-- Logs begin at Sun 2022-09-25 00:10:39 UTC, end at Sun 2022-09-25 02:49:48 UTC. -- Sep 25 00:43:28.560670 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:43:28 2022] *** Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: nodename: n-d-master-1 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: machine: x86_64 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: clock source: unix Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: pcre jit disabled Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: detected number of CPU cores: 4 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: current working directory: / Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: your processes number limit is 47680 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: your memory page size is 4096 bytes Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: detected max file descriptor number: 2048 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: lock engine: pthread robust mutexes Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: thunder lock: enabled Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 25 00:43:28.573434 n-d-master-1 devstack@keystone.service[81850]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:43:28.611453 n-d-master-1 devstack@keystone.service[81850]: Python main interpreter initialized at 0x55c09e8ab9c0 Sep 25 00:43:28.611453 n-d-master-1 devstack@keystone.service[81850]: python threads support enabled Sep 25 00:43:28.611453 n-d-master-1 devstack@keystone.service[81850]: your server socket listen backlog is limited to 100 connections Sep 25 00:43:28.611453 n-d-master-1 devstack@keystone.service[81850]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:43:28.611877 n-d-master-1 devstack@keystone.service[81850]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:43:28.611877 n-d-master-1 devstack@keystone.service[81850]: *** Operational MODE: preforking *** Sep 25 00:43:28.612170 n-d-master-1 devstack@keystone.service[81850]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:43:28.612170 n-d-master-1 devstack@keystone.service[81850]: spawned uWSGI master process (pid: 81850) Sep 25 00:43:28.612383 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Sep 25 00:43:28.614075 n-d-master-1 devstack@keystone.service[81850]: spawned uWSGI worker 1 (pid: 81862, cores: 1) Sep 25 00:43:28.614075 n-d-master-1 devstack@keystone.service[81850]: spawned uWSGI worker 2 (pid: 81863, cores: 1) Sep 25 00:43:28.614075 n-d-master-1 devstack@keystone.service[81850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:43:32.977868 n-d-master-1 devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:43:32.977868 n-d-master-1 devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 25 00:43:32.978743 n-d-master-1 devstack@keystone.service[81862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:43:32.978743 n-d-master-1 devstack@keystone.service[81862]: from cryptography.utils import int_from_bytes Sep 25 00:43:32.979159 n-d-master-1 devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:43:32.979159 n-d-master-1 devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 25 00:43:32.979265 n-d-master-1 devstack@keystone.service[81862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:43:32.979265 n-d-master-1 devstack@keystone.service[81862]: from cryptography.utils import int_from_bytes Sep 25 00:43:33.028765 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:43:33.028959 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:43:33.029039 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:43:33.029122 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:43:33.029201 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] command line args: [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:43:33.029277 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] command line args: [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:43:33.029393 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:43:33.029504 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:43:33.029611 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ================================================================================ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:43:33.029697 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ================================================================================ {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:43:33.029871 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.029961 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] admin_token = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030121 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] config_dir = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030207 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] config_dir = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030315 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030400 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030499 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] config_source = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030586 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] config_source = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030663 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] debug = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030733 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] debug = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.030862 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031119 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031216 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031282 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031410 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031514 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031641 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031753 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.031890 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032001 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032109 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032210 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032344 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_config_append = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032461 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_config_append = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032571 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032667 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032762 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_dir = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032863 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_dir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.032966 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_file = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033072 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033174 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033298 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033435 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033546 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033653 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033780 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.033898 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034016 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034142 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034225 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034307 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034384 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034508 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034589 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034666 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034790 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034876 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.034948 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035062 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035142 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035214 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035283 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035438 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035520 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035685 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035777 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.035931 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036048 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036203 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036328 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036694 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036811 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.036933 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] publish_errors = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037042 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] publish_errors = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037154 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037265 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037385 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037539 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037539 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037741 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037852 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.037989 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038113 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038229 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038347 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] standard_threads = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038452 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] standard_threads = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038571 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038684 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038803 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.038922 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039081 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039197 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039365 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] use_journal = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039365 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] use_json = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039587 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] use_journal = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039706 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] use_stderr = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.039855 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] use_json = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040023 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] use_syslog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040149 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] use_stderr = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040269 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040391 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] use_syslog = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040511 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.040626 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:43:33.040739 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.040859 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.040978 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041093 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041212 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041326 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041455 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041582 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041699 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041813 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.041925 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042044 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042157 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042278 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042393 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042513 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042627 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042739 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042857 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.042980 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043094 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043212 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043332 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043452 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043572 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043704 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043823 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.043933 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044051 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044164 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044276 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044396 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044512 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044630 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044750 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044864 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.044976 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045167 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045288 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045416 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045549 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045663 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045775 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.045900 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046016 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046135 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046248 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046362 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046485 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046600 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046714 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046832 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.046945 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047064 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047185 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047299 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047411 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047523 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047640 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047754 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047874 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.047994 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048113 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048226 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048339 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048451 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048574 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048688 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048801 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.048914 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049032 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049145 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049269 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049389 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049562 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049685 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049800 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.049918 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050030 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050144 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050263 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050382 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050495 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050607 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050799 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.050916 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051028 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051141 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051253 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051366 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051487 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051602 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051720 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051833 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.051953 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052067 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052192 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052307 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052420 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052532 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052644 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052763 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.052887 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053002 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053114 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053227 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053339 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053474 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053601 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053716 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053829 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.053980 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054103 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054229 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054345 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054458 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054594 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054746 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054862 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.054984 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055099 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055248 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055408 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055534 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055650 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055772 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.055899 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056022 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056139 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056252 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056365 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056484 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056598 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056720 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056720 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056935 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.056935 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057149 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057268 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057390 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057554 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057680 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057797 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.057911 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058024 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058146 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058262 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058376 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058489 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058614 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058730 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058852 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.058967 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059081 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059196 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059310 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059423 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059545 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059645 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059742 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059838 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.059933 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060028 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060132 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060239 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060336 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060432 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060528 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060623 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060726 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060726 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060949 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.060949 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061154 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061154 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061376 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061376 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061615 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061721 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061833 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.061833 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062125 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062234 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062349 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062462 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062568 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062690 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062817 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.062941 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063057 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063161 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063274 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063388 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063498 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063620 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063736 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063852 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.063969 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064083 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064202 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064325 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064432 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064545 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064659 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064773 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064877 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.064998 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065119 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065234 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065348 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065476 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065594 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065747 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065873 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.external = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.065998 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.external = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066120 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066247 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066368 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066485 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066602 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066724 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066841 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.password = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.066956 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.password = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067077 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.token = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067194 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] auth.token = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067309 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067431 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067547 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067663 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067778 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.067894 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068015 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068141 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068258 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068379 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068503 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068625 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068742 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068865 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.068981 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069096 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069210 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069324 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069485 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069617 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069737 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069853 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.069975 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.070092 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.070704 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.070835 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.070978 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071139 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071261 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071377 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071492 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071620 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071744 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071862 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.071978 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072093 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072208 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072332 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072450 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072565 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072565 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072790 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.072906 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073029 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073145 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073261 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073376 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073506 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073621 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073749 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073868 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.073987 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074103 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074218 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074333 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074457 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074573 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074689 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074804 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.074920 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075043 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075161 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075276 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075391 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075506 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075621 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075748 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.075865 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076000 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076118 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076239 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076356 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076547 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076666 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076781 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.076897 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077013 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077129 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077252 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077369 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077501 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077617 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077732 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077858 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.077984 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078102 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078217 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078333 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078448 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078572 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078696 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078813 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.078919 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079034 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079149 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079265 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079388 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079504 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079619 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079734 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079849 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.079962 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080085 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080203 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080318 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080434 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080550 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080666 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080839 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.080959 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081074 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081189 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081305 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081448 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081579 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081698 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081814 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.081929 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082044 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082165 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082291 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082408 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082524 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082639 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082754 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082869 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.082991 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083108 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083228 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083346 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083461 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083576 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083699 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083816 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.083936 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084051 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084166 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084281 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084405 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084522 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084637 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084751 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084866 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.084981 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085103 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085220 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085335 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085465 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085582 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085710 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.085828 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.086498 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.086623 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.086739 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.086854 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.086978 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087176 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087296 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087402 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087517 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087638 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087638 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087865 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.087980 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088095 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088211 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088331 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088461 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088580 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088695 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088818 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.088938 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089055 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089178 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089295 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089429 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089553 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089670 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089784 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.089912 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090029 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090145 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090260 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090375 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090489 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090615 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090733 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090848 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.090963 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091078 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091192 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091315 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091431 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091546 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091546 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091762 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091762 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.091985 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092101 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092217 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092331 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092445 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092560 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092682 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092799 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092915 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.092915 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093130 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093244 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093367 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093591 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093708 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093827 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.093942 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094057 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094184 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094302 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094417 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094532 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094646 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094761 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.094885 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095001 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095116 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095231 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095346 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095461 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095584 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095700 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095814 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.095930 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096045 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096159 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096282 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096399 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096514 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096629 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096744 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096858 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.096982 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097099 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097214 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097328 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097456 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097572 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097699 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097818 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.097933 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098049 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098163 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098277 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098400 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098517 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098632 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098747 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098861 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.098982 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099107 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099223 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099338 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099452 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099566 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099681 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099871 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.099989 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] role.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100106 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100220 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] role.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100336 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100451 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100574 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] role.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100690 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100805 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] role.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.100920 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101036 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101159 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101276 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101390 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101594 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101740 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101840 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.101971 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102090 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102237 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102400 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102521 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102636 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102760 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102877 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.102993 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103107 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103222 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103338 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103460 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103577 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103692 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103812 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.103812 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104029 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104153 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104270 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104270 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104487 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104602 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104716 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104840 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.104956 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105071 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105186 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105300 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105464 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105596 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105715 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105831 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.105946 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106061 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106184 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106300 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106417 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106532 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106647 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106761 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.106888 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107005 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107120 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107235 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107350 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107465 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107588 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107704 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107819 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.107933 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108048 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108162 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108284 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108400 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108516 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108631 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108745 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108859 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.108981 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109097 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109212 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109327 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109455 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109573 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109700 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109818 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.109933 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110048 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110163 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110278 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110401 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110517 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110633 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110748 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110863 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.110977 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111089 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111205 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111320 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111434 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111549 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111665 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111787 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.111903 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112027 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112152 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112269 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112383 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112498 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112625 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.connection = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112750 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112878 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.112996 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113111 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113225 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113340 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113469 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113599 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113724 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113840 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.113954 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114070 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114185 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114309 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114426 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114541 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114656 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114773 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.114890 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115281 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115406 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115523 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115639 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115756 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.115872 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116000 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116118 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116234 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116349 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116465 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116581 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116705 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116822 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.116939 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117074 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117231 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117351 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117498 n-d-master-1 devstack@keystone.service[81862]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:43:33.117619 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117619 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:43:33.117619 n-d-master-1 devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:43:33.146203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.146399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.146482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.146557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.146631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.146705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.155227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.155341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.184747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.184951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.185040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.185186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.238863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.239019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.289419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.289599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.289744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.289926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.446977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.447130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.447223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.447359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.447589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.447810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.448029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.471929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.472697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.483896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.484189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.497423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.497598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.497686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.497839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.497933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81862) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.498920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 25 00:43:33.515860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.516067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:43:33.516419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.516534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.516622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:43:33.516749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:43:33.516925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 25 00:43:33.517385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.517887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.518149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.518411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.528153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.528433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.528673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.528773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.528958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.529041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.529234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.529548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.535981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.536552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.538961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.539294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.539548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.539645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.539837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.539923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.540996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.541853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.542033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.542303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.565151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.565752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.566659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.566950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.567237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.567526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.571694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.571983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.572267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.572468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.572757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.573039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.578668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.578959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.579443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.579764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.584853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.585153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.585468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.585598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.585757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.586429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.586767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.586849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.587889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.588158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.603449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.603724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.603838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.604122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.607613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.608021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.610895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.611191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.611286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.611565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.615442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.615817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.619135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.619628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.622407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.622707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.622896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.623852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.624048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.624344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.639999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.640290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.640534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.640620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.640809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.640889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.641080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.641345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.647705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.648237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.649926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.650458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.651458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.651736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.651991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.652268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.654521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.654826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.655111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.655207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.655396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.655478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.655715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.655804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.656000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.656389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.667109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.667399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.667679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.667766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.667959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.668976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.669191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.669499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.685144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.686437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.688118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.689374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.691048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.692285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.692481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.693877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.694099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.694386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.694785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.695907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.696192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.696580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.701741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.703075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.703193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.704532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.706113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.706511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.706801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.707084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.707443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.707838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.708125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.708409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.715176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.715474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.715760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.716315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.716609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.716892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.722685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81862) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.722972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.723256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.723533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.723818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.723902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 25 00:43:33.724094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.724914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.725848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81862) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.726828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.727094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.727386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 25 00:43:33.763096 n-d-master-1 devstack@keystone.service[81862]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c09e8ab9c0 pid: 81862 (default app) Sep 25 00:43:33.763232 n-d-master-1 devstack@keystone.service[81863]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c09e8ab9c0 pid: 81863 (default app) Sep 25 00:43:33.766477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468389b0-4bd6-40f3-9a81-fc30e3f5d756 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:33.766768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468389b0-4bd6-40f3-9a81-fc30e3f5d756 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:33.767045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468389b0-4bd6-40f3-9a81-fc30e3f5d756 None None] PATH_INFO: `/v3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:33.771210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sun Sep 25 00:43:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:40.735725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494c3d-6efb-428c-a702-772038855801 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:40.736229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494c3d-6efb-428c-a702-772038855801 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:40.736229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494c3d-6efb-428c-a702-772038855801 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:40.740506 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:40.746279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:40.746848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:40.746848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:40.817499 n-d-master-1 devstack@keystone.service[81862]: INFO dbcounter [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] Registered counter for database keystone Sep 25 00:43:40.836573 n-d-master-1 devstack@keystone.service[81862]: DEBUG oslo_db.sqlalchemy.engines [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:43:40.842845 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writer thread running {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:43:41.024269 n-d-master-1 devstack@keystone.service[81862]: DEBUG passlib.handlers.bcrypt [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81862) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 00:43:41.024664 n-d-master-1 devstack@keystone.service[81862]: DEBUG passlib.handlers.bcrypt [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81862) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 00:43:41.084206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:41.085925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:41.217437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 25 00:43:41.584136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494c3d-6efb-428c-a702-772038855801 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:41.656220 n-d-master-1 devstack@keystone.service[81863]: INFO dbcounter [None req-9f494c3d-6efb-428c-a702-772038855801 None None] Registered counter for database keystone Sep 25 00:43:41.678240 n-d-master-1 devstack@keystone.service[81863]: DEBUG oslo_db.sqlalchemy.engines [None req-9f494c3d-6efb-428c-a702-772038855801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:43:41.685372 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writer thread running {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:43:41.806586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494c3d-6efb-428c-a702-772038855801 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:41.811325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:41.811963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:41.812239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:41.812505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:41.821712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:41.874648 n-d-master-1 devstack@keystone.service[81863]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 00:43:41.875031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa72d40-0ec4-47e7-bed9-57964a15d5f1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:41.886554 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 25 00:43:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:43:41.892758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:41.910996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a7930-57b0-41a3-8bb4-4930d4225bda None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:41.915553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:41.916760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:41.917041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:41.917321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] PATH_INFO: `/v3/projects/703ca81b507b4a13a3d49269a53cbe77` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:41.919010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] RBAC: Authorizing `identity:get_project(project_id=703ca81b507b4a13a3d49269a53cbe77)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:41.973121 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 25 00:43:41.973484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa02bf-0408-42e2-864f-3cabecc7249b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:41.978637 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sun Sep 25 00:43:41 2022] GET /identity/v3/projects/703ca81b507b4a13a3d49269a53cbe77 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:44.140037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85b0d-d2bc-4d7c-9285-2819935f6f89 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.140588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85b0d-d2bc-4d7c-9285-2819935f6f89 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.140588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85b0d-d2bc-4d7c-9285-2819935f6f89 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.144735 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:44.151026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.151450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.151579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.172176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:44.173801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:44.181869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 25 00:43:44.453217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af85b0d-d2bc-4d7c-9285-2819935f6f89 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:44.466174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af85b0d-d2bc-4d7c-9285-2819935f6f89 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:44.470373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:44.470988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.471267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.471538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.479627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:44.481452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef513a-31ae-4179-abc0-0a06270a4cb1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:44.490225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 25 00:43:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 00:43:44.496479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:44.505867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97bb91-0204-479f-8156-16fe8a3c44f0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:44.511209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:44.511775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:44.512066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:44.512340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:44.513692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:44.515552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c512bf-1012-41e8-b3ca-a97b73eb3fa8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:44.517117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sun Sep 25 00:43:44 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:46.775165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01351-309c-4c86-9eb5-7fdf7dc5fc91 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:46.775718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01351-309c-4c86-9eb5-7fdf7dc5fc91 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:46.775718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01351-309c-4c86-9eb5-7fdf7dc5fc91 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:46.777021 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:46.782412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:46.782825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:46.782970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:46.801042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:46.802257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:46.860403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39eae-3a9c-4682-872b-1c0690e000ee None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:46.860690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39eae-3a9c-4682-872b-1c0690e000ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:46.860971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39eae-3a9c-4682-872b-1c0690e000ee None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:46.862404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:46.868424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:46.868813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:46.869104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:46.888459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:46.912983 n-d-master-1 devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81863) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 25 00:43:46.913376 n-d-master-1 devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81863) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 25 00:43:46.963748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:46.965364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:47.071106 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:43:47.161482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.187344 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.268614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e87937-11a7-4c7d-a477-e1b2c519328c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.302371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.303003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.303279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.303554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.315087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:47.324489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:47.325378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:43:47.326220 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:47.332872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.371288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.437353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256085ac-0f59-49da-92bf-5a598a03be4e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.440549 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.456530 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.477023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7345-171e-4a82-8b76-2747516348e9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.479457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.480369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.480650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.480925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.481803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:47.482111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.483569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.496279 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:47.502920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.512678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.513301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.513605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.513883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.596136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.597589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.610123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cfcdc-e0c5-4cc2-b26d-11e04ea87001 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.646003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.647049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.647330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.647605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.650127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.651508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.653008 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:47.658651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.683668 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.694389 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.706718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:43:47.712344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.777395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb09de-aa68-4d4e-8c60-4ce592d7ee3c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.814591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.815250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.815525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.815793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.816148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49d07-0a42-4b17-b830-50a3831b8d34 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.816958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.818487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.820739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:47.826806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.855570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.856140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.856420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.856693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.868882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.870417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:47.888058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:47.889053 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:47.889892 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:47.889892 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:47.889892 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:43:47.889892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:47.895478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:47.933254 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.937782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a11d9-ff86-4b54-9e4b-bfc5afbd5837 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:47.939547 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:47.974838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:47.975452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:47.975757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:47.976027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:47.977107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.domain.id=default, user.id=90697e4fcb7e4bb39c8b9cc770ece301) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:47.977438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:47.978929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134dcd-f740-418a-a20f-dc81a2a47981 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:47.988080 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/role_assignments?user.id=90697e4fcb7e4bb39c8b9cc770ece301&scope.domain.id=default&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:48.014374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c513-a6d0-4d67-8025-17c8d37c0da8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:48.057350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:48.058012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:48.058298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:48.058574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:48.059243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:48.059546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:48.060969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e551433-c80b-47bf-8226-7eeffe777917 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:48.081649 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:50.540971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e80c3-5029-4a45-8e4f-ec7bc1789de8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.542021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e80c3-5029-4a45-8e4f-ec7bc1789de8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.542541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e80c3-5029-4a45-8e4f-ec7bc1789de8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.544472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:50.549789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6036a2-8473-4703-95cc-534c1020b20b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.550751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6036a2-8473-4703-95cc-534c1020b20b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.551230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6036a2-8473-4703-95cc-534c1020b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.578604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5d6036a2-8473-4703-95cc-534c1020b20b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:50.579853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d6036a2-8473-4703-95cc-534c1020b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:50.672858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc33ea-0304-49bf-b42d-907dac607f53 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.673521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc33ea-0304-49bf-b42d-907dac607f53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.674007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc33ea-0304-49bf-b42d-907dac607f53 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.675678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:43:50.682582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.683222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.683700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.687305 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:50.733340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:50.734958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:50.817889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a671-f762-45d9-807e-6a95f727cb76 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.819340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a671-f762-45d9-807e-6a95f727cb76 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.820653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a671-f762-45d9-807e-6a95f727cb76 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.822437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 12/25] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:50.829069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4c63-5826-443b-a627-11e61ed4ad05 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:50.830447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4c63-5826-443b-a627-11e61ed4ad05 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:50.831125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4c63-5826-443b-a627-11e61ed4ad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:50.848562 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 25 00:43:50.862483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a6d4c63-5826-443b-a627-11e61ed4ad05 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:50.864035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a6d4c63-5826-443b-a627-11e61ed4ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:50.890284 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:50.963276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:51.180714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:51.298075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de75ce-cabf-452e-8285-245b4ef7e200 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.298448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de75ce-cabf-452e-8285-245b4ef7e200 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.298651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de75ce-cabf-452e-8285-245b4ef7e200 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.300276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:51.301601 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:51.305772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.306057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.306330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.313426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50c0e-dc8a-4906-9ecb-5eabc0358317 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:51.340825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:51.342429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:51.388674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:51.389338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.389646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.389920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.425429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:51.439022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:51.439950 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:51.440705 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:43:51.441448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:51.442574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:51.446427 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:43:51.447300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:51.611213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee029f-bc23-49a8-b252-1a82c1a9ec35 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:51.645092 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:51.680546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:51.681557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.681987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.682794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.684685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f5b4-99f9-459a-8905-4ce3422e11a8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:51.723180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:51.724709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:43:51.757842 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:51.759004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:43:51.759831 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:43:51.759831 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:43:51.759831 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:43:51.759831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:51.760230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:51.777982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:51.778617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.778894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.779167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.779867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:51.780152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:51.781618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:51.796592 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:51.810720 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:51.811653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:51.914345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e00a-20f0-4fb7-8f5f-b3bb30b44ded None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:51.947694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e16013-596c-4959-a081-ffd6f8e2e1f2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:51.956737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:51.957779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.958271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.958687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.959532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:51.961651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:51.994907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:51.996000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:51.996464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:51.996925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:51.997825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:51.998313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.000009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.019054 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:52.020264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:52.030698 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:52.107487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 25 00:43:51 2022] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:52.109286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:52.137448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a8cd3-4896-400a-ad84-3f98ffbc0823 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:52.188055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:52.188627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.188911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.189187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.193797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.195379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.197442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:52 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:52.204688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:52.240501 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:52.319768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618028-cc7a-4125-99a1-751eb806b9a8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:52.364924 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:52.401999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:52.402190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4aeac-0d5a-432c-8140-c420e24f9c43 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:52.403048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.403341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.403623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.404323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.406380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.430948 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 25 00:43:52 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:52.432657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:52.464580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:52.465276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.465717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.466088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.466871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.468505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98ccd3-119d-4a96-be61-5ec0f45e50fb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.585987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c28d-10fb-44b1-9c7b-ede6ac718b99 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:52.619331 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:52.631833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:52.633757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.634353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.634754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.636444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.638284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4d39-13e5-40c0-8641-b07def2f32e1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.640190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:52.641790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6bc4-af46-45ff-b6f2-27319dfdab00 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.642188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6bc4-af46-45ff-b6f2-27319dfdab00 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.642612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6bc4-af46-45ff-b6f2-27319dfdab00 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.644273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:52.650405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6bc4-af46-45ff-b6f2-27319dfdab00 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:52.743296 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:43:52 2022] POST /identity/v3/projects => generated 301 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:52.745657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.746104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.746531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.768607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:52.770252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:52.783945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6bc4-af46-45ff-b6f2-27319dfdab00 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:52.823149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:52.823835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.824117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.824394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] PATH_INFO: `/v3/domains/default/users/90697e4fcb7e4bb39c8b9cc770ece301/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.826491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=90697e4fcb7e4bb39c8b9cc770ece301, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:52.828002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d4b2-1ce4-454d-9434-f14f66c56400 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:52.853438 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1361 bytes} [Sun Sep 25 00:43:52 2022] PUT /identity/v3/domains/default/users/90697e4fcb7e4bb39c8b9cc770ece301/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:43:52.853438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473bad-3333-446e-8276-d08a322efac4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.853438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473bad-3333-446e-8276-d08a322efac4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.853438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473bad-3333-446e-8276-d08a322efac4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.853438 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 22/41] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:52.855336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:52.855712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:52.856095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:52.863026 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:52.878110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:52.880018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:52.948408 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:52.972465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:43:53.162758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.223397 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.246740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.271699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab8e6-7263-40c0-bf59-0f935d20e26d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.307482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.308207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.308490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.308785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.309566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.311211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:53.329127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 21/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 25 00:43:53 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:53.360395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99162-b43e-405a-8a3a-95728dfeb726 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.403851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.404522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.404806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.405080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.406359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.407869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203c774-afd9-4abc-8305-1615753f666a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:53.409817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:53.416398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:53.536025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae439-f74b-499d-a9fd-744ffc327541 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:53.555948 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:53.578186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a416627-a707-45db-af21-98394fa92737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:53.579047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416627-a707-45db-af21-98394fa92737 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:53.579330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416627-a707-45db-af21-98394fa92737 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:53.579603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416627-a707-45db-af21-98394fa92737 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:53.580303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a416627-a707-45db-af21-98394fa92737 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:53.581824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a416627-a707-45db-af21-98394fa92737 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:53.610320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:43:53 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:55.107130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be871d-c363-45c8-a39e-d537517809f5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.107667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be871d-c363-45c8-a39e-d537517809f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.107770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be871d-c363-45c8-a39e-d537517809f5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.109070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:55.114811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.115293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.115401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.135536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:55.136772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:55.211507 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:55.480769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be871d-c363-45c8-a39e-d537517809f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:55.540379 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:55.585339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be871d-c363-45c8-a39e-d537517809f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:55.618958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:55.619585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.619869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.620146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.630347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:43:55.635906 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:43:55.636993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:43:55.637898 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:43:55.643083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:55.747494 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:55.752149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fccd-581d-464a-b390-0c3e78da3da3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:55.789268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:55.789974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.790258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.790529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.791210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:55.791515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:55.792930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c18694-72dd-479e-a088-65166c9f0650 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:55.801666 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:55.808044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:55.820217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c76d1-d7cc-425e-84c8-3ba8f707d2e4 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.820522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c76d1-d7cc-425e-84c8-3ba8f707d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.820801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c76d1-d7cc-425e-84c8-3ba8f707d2e4 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.822198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:55.828388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.828796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.829157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.847907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:55.849123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:55.912686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411312-6e5f-43f8-b3f0-11f68b15bbd8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:55.919483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:43:55.926868 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:55.948931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:55.949608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:55.949894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:55.950171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:55.951296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:55.952757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:55.954372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:43:55 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:55.959973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:56.048511 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:56.059139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057b51-86d9-4f5b-877b-3076bc76ef5f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:56.092545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:56.093179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.093485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.093759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.094872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:56.096321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:56.097918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:56.104380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:56.201593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:56.202867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a54-9885-439e-8e19-c880bd451f7e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:56.238415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:56.239030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.239317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.239588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.240358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.domain.id=default, user.id=90697e4fcb7e4bb39c8b9cc770ece301) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:43:56.240662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:56.242796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:56.248681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 25 00:43:56 2022] GET /identity/v3/role_assignments?user.id=90697e4fcb7e4bb39c8b9cc770ece301&scope.domain.id=default&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:56.317024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31cb3-0656-442b-9131-db24d38c494a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:56.355518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:56.356175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.356465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.356747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.357930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:56.359407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4c29-8f61-4f70-8a9a-7e1d7e4740c2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:56.361210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:43:56.366919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:56.419832 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:56.478319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550b419-c185-4cd1-ae01-eed02bc407df None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:56.513008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:56.513657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:56.513941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:56.514216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:56.514869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:56.516343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc4354-c843-4e70-965e-187db18fcdef None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:56.545550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 25 00:43:56 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:43:58.752373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef979-0407-40f8-8118-1eba3efaa693 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:58.752917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef979-0407-40f8-8118-1eba3efaa693 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:58.752917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef979-0407-40f8-8118-1eba3efaa693 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:58.754280 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:43:58.760668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:58.761151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:58.761237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:58.884188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:43:58.885432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:43:58.951379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:43:59.221960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef979-0407-40f8-8118-1eba3efaa693 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:59.249091 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:59.323223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef979-0407-40f8-8118-1eba3efaa693 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:59.357470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:59.358180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:59.358417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:59.358689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:59.359789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:59.361252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa08ce9-3ab0-434d-a63b-ecc8df306e12 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:59.362844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:43:59.368998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:43:59.396217 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:43:59.468568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aed6-f098-407a-af81-e78c64f4e019 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:43:59.503049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:43:59.503584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:43:59.503867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:43:59.504136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:43:59.504791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:43:59.506286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bc3fd-7eb0-483a-a1c3-f5895361d54a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:43:59.535453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:43:59 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:02.955349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575194-4195-43a3-96fa-197bae9ed87a None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:02.956372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575194-4195-43a3-96fa-197bae9ed87a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:02.956873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575194-4195-43a3-96fa-197bae9ed87a None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:02.958708 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:02.965140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2600-398d-4cdf-9daa-ccccbdcf9725 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:02.966080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2600-398d-4cdf-9daa-ccccbdcf9725 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:02.966557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea2600-398d-4cdf-9daa-ccccbdcf9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:02.994509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-91ea2600-398d-4cdf-9daa-ccccbdcf9725 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:02.996071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-91ea2600-398d-4cdf-9daa-ccccbdcf9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:03.098994 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:03.231100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61b35-ba7d-41f6-b2f0-a63712ac631b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.231715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61b35-ba7d-41f6-b2f0-a63712ac631b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.232217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61b35-ba7d-41f6-b2f0-a63712ac631b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.233900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:03.240240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.240874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.241506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.271185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:03.272913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:03.286328 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:03.357269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7fa80-33b2-4183-b151-39fbb922ff5c None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.357873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7fa80-33b2-4183-b151-39fbb922ff5c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.358382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7fa80-33b2-4183-b151-39fbb922ff5c None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.359941 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 33/65] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:03.364495 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:03.365768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c776e-03bf-4f5a-99f6-8f7f1e4cb12b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.366266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c776e-03bf-4f5a-99f6-8f7f1e4cb12b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.366993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c776e-03bf-4f5a-99f6-8f7f1e4cb12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.410428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-438c776e-03bf-4f5a-99f6-8f7f1e4cb12b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:03.417926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-438c776e-03bf-4f5a-99f6-8f7f1e4cb12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:03.509990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:03.602326 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:03.605492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f548-02bd-483e-9c07-e8721a8835ea None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.606878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f548-02bd-483e-9c07-e8721a8835ea None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.608007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f548-02bd-483e-9c07-e8721a8835ea None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.611566 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 35/68] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:03.618865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.619215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.619417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.639754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:03.640993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:03.660696 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:03.694667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b7d9-7a4e-4080-bf5a-b4b939375616 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:03.725572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:03.727022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:03.771189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:03.772280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.773311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.773877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.809489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:03.831598 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:03.833522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:03.835395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:03.847012 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:03.850554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e96757-2835-492e-b2f4-d70cfd20bb40 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:03.856160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:03.867302 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:03.892671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:03.893621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:03.894052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:03.894532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:03.906432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:03.911753 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:03.912584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:03.914094 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:03.916699 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 37/71] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:03.917913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:03.934957 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.006610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41e05-dc25-4be3-b4db-7e92de38ad86 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.024725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdf65d-9aab-402f-b25a-55ef1e53c63c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.045936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.046557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.047276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.047562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.048691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:04.049010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.050974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542a2f9-1bc6-4913-a8a5-e2ae1ff07be4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.060469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:04.061515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f657-f3b8-46c3-9b83-e1cd0bf061ea None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.061964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f657-f3b8-46c3-9b83-e1cd0bf061ea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.062385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f657-f3b8-46c3-9b83-e1cd0bf061ea None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.062495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.063245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.063636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.064015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.064620 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 36/73] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:04.065492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4f657-f3b8-46c3-9b83-e1cd0bf061ea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.077316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:04.083484 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:04.084510 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:04.090565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.147465 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.167343 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.190394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4f657-f3b8-46c3-9b83-e1cd0bf061ea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.194872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94cec-7793-4f3d-bd9a-1770d5f9cd32 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.229662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.230289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.230576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.230853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.231671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.232288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.232696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.232980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.233842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:04.234126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.235528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c4746-bd48-46ed-aae1-1d4de93d3b32 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.245294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.245480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.246568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.246853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.246949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.247123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.248698 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.250922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.266445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:04.267660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:04.335893 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:04.336854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.349516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8884d-ad05-423e-9afc-81711abb76f8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.386629 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.397609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.398757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.399342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.399885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.400705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:04.401298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.403572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.416510 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.417029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.417936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.459600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19b99a-bf84-4666-af3b-5a04dea6abce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.500365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.501368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.501815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.502272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.516451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:04.523431 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:04.524912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:04.525884 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:04.529567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:04.530890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.537838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be1eba-e692-4aee-a4ee-313306c97a39 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.579049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.579701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.580164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.580450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.582050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.583847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.590689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.590689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.647183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f028f-a52a-4e9b-a589-fef6af5e71df None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.649819 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.666507 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.684714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.685335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.685663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.685934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.690873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe408e-c7d5-47bf-b4b2-e36491ff39fe None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.724343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.724977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.725258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.725563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.727499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.728956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.730820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.731354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.758899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.760400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.838261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8234-ed44-49d9-ab47-4010a87b239c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:04.865954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:04.867099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.873787 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.880406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:04.881019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:04.881298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:04.881607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:04.883202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:04.883507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:04.885002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:04.886879 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:04.893942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:04.894759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:04.970073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5b79-d878-40a7-abc1-b1dbaa148523 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.000885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b91d-a831-400e-b0bf-ce7989341348 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.005851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.006470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.006756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.008093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.035971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.036608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.036907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.037186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.038498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.039995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.041631 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 44/84] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.042412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.083550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.086374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.103662 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.115614 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.157735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109415d5-c0fc-4667-b085-1546148f14e7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.193274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.193915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.194193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.194492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.201393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 41/85] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:05.206357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.263335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.264824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.305084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8755da-ffbd-4d96-bcd0-5d8e82e396a7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.327730 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.331748 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.347948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.348652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.348936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.349209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.350360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.352708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.354388 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.355159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.383652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 45/87] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:05.384843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.483523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca6a3-064c-4239-9da3-0abd76fc6ce9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.506519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef26d-b874-4b51-8757-6798d2821127 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.526804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.527456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.527894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.528015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.529290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.530792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.532415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 43/88] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.537917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.547880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.548514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.548801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.549076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.549797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.551348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.589719 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 46/89] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:05 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:05.590729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.614352 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.619524 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.698877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1c2d-3fc0-4732-a99e-7394dc6bbb91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.739698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.740649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.741115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.742130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.742910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7684c6-f3aa-44a5-986c-b3e90eacc94f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.743755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.745478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.747559 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.748692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.791604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.792240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.792520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.792792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.793571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:05.793919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.796044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.805671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.806623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.887212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eef89-2efa-4e84-a5c5-056ae29fb716 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.917045 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.930224 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:05.931220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.932104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.932623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.933221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] PATH_INFO: `/v3/projects/d44d0798489d4a9cbf1ace02c48f3713` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:05.935252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] RBAC: Authorizing `identity:get_project(project_id=d44d0798489d4a9cbf1ace02c48f3713)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:05.937006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:05.939234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/projects/d44d0798489d4a9cbf1ace02c48f3713 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:05.940337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:05.952357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7a10d-e8b8-4377-93a5-91dff3d3c4b0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:05.998284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:05.998889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:05.999181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:05.999462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:06.076900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cfcf-3373-49ac-a179-ee22521704bd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:06.099148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:06.101835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:06.124482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:06.125118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:06.125417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:06.125699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:06.126448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=90697e4fcb7e4bb39c8b9cc770ece301) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:06.126758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:06.128220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:06.135715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/role_assignments?user.id=90697e4fcb7e4bb39c8b9cc770ece301&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:06.136376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:06.200081 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:06.213574 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:06.237497 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:06.244214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:06.249982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d2fc-de9e-438a-9802-089cc3912501 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:06.289079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=d44d0798489d4a9cbf1ace02c48f3713, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:06.293498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:06.302641 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:06 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=d44d0798489d4a9cbf1ace02c48f3713&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:06.419837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1d86-9609-4e19-8dcb-5c92737656cb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:06.477121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:06.477812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:06.478096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:06.478370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:06.479632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:06.481266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777362f-c4b3-4e88-9eb0-43db59b83c44 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:06.487372 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:06 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:06.494420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:06.617673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5abd-5d15-4ef7-a75b-df0ddad8b13b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:06.642851 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:06.661784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:06.662405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:06.662692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:06.662965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:06.663920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:06.664235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:06.665820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be969f2-5245-4125-9479-6575f8fe117e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:06.671995 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:06 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=43b01aadcec14574861255a746ef1a34 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:08.692501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7666c7-5dd2-4756-be42-c646aa95ba71 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:08.693584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7666c7-5dd2-4756-be42-c646aa95ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:08.694084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7666c7-5dd2-4756-be42-c646aa95ba71 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:08.696041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:08.702576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3ca5-7faf-4d4e-8d3a-d82eec37a68a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:08.703593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3ca5-7faf-4d4e-8d3a-d82eec37a68a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:08.704081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3ca5-7faf-4d4e-8d3a-d82eec37a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:08.726651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921340-f900-49a0-834d-827617bbbb23 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:08.727277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921340-f900-49a0-834d-827617bbbb23 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:08.727798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921340-f900-49a0-834d-827617bbbb23 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:08.729461 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 51/99] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:08.732707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1c0b3ca5-7faf-4d4e-8d3a-d82eec37a68a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:08.735318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ac8e-5081-4319-9934-7d9e2c902025 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:08.735843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ac8e-5081-4319-9934-7d9e2c902025 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:08.736337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ac8e-5081-4319-9934-7d9e2c902025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:08.745305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c0b3ca5-7faf-4d4e-8d3a-d82eec37a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:08.767474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1608ac8e-5081-4319-9934-7d9e2c902025 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:08.771654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1608ac8e-5081-4319-9934-7d9e2c902025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:08.879416 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:08.911808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 49/100] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:08.924567 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 52/101] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:09.017382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783199b-ac59-4853-a9a4-8f6c2d1a17f4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.018130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783199b-ac59-4853-a9a4-8f6c2d1a17f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.018613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783199b-ac59-4853-a9a4-8f6c2d1a17f4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.020158 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 50/102] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:09.026668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.027209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.027682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.046892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:09.048391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:09.125512 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 53/103] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:09.456672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783199b-ac59-4853-a9a4-8f6c2d1a17f4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.458702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.602319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783199b-ac59-4853-a9a4-8f6c2d1a17f4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:09.620483 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:09.644205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:09.644779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.645070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.645353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.646581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:09.649171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:09.650918 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:09.651856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.695550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26936e-c47e-4c7d-987d-99ed11e308ec None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:09.744043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:09.745183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.745685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.746268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.749730 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:09.758946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:09.764920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:09.765787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:09.766560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:09.767120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee9312-c09a-43e6-8b9b-096bf473f0d8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:09.769294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:09.770586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.803469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:09.804277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.804474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.804745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.816030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:09.821581 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:09.822445 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:09.823612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.873637 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:09.887111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e4c9-591d-46db-a734-1033780d26ca None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:09.928828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:09.929834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.930332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.930905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.931769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:09.933575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2b7ee-c515-4cd9-a972-70a479127eb9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:09.943585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543132-d99c-45f7-893f-910616d6b1de None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:09.964525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 55/107] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:44:09 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:09.966483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfc01-abea-4355-b33a-ffa891def43d None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.967007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfc01-abea-4355-b33a-ffa891def43d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.967654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfc01-abea-4355-b33a-ffa891def43d None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.969710 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 56/108] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:09.971112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bfc01-abea-4355-b33a-ffa891def43d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:09.985445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:09.986176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:09.986463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:09.987279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:09.987668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:09.988039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:09.989753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af5e4b-471c-4f6b-94d0-5df056fa4af9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:09.999444 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:10.000778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.001071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.001352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.013812 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.023158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:10.024526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:10.108548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bfc01-abea-4355-b33a-ffa891def43d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.127954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 54/110] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:10.129900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.148483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.149122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.149427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.149724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.150707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:10.150841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:10.152220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a65b7-c249-4857-860b-3009505e67f3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:10.163723 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 57/111] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:10.165374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b254-9d67-4c44-9562-1f87f51a5afd None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.165580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b254-9d67-4c44-9562-1f87f51a5afd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.165819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b254-9d67-4c44-9562-1f87f51a5afd None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.167174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:10.172261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008b254-9d67-4c44-9562-1f87f51a5afd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.178559 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.273427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbfbea-8041-49ba-b4e8-193910657776 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.282233 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.306877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008b254-9d67-4c44-9562-1f87f51a5afd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.319043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.320193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.320666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.320948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.322391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:10.323876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7b04d-bf0c-424d-bc0a-4b9a03f08e35 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:10.325938 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 55/113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:10.327520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d652f-812c-465d-9b89-126cb6d2e4a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.327808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d652f-812c-465d-9b89-126cb6d2e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.328084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d652f-812c-465d-9b89-126cb6d2e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.352336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-730d652f-812c-465d-9b89-126cb6d2e4a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:10.353589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-730d652f-812c-465d-9b89-126cb6d2e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:10.366543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.367228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.367514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.367804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] PATH_INFO: `/v3/users/6652b68058c24472bb77f1757b7e3373` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.382913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] RBAC: Authorizing `identity:get_user(user_id=6652b68058c24472bb77f1757b7e3373)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:10.384546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:10.386539 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 59/114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/users/6652b68058c24472bb77f1757b7e3373 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:10.393454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.491725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 56/115] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:10.494387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95de72-5fac-4897-a44e-9a32b7b632b8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.494906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95de72-5fac-4897-a44e-9a32b7b632b8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.495409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95de72-5fac-4897-a44e-9a32b7b632b8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.498197 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 57/116] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:10.499517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95de72-5fac-4897-a44e-9a32b7b632b8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.511937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b74c-5e89-451e-9d66-15be2f4fc839 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.550393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.551365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.551893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.552355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.553426 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.554456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:10.557218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:10.564591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 60/117] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:10.566167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.578979 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.656534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95de72-5fac-4897-a44e-9a32b7b632b8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.698211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78803bc-5473-4295-a33d-fbfb0da26b70 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:10.700522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.702071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.702362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.702643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.735476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:10.736358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.736742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.737136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.748959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-bc231139-49c6-459e-9764-15b66213f206 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:10.762010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:10.763055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:10.763910 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:10.764469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 61/118] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:10.769258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:10.769258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:10.769258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:10.790439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:10.792502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:10.793177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:10.795059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:10.829336 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.862439 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:10.869250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 62/119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:10.880513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:10.911232 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 58/120] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:10.917964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.002040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42768da6-886e-484f-b5b9-1116bafd3d56 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.041260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.042277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.042728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.043219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.045365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, user_id=cc8242e9627f4b96adbf4f8c9dcee7fc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.047082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.055832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bec518-e3ea-44ba-879e-6da70220ed3b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.064437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 63/121] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:10 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:11.065729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.115534 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.131765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.132749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.133033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.133313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.134062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:11.134379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.135864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.156704 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.158989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 59/122] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.159682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.230887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72869bf-4d18-4838-839f-35b8fe4eb0e7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.271909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.272660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.272946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.273221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.281298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6e24-46d4-44fc-8ac2-2f4c5fdf51d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.286651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:11.293023 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:11.293959 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:11.294702 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 64/123] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:11.300557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.320666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.321318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.321667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.321948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.323116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.324604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.326551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 60/124] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.327247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.395004 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.413979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27136e-de4b-4553-b428-51a70862e6dc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.435864 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.456104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf62fb5-ccb6-4cad-a82a-05282ac1c34b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.460965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.461697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.461991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.462283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.478231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:11.485432 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:11.486330 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:11.487093 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:11.487657 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 65/125] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:11.490254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.503153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.503814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.504103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.504384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.505609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.507890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.513524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 61/126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.514427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.627787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93851-b208-49be-9ffe-a07e90290f1c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.648273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0045fe-3604-496e-8b88-ef6e8f9f4b19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.668127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.668747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.669033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.669308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.670019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:11.670329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.671748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.681216 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 66/127] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.682061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.683204 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.695127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.696622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.697061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.697910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.699086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=6652b68058c24472bb77f1757b7e3373) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:11.699552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.701925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.709719 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 62/128] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/role_assignments?user.id=6652b68058c24472bb77f1757b7e3373&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=2b840863ca9e41d782022e3a563133e1 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.712267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.737784 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:11.816449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613d31-31aa-45c7-bd9d-a3fd511fd576 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.848353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7a1e-d31f-40a1-b5e0-cfc3da801b98 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:11.863044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.864100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.864591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.865086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.866094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:11.867318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.869048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.878908 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.880248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.893801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:11.894467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:11.894752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:11.895031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:11.896488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:11.899084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:11.900875 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:11.906663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:11.980178 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:12.006169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885da6c-befa-4df0-8d21-880fa636a445 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.008886 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:12.047224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffa4d-02de-4e47-b179-52b4ae48a816 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.050957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.051915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.052398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.052893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.054411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.056368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.058351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:12.059417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:12.088922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.089765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.090053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.090332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.091565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.093092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.094761 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 64/132] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:11 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:12.095798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:12.179149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2df50-0b39-4a70-9e87-dcc8cd38b1a2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.216553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d645-d4e3-4e2c-8599-58c4be5be50f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.217597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.218504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.218986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.219459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/90697e4fcb7e4bb39c8b9cc770ece301/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.221695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, user_id=90697e4fcb7e4bb39c8b9cc770ece301, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.223423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.242641 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 69/133] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:12 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/90697e4fcb7e4bb39c8b9cc770ece301/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:12.244142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:12.249232 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:12.261475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.262247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.262537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.262814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] PATH_INFO: `/v3/projects/d44d0798489d4a9cbf1ace02c48f3713` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.264622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] RBAC: Authorizing `identity:get_project(project_id=d44d0798489d4a9cbf1ace02c48f3713)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.265929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.268120 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 65/134] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:12 2022] GET /identity/v3/projects/d44d0798489d4a9cbf1ace02c48f3713 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:12.275822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:12.290635 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:12.386033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2a9-2aba-441a-8da3-6c96f02e74f8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.431173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.431745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.432315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.432600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.433868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.436091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.437949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 70/135] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:12 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:12.444423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:12.475868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50d0e-3e9a-4abc-a514-2398dfe57942 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.537290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.538087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.538414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.538699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] PATH_INFO: `/v3/projects/d44d0798489d4a9cbf1ace02c48f3713/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.541146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=d44d0798489d4a9cbf1ace02c48f3713, user_id=cc8242e9627f4b96adbf4f8c9dcee7fc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.542800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfa9d4-288d-44c5-b96a-12ca4b1b5c91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.560782 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 66/136] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:12 2022] PUT /identity/v3/projects/d44d0798489d4a9cbf1ace02c48f3713/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:12.572310 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:12.576487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381c5d-cef7-4fc3-8098-2fcb0567a1bc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:12.616805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:12.617830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.618202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.618485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.620885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, user_id=cc8242e9627f4b96adbf4f8c9dcee7fc, role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:12.622399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc82f11-06f7-40ca-8ccf-44e63b2a29d1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:12.643061 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:12 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/cc8242e9627f4b96adbf4f8c9dcee7fc/roles/43b01aadcec14574861255a746ef1a34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:12.682710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd4a2-1aa8-4070-9036-7339f4461461 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.682917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd4a2-1aa8-4070-9036-7339f4461461 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.683200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd4a2-1aa8-4070-9036-7339f4461461 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.684895 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 67/138] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:12.691195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:12.691487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:12.691770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:12.717648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:12.718934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:12.810378 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:13.145783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dd4a2-1aa8-4070-9036-7339f4461461 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:13.217461 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:13.267413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dd4a2-1aa8-4070-9036-7339f4461461 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:13.304556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893162-25e6-4d03-b857-311cda275287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:13.305245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893162-25e6-4d03-b857-311cda275287 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:13.305546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893162-25e6-4d03-b857-311cda275287 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:13.305809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893162-25e6-4d03-b857-311cda275287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:13.307001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893162-25e6-4d03-b857-311cda275287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:13.308489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893162-25e6-4d03-b857-311cda275287 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:13.310143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:13.316187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:13.462458 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:13.474210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9a914-c0ec-4daf-b8fa-7a0bc81a07a4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:13.528228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:13.528855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:13.529140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:13.529433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:13.530116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:13.531592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538620-ddc4-41b1-9f72-ad3195c8a3a9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:13.562887 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 73/141] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:13 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:14.274054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bbe6e-7193-491e-9173-efa1c7dfe5a7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:14.274956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bbe6e-7193-491e-9173-efa1c7dfe5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:14.275406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bbe6e-7193-491e-9173-efa1c7dfe5a7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:14.276996 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 69/142] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:14.283025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae341-6a05-4cf7-b306-79f1b21f659d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:14.283857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae341-6a05-4cf7-b306-79f1b21f659d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:14.284336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae341-6a05-4cf7-b306-79f1b21f659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:14.305373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8c4ae341-6a05-4cf7-b306-79f1b21f659d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:14.307067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c4ae341-6a05-4cf7-b306-79f1b21f659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:14.399766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 74/143] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:14.903161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843d0f-1b34-4bd4-a3e8-951f13561bb3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:14.903853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843d0f-1b34-4bd4-a3e8-951f13561bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:14.904333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843d0f-1b34-4bd4-a3e8-951f13561bb3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:14.906504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 70/144] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:14.911764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:14.912347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:14.912811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:14.935705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:14.937220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:14.955077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf843d0f-1b34-4bd4-a3e8-951f13561bb3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:15.103817 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 75/145] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:15.123896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf843d0f-1b34-4bd4-a3e8-951f13561bb3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:15.150441 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:15.166476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:15.167056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:15.167341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:15.167620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:15.180207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:15.185174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:15.186196 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:15.186969 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:15.191300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 71/146] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:15.192686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:15.197790 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:15.321232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b7cad-e48b-4ebe-8d24-f6256891b137 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:15.370858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:15.371493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:15.371777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:15.372050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:15.372736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:15.373038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:15.374485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:15.385569 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 76/147] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:15.393029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:15.514418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc44f4-2ff1-47e4-b05a-849c18e37ea5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:15.558383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:15.559070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:15.559342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:15.559627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:15.560831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:15.562336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:15.563942 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:15 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:15.569953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:15.652660 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:15.707596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be936c1-1c51-431d-89f9-18c8d4f03ca1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:15.711079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:15.824191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165de-9828-44ab-a29f-579af303b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:15.824191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165de-9828-44ab-a29f-579af303b1be None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:15.824191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165de-9828-44ab-a29f-579af303b1be None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:15.824191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165de-9828-44ab-a29f-579af303b1be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:15.831690 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:15.924716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b47c7-c0cb-44b5-8a15-012cadab6437 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:15.959940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479165de-9828-44ab-a29f-579af303b1be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:15.961858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479165de-9828-44ab-a29f-579af303b1be None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:15.972754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:15.973740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:15.977432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:15.977432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:15.992034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:15.998023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:15.998933 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:15.999724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 73/149] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:16.006154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:16.094343 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:16.161636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 77/150] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:16.168386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165de-9828-44ab-a29f-579af303b1be None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:16.169271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2a95e-2571-4a1f-8681-2f5d3fc84a1f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:16.200874 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:16.290188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:16.290838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.291127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.291405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.292106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:16.292410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:16.293858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae895a4-c282-4d11-8482-1502b7380675 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:16.315772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 74/151] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:16.316891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed83e3-2158-4fcc-865d-4a906f3cf566 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.317203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed83e3-2158-4fcc-865d-4a906f3cf566 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.317484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed83e3-2158-4fcc-865d-4a906f3cf566 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.318741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 75/152] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:16.323430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed83e3-2158-4fcc-865d-4a906f3cf566 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:16.351043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165de-9828-44ab-a29f-579af303b1be None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:16.434166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:16.434834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.435117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.435394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.440727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:16.442292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31509759-7d46-4972-89c7-02b0adb289e7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:16.444522 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 78/153] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:16 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:16.445799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad661c6-9161-4ff6-8835-4e4420b1625f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.446089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad661c6-9161-4ff6-8835-4e4420b1625f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.446525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad661c6-9161-4ff6-8835-4e4420b1625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.483050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dad661c6-9161-4ff6-8835-4e4420b1625f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:16.484244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dad661c6-9161-4ff6-8835-4e4420b1625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:16.526216 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:16.589621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed83e3-2158-4fcc-865d-4a906f3cf566 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:16.608736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:16.609872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd572f-2659-4f0c-a560-7fcf069e6ee0 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.610155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd572f-2659-4f0c-a560-7fcf069e6ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.610431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd572f-2659-4f0c-a560-7fcf069e6ee0 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.611979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 80/155] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:16.612549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd572f-2659-4f0c-a560-7fcf069e6ee0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:16.665422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:16.666393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.666835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.667256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] PATH_INFO: `/v3/users/6652b68058c24472bb77f1757b7e3373` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.671379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] RBAC: Authorizing `identity:get_user(user_id=6652b68058c24472bb77f1757b7e3373)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:16.673244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73b867-1174-4d83-b07b-616e814d867a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:16.675529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 76/156] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:16 2022] GET /identity/v3/users/6652b68058c24472bb77f1757b7e3373 => generated 289 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:16.677044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.677495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.677921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.712971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:16.714585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:16.745466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd572f-2659-4f0c-a560-7fcf069e6ee0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:16.784000 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:16.806634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:16.807256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.807529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.807788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.808530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:16.808829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:16.810325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1937f-3a75-48b2-a357-fc903747add7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:16.823830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 81/157] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:16 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:16.825087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37ff8-7217-40e2-b241-3b85940a7b2e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.825285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37ff8-7217-40e2-b241-3b85940a7b2e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.825660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37ff8-7217-40e2-b241-3b85940a7b2e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.825879 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:16.826993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:16.833453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 82/159] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:16.835700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:16.835990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:16.836262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:16.878474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:16.879645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:16.924103 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:16.997480 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:17.016837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bad93-94ce-4b7e-8d25-944e96df278f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:17.083414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:17.084459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:17.085535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:17.086191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:17.090216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:17.092019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:17.094419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 78/161] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:16 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:17.099947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:17.252331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cd77d-f850-4ea5-970a-e46843a18220 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:17.293095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:17.293811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:17.294089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:17.294417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/6652b68058c24472bb77f1757b7e3373/roles/2b840863ca9e41d782022e3a563133e1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:17.296527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, user_id=6652b68058c24472bb77f1757b7e3373, role_id=2b840863ca9e41d782022e3a563133e1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:17.298159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:17.299983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:17.329517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:17 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/users/6652b68058c24472bb77f1757b7e3373/roles/2b840863ca9e41d782022e3a563133e1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:17.410023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:17.425444 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:17.453248 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:17.601298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73e57-6049-4257-9ff3-530cd7cd2988 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:17.647732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c25d0-ee07-4dce-9e75-8d4cfa03eb3f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:17.658773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:17.659415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:17.659700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:17.659964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:17.694287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:17.713956 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:17.716350 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:17.718529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:17.723200 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 85/163] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:17.725272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:17.745728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:17.746385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:17.746668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:17.746918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:17.774361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:17.779290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:17.781006 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 79/164] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:17.782671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:17.917929 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:17.968827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe0c2-b66f-4e82-9b5b-6fa86a6dc81f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.028028 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:18.035662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348c21-8665-4aae-b386-dc6f66d2aa6d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.045564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.047153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.047937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.049292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.083465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:18.090049 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:18.091768 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:18.093449 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 86/165] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:18.101130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.113493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.114122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.114377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.114658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.115343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:18.115645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.117179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.148329 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 80/166] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.150173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.325704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e5f8-5b58-43e6-938f-d751d7251264 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.354020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54235-a054-4e7c-9458-caa6c9955582 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.401079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.401721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.401997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.402262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.402929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:18.403231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.404609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.416787 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:18.428223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 87/167] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.430653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.434678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.435302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.435579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.435848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.436522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:18.436821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.438247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.458551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 81/168] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.459507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.511938 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:18.601499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaca61-9a24-42b3-8b15-3221e9a665f7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.609170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecaca8-00e2-4a6d-902d-07955d22c4b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.645765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.646661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.646948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.647849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.649011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.650626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.652513 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 82/169] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.653301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.656207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.657102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.657563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.657986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] PATH_INFO: `/v3/users/90697e4fcb7e4bb39c8b9cc770ece301` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.659353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] RBAC: Authorizing `identity:get_user(user_id=90697e4fcb7e4bb39c8b9cc770ece301)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.661055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a177-fb8a-4ab2-9b49-b58bec235567 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.662917 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 88/170] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/users/90697e4fcb7e4bb39c8b9cc770ece301 => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.664651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549e42-72b8-45df-8191-11e22031d244 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.665121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549e42-72b8-45df-8191-11e22031d244 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.665724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549e42-72b8-45df-8191-11e22031d244 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.667826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 89/171] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:18.668878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85549e42-72b8-45df-8191-11e22031d244 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:18.753085 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:18.781159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85549e42-72b8-45df-8191-11e22031d244 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.816993 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:18.832586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.833197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.833502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.833776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.837794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6bdf2-62fa-41df-b9d4-abdd15ec2e32 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:18.905641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.907121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.915246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:18.919379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.919773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.920056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] PATH_INFO: `/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.922867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] RBAC: Authorizing `identity:get_user(user_id=cc8242e9627f4b96adbf4f8c9dcee7fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:18.924466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3de40-21f2-4850-9eb5-8dce5d73f26e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:18.926584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 83/172] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/users/cc8242e9627f4b96adbf4f8c9dcee7fc => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:18.927861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:18.928150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:18.928423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:18.964288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:18.965537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:19.008807 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.052953 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 90/173] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:19.053837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.096593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 84/174] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:19.098092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.260894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fca07-2186-4bc4-8e3b-95063bbdc455 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.273776 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.298795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.299605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.299898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.300179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.323703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51dc3-5657-4d03-ae11-c92d30dd07da None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.376812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:19.378328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:19.398344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.399251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.399709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.400183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.453835 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.489030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:19.491606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140206-e6e8-4afe-8f5c-6e9dfd7d3bd1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:19.495035 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.509466 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 85/175] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:19.510802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.622818 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 91/176] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:19.624739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6917-86d1-4695-9f85-1e717e97635b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.625323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6917-86d1-4695-9f85-1e717e97635b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.625852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6917-86d1-4695-9f85-1e717e97635b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.627751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 92/177] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:19.633281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6917-86d1-4695-9f85-1e717e97635b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.670210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e0228-d0d3-439f-94bf-9b68a90345d2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.714553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.715332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.715513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.715787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] PATH_INFO: `/v3/projects/d44d0798489d4a9cbf1ace02c48f3713` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.716934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] RBAC: Authorizing `identity:get_project(project_id=d44d0798489d4a9cbf1ace02c48f3713)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:19.718427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:19.720213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 86/178] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/projects/d44d0798489d4a9cbf1ace02c48f3713 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:19.722398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.726347 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.771055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6917-86d1-4695-9f85-1e717e97635b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.793030 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.810923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.811563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.811837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.812104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.823969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:19.828845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:19.829823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 93/179] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:19.830997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:19.847351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfdcf2-2790-4145-96fe-e350d6672c1b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.890760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.891270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.891518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.891791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.893043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:19.894576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e760c-e9b7-4c1b-9d21-53691c3749d6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:19.901444 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 87/180] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:19.901444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.901444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.901444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:19.921264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:19.922641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:19.956482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a45f-e14a-43b9-af40-11c8d7777b03 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:19.988627 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:19.998774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:19.999443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:19.999721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:19.999998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.001170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.002687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2938-4a62-4945-a65b-6e6ca973b99d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.004416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 94/181] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:19 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.005710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ca2b1-e821-49f0-b794-fc4861fc2453 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.005992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ca2b1-e821-49f0-b794-fc4861fc2453 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.006261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ca2b1-e821-49f0-b794-fc4861fc2453 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.009454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 95/182] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:20.009454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ca2b1-e821-49f0-b794-fc4861fc2453 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.016189 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 88/183] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:20.016955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.113843 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:20.138615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ca2b1-e821-49f0-b794-fc4861fc2453 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.179570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ea8c1-2dc9-4358-9d46-9acd0e4a930d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.180508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.181361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.181880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.182346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.183276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=d44d0798489d4a9cbf1ace02c48f3713, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:20.183799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.185682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.192577 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 96/184] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=d44d0798489d4a9cbf1ace02c48f3713&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.193730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.240462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.242240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.242862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.244067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.246501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:20.247078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.249965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.269929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 89/185] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.271816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.305589 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:20.367752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd457-6879-4100-a068-fb92fb4e81a7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.409827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.410333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.410618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.410897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.411757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=cc8242e9627f4b96adbf4f8c9dcee7fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:20.411981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.414124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c28-24db-41f9-8e58-eedbcbdee136 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.421004 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 97/186] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/role_assignments?user.id=cc8242e9627f4b96adbf4f8c9dcee7fc&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=43b01aadcec14574861255a746ef1a34 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.425802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.425802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.425802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.429032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac033e63-6283-4461-98a1-b15cd8ee0b78 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.448230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:20.449382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:20.470979 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:20.491646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.493555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.493903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.494186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.495402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=90697e4fcb7e4bb39c8b9cc770ece301) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:20.495719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.498355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.507237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 90/187] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/role_assignments?user.id=90697e4fcb7e4bb39c8b9cc770ece301&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.508359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.564365 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 98/188] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:20.566074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.669979 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:20.672901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6dc71-3f6a-4a2b-8edc-d5948dbb35be None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.728123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.728603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.728961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.729239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.748083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ad8a-2deb-456f-9c66-c419a04534bf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.751829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:20.753329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9111d-147b-407d-bbf5-b00cb5b33182 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:20.755109 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 91/189] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:20.757246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff333-0296-4b90-9091-c9c1e3619095 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.757832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff333-0296-4b90-9091-c9c1e3619095 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.758080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff333-0296-4b90-9091-c9c1e3619095 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.759529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 92/190] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:20.764292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff333-0296-4b90-9091-c9c1e3619095 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.800154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.802621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.802621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.802621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.818940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:20.824609 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a58f45de-2566-4b63-9567-a3c01cd92d75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:20.825508 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:20.826392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:20.827175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 99/191] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:20.828623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.828819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.829432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.855957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:20.857742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:20.905366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff333-0296-4b90-9091-c9c1e3619095 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:20.947064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 100/192] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:20.947747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:20.954737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:20.955344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:20.955619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:20.955887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:20.999234 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.031201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.032660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.057517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87cdfc-d6e2-4030-8a2e-6b8aacdd167a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.075572 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.092723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.093344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.093656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.093985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.094659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:21.094960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.096340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.105779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 101/193] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.106775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.150623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 93/194] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:21.151849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.218350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beca44-efe5-4f13-83b5-61c97c5e87de None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.226272 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.256357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.257518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.258064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.258360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.258499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7bbe-c13d-473d-ace5-84321f44c7aa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.259496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.260979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.262597 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 102/195] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.265581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.293040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.293711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.293990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.294265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.295393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.296836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.298450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 94/196] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.299215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.309762 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.364393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae295-a74a-4e71-aae4-ba70563ecb73 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.401021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.401685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.401962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.402230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.402931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb497-0643-4e1a-98f1-23299d4aa106 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.403338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.404803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.406473 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 103/197] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.407214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.440719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.441362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.441678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.441956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.452691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:21.455826 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:21.457778 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:21.458737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:21.459563 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 95/198] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:21.460573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.517159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb856e-08e8-438e-919a-dd3fed4f5f0a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.527123 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.552903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.553723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.553990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.554234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.554887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.556344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.561195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8451-8f71-4ba1-8ec7-4dde6c66add4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.576757 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 104/199] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:21 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:21.577622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.602067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.602695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.602974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.603261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.688918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.691051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.697227 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.701616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fc12e-8ecc-4aa0-80c8-8b1a9c9b64a8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.743746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.744378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.744666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.744943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.746101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccedd4b3b3943638c786ff2631b39fe) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:21.746415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.747929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.755285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 105/200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/role_assignments?user.id=eccedd4b3b3943638c786ff2631b39fe&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.755285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.783733 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:21.839611 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 96/201] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:21.846296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.920741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508e4b-d6cc-4f95-b574-4a7ffb0f0820 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:21.977306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:21.977972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:21.978250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:21.978515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:21.979186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:21.979483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:21.980865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:21.990203 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 106/202] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:21.997857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:21.999058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7e385-4a21-4f73-9017-4de1b5e20c7b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:22.032867 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:22.050705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:22.051671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:22.052677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:22.053167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:22.055520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:22.057464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:22.059407 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 97/203] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:22.067291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:22.132113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9ef6-e22d-41e3-9cb8-e8084ba098cf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:22.132511 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:22.208883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:22.210125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:22.210754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:22.211372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] PATH_INFO: `/v3/users/6652b68058c24472bb77f1757b7e3373` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:22.212808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] RBAC: Authorizing `identity:get_user(user_id=6652b68058c24472bb77f1757b7e3373)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:22.220245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f9fd-d036-4ea3-b5e6-3f6cb450119a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:22.222506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:22.224483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 107/204] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:21 2022] GET /identity/v3/users/6652b68058c24472bb77f1757b7e3373 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:22.243089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:22.268655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:22.269284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:22.270674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:22.270983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:22.273360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccedd4b3b3943638c786ff2631b39fe) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:22.273692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:22.275169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:22.291880 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 98/205] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:22 2022] GET /identity/v3/role_assignments?user.id=eccedd4b3b3943638c786ff2631b39fe&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=43b01aadcec14574861255a746ef1a34 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:22.406166 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:22.423491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e72d-5740-4528-ace3-19d5fe23ca88 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:22.472334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:22.472955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:22.473321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:22.473539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:22.553268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:22.555024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:22.654050 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:22.666185 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:22.672797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:22.841774 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:22.846670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f27f-b252-4e02-8dea-0edfd3fc2054 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:22.900467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:22.901122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:22.901420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:22.901695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:22.902865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:22.904373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eb0c-3ff7-48a8-8269-423b560dcdec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:22.905979 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 99/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:22 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:22.912013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:23.037825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf93f3-41c1-48f7-a9e0-9c29d91be76f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:23.091095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:23.092159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:23.092678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:23.093171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:23.094145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79, user.id=6652b68058c24472bb77f1757b7e3373) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:23.094648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:23.096285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a470f1-46a0-4fc8-97dd-b11a99bfbf39 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:23.102889 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 109/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:22 2022] GET /identity/v3/role_assignments?user.id=6652b68058c24472bb77f1757b7e3373&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=2b840863ca9e41d782022e3a563133e1 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:24.404377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eac9ab-6bdc-41c7-b1aa-f853c9392a20 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.404377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eac9ab-6bdc-41c7-b1aa-f853c9392a20 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.404377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eac9ab-6bdc-41c7-b1aa-f853c9392a20 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.404377 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 100/209] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:24.410888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286492c7-bbca-4b61-a227-699d290af1f0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.411359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286492c7-bbca-4b61-a227-699d290af1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.411436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286492c7-bbca-4b61-a227-699d290af1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.438221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-286492c7-bbca-4b61-a227-699d290af1f0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:24.439834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-286492c7-bbca-4b61-a227-699d290af1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:24.463196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efccaaa-7a9c-48f3-be5b-74e34c696f33 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.463783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efccaaa-7a9c-48f3-be5b-74e34c696f33 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.464255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efccaaa-7a9c-48f3-be5b-74e34c696f33 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.466027 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 101/210] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:24.472111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893be39-6319-4129-9975-381dfc77321a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.472759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893be39-6319-4129-9975-381dfc77321a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.473218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893be39-6319-4129-9975-381dfc77321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.503755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9893be39-6319-4129-9975-381dfc77321a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:24.506106 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:24.508124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9893be39-6319-4129-9975-381dfc77321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:24.526129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 110/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:24.570541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbea0-0413-4cda-8982-c3bd213deb60 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.571165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbea0-0413-4cda-8982-c3bd213deb60 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.571655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbea0-0413-4cda-8982-c3bd213deb60 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.573290 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 111/212] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:24.579166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25825-3833-4965-a09d-6c1c9db04b2c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.579741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25825-3833-4965-a09d-6c1c9db04b2c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.580212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25825-3833-4965-a09d-6c1c9db04b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.601863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-15d25825-3833-4965-a09d-6c1c9db04b2c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:24.603608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15d25825-3833-4965-a09d-6c1c9db04b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:24.616449 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 102/213] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:24.689611 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 112/214] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:24.811573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893be39-6319-4129-9975-381dfc77321a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:24.845731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9ec6-c235-4931-abbb-40c1b47551a6 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.846177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9ec6-c235-4931-abbb-40c1b47551a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.846555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9ec6-c235-4931-abbb-40c1b47551a6 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.848219 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 113/215] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:24.854515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.854796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.855074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.877715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:24.879174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:24.925783 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:24.930396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893be39-6319-4129-9975-381dfc77321a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:24.954415 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 114/216] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:24.958624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:24.968625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:24.969432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:24.969807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:24.970458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:24.982866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:24.988036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:24.988995 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 103/217] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:24.990454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.020815 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.080700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e969-793e-44a2-9512-dbfce68e391a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.102899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5640e-3636-41f4-b751-64bd7124ac92 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.118633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.119340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.119636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.119912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.132481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:25.137814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:25.139374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 115/218] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:25.140629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.148766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.149444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.149731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.150007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.151601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.153507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.155583 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 104/219] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.156240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.187797 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.258362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377ad38-1d2e-4c3b-bd6d-62d8d5d93c2a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.266209 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.273850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f9fac-9b88-4078-8e2f-b5af438ac953 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.296456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.297123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.297342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.297645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.298326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:25.298625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.300015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.308529 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 116/220] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.309111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.310010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.310621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.310898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.311168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.311837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:25.312137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.313617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.322672 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 105/221] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.323488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.419006 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.420870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384efe-c542-41bc-ab21-c77a11245528 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.433664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2400-229f-4797-a24a-2f02bbd8e0fa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.456164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.456779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.457057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.457329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.458043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.459498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.469153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.469904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.470192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.470463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.482171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:25.482761 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 117/222] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:25 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:25.483589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:25.487843 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:25.488936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:25.489779 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 106/223] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:25.490434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.528955 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.624227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388213b4-ac43-4a88-94b7-570d3b2adbee None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.624513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e846ba-7a5c-441d-8fb4-78db4cc26b9f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.661944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.662190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.662586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.662709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.663408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.663543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.663821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] PATH_INFO: `/v3/users/eccda07ffbf3423a9fb327dd45fc4d86` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.663973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.665069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.667235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.668225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 107/224] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.668997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.680395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] RBAC: Authorizing `identity:get_user(user_id=eccda07ffbf3423a9fb327dd45fc4d86)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.683300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.684657 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 118/225] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/users/eccda07ffbf3423a9fb327dd45fc4d86 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.684901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.696161 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.793996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.809096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8a7a-bc5d-42f2-aa9b-c3d3f2dbd29d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.817052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503406-9cee-4fad-9416-49f959b61c3c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:25.853546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.854530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.855047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.855330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.856046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:25.856324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.859671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.861239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:25.861888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:25.862169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:25.862438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:25.863643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:25.865095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:25.867105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 119/226] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.867913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.868568 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 108/227] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:25.877905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:25.974715 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:25.991421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe910b-b8fd-4fc8-b323-8181dc3d7992 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.003579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f845203-18d8-4284-ad84-b1b32b8f5573 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.035333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.036432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.036960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.037487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.045561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.046163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.046445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.046720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccedd4b3b3943638c786ff2631b39fe/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.048986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, user_id=eccedd4b3b3943638c786ff2631b39fe, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.050409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.063418 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:26.070585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 109/228] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:25 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccedd4b3b3943638c786ff2631b39fe/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:44:26.072253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:26.135326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.137649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.206339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c370e-24cd-4e72-8c52-0267297edae1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.263543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.264338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.264684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.264968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.266308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.268247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.270328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 110/229] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:26 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:26.277502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:26.291803 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:26.363372 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 120/230] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:26.369567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:26.418531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d60655-1e99-46d9-98f8-0a64739a0548 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.466303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.467120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.467286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.467519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.468732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.470452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.472392 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 111/231] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:26 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:26.482628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:26.492737 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:26.564746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e553-d2a7-4a47-ae81-db3b68824528 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.634266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.635263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.635766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.636274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.638776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.641859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.648463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 121/232] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:26 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:26.653234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:26.665518 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:26.731783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f846b-c64e-44d1-8b6a-ed6c4f8d1dc8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.826750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.827444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.827727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.828046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccedd4b3b3943638c786ff2631b39fe/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.828280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626cc6d-6317-4f75-a829-494dbe709b04 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:26.838293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, user_id=eccedd4b3b3943638c786ff2631b39fe, role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.839897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d41857-be46-485b-8ecb-578a77787ad4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.861942 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:26.881335 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 112/233] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:26 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccedd4b3b3943638c786ff2631b39fe/roles/43b01aadcec14574861255a746ef1a34 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:26.908902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:26.909723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:26.910181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:26.910631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:26.911880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccda07ffbf3423a9fb327dd45fc4d86) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:26.912389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:26.915049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710929-85ee-41b6-a4a1-32dd520775da None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:26.925651 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 122/234] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:26 2022] GET /identity/v3/role_assignments?user.id=eccda07ffbf3423a9fb327dd45fc4d86&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:28.630699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755fef-0a4e-4d6f-9ead-c47d0f647828 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:28.631214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755fef-0a4e-4d6f-9ead-c47d0f647828 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:28.632115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755fef-0a4e-4d6f-9ead-c47d0f647828 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:28.635281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 113/235] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:28.641506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacccc2-27f0-4cfa-8ffa-f6335de4e83e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:28.641978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacccc2-27f0-4cfa-8ffa-f6335de4e83e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:28.642185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacccc2-27f0-4cfa-8ffa-f6335de4e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:28.676600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4aacccc2-27f0-4cfa-8ffa-f6335de4e83e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:28.678127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4aacccc2-27f0-4cfa-8ffa-f6335de4e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:28.687110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dee4-cce5-4ebb-9056-78b4c31f9f8a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:28.687499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dee4-cce5-4ebb-9056-78b4c31f9f8a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:28.687823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dee4-cce5-4ebb-9056-78b4c31f9f8a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:28.689434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 114/236] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:28.695967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea75a1-0e2e-473d-be74-d492879f23c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:28.696244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea75a1-0e2e-473d-be74-d492879f23c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:28.696517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea75a1-0e2e-473d-be74-d492879f23c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:28.731753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-48ea75a1-0e2e-473d-be74-d492879f23c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:28.732948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-48ea75a1-0e2e-473d-be74-d492879f23c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:28.830370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 123/237] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:28.870630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 115/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:29.164189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474ce96-b296-4831-895b-5465ef19bd75 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.164905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474ce96-b296-4831-895b-5465ef19bd75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.165461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474ce96-b296-4831-895b-5465ef19bd75 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.167376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 124/239] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:29.172768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.173344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.173844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.202448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:29.204375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:29.253271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474ce96-b296-4831-895b-5465ef19bd75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.312556 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:29.328313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 116/240] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:29.329233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.464844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec361a8-0179-4f24-bb18-61f66db61848 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:29.506142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:29.508538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.508866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.509093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.520593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:29.522831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474ce96-b296-4831-895b-5465ef19bd75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:29.527257 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:29.528626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:29.529880 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 117/241] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:29.541438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.561431 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:29.609791 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:29.618778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:29.620209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.621056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.622012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.630537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:29.633750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:29.636539 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 125/242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:29.643181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.669440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e2b1a-64ca-47db-b811-d0549f450861 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:29.702886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:29.703611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.704004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.704340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.705075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:29.705796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:29.708192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:29.721532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 118/243] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:29.721532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.864190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f77fa-35b8-4709-a3cb-14f38a8f2de3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:29.868366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d32f-2ec3-4a62-8f61-cd3ccd5159c3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:29.890047 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:29.908144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:29.908757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.909036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.909310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.909991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:29.911449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:29.923423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:29.924517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.924970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.925331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.945505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:29.945752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 126/244] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:29 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:29.945752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c27ec2f2-abf3-4d6f-b1a0-561fdd7fb98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:29.948201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:29.949747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 119/245] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:29.950716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b1d7-cb20-465f-b73b-202f5b830fcc None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:29.951440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b1d7-cb20-465f-b73b-202f5b830fcc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:29.951440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b1d7-cb20-465f-b73b-202f5b830fcc None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:29.952121 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 120/246] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:29.954025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279b1d7-cb20-465f-b73b-202f5b830fcc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:30.003254 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:30.123293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279b1d7-cb20-465f-b73b-202f5b830fcc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:30.131055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe4e3-05df-46a8-9be3-9444821a7249 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:30.175097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:30.176221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:30.176345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.176856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.176976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.177249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.177558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.178770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] PATH_INFO: `/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.178897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:30.178897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:30.180164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789dac-43f8-48b6-b1ee-14687632ab64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:30.193456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 121/247] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:30.196028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.196314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.196590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.196736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cb67ab5e355a4e2ea0632d8bdc2dcc7f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:30.198374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9223eb9-8fd3-47f1-acd8-0f221aee58a6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:30.200721 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 127/248] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:29 2022] GET /identity/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:30.204986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55b81a-0d80-4204-a753-33fca48cd063 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.204986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55b81a-0d80-4204-a753-33fca48cd063 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.204986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55b81a-0d80-4204-a753-33fca48cd063 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.206162 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 128/249] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:30.206886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55b81a-0d80-4204-a753-33fca48cd063 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:30.217577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:30.218898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:30.256077 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:30.319964 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 122/250] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:30.320860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:30.338890 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:30.352379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55b81a-0d80-4204-a753-33fca48cd063 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:30.426393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:30.427248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.427960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.428324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.430872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:30.432461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05952c-842e-41cf-8ec9-8613f9d2e61e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:30.434425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 129/251] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:30 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:30.437053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.441733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.442075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.470418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:30.472213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:30.502863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a7ee-ed9a-46cf-994a-f833173364f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:30.564466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 130/252] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:30.569433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:30.569433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.569433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.569433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:30.570585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:30.630343 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:30.707639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:30.710093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:30.814222 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:30.832660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c33968-a5b3-427f-a29a-a6ade909e28f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:30.899991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 123/253] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:30.902005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:30.945068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:30.948030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:30.948836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:30.951054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.054440 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.086705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.088096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.113799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898ae1-de89-4be3-ab71-d0d1cc187056 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.193688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.196786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.198063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.198859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.209137 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.223584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:31.229445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 131/254] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:31.229445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:31.243409 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:31.245158 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:31.246683 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:31.248822 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 124/255] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:31.248822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.383474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce010-c4af-4ebb-8bd6-8e10e6ed8956 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.409714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7189-e45b-4ecc-beda-f17887bfd78a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.437840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.438516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.438795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.439063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.440689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.442718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.445239 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 132/256] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:31.450544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.461288 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.473382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.474450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.474977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.475835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.491305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:31.497655 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:31.498651 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:31.499495 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 125/257] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:31.508204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.540761 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.584639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42c9f1-d700-43d8-abca-cca0f62c8224 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.620953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.621620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.621990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.622319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.623455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.624984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.626800 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 133/258] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:31.627408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.631182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff30b3-1f3d-479a-b800-e4694a23933d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.670968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.671897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.672369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.672849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.673741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:31.674236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.676036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.686772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 126/259] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:31.687945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.748484 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.758567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940db91-fe42-4901-aa08-fac8982f59a1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.794221 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:31.806495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.807758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.808256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.808716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.809013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ace-35e7-4078-879f-f7fd73a6fb97 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:31.809897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=cb67ab5e355a4e2ea0632d8bdc2dcc7f) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:31.810434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.813089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.826088 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 134/260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/role_assignments?user.id=cb67ab5e355a4e2ea0632d8bdc2dcc7f&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=2b840863ca9e41d782022e3a563133e1 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:31.826711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:31.886165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:31.886807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:31.887087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:31.887360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:31.889336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:31.889672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:31.891133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:31.916093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 127/261] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:31.917012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:32.062696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597a37-8dcf-4745-b406-b99941560e2c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.083217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834618-ffda-4cf0-ac77-f71bea70e8ae None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.103544 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:32.111001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.111984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.112455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.112917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.114035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccedd4b3b3943638c786ff2631b39fe) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:32.114557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.117108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.125357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 135/262] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/role_assignments?user.id=eccedd4b3b3943638c786ff2631b39fe&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:32.126991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:32.141226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.141925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.142213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.142490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] PATH_INFO: `/v3/users/eccda07ffbf3423a9fb327dd45fc4d86` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.143823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] RBAC: Authorizing `identity:get_user(user_id=eccda07ffbf3423a9fb327dd45fc4d86)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.145487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.147772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 128/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:31 2022] GET /identity/v3/users/eccda07ffbf3423a9fb327dd45fc4d86 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:32.154964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:32.216918 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:32.315942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7467c-d04f-46cb-822c-1cd88bedb666 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.396823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.397624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.397903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.398180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] PATH_INFO: `/v3/users/eccedd4b3b3943638c786ff2631b39fe` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.399409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] RBAC: Authorizing `identity:get_user(user_id=eccedd4b3b3943638c786ff2631b39fe)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.400950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.403088 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 136/264] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:32 2022] GET /identity/v3/users/eccedd4b3b3943638c786ff2631b39fe => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:32.408973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:32.448398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de386d2-4962-40fd-a96d-916d9b83269f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.531877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.533035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.533324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.533637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.534827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.536427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.539105 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:32 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:32.545573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:32.570733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e82a27-e78a-440c-8110-1321c9eb9adb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.631128 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:32.652222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067311-3270-4348-926d-6189e9e066de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.652906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067311-3270-4348-926d-6189e9e066de None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.653188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067311-3270-4348-926d-6189e9e066de None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.653484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067311-3270-4348-926d-6189e9e066de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.655590 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:32.729725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62293a9-09d1-4c01-8495-33f2e8735d27 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:32.777565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:32.778342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.778552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.778828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccda07ffbf3423a9fb327dd45fc4d86/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.781102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, user_id=eccda07ffbf3423a9fb327dd45fc4d86, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.782779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f3d7-88fb-4a7d-81f4-81e1a746a4ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.790850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067311-3270-4348-926d-6189e9e066de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:32.792709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067311-3270-4348-926d-6189e9e066de None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:32.799784 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 130/266] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:32 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/eccda07ffbf3423a9fb327dd45fc4d86/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:44:32.801306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c146ae-167c-4220-abdd-120749baffad None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.801629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c146ae-167c-4220-abdd-120749baffad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.801959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c146ae-167c-4220-abdd-120749baffad None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.804825 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 131/267] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:32.815128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd8d5-338d-4557-aec6-32beadc72158 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:32.815504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd8d5-338d-4557-aec6-32beadc72158 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:32.815829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd8d5-338d-4557-aec6-32beadc72158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:32.863897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aeadd8d5-338d-4557-aec6-32beadc72158 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:32.868036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aeadd8d5-338d-4557-aec6-32beadc72158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:32.995526 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 137/268] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:44:33.001513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067311-3270-4348-926d-6189e9e066de None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.014642 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 132/269] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:33.021085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a31f-e3bb-46ce-aa7c-00a7a7440eab None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.021441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a31f-e3bb-46ce-aa7c-00a7a7440eab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.021693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a31f-e3bb-46ce-aa7c-00a7a7440eab None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.023772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 133/270] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:33.030328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.030653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.030886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.043889 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:33.055089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:33.056484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:33.111965 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:33.141196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067311-3270-4348-926d-6189e9e066de None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:33.180705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 134/271] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:33.191397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:33.192040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.192323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.192593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.195674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:33.197161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:33.199075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 138/272] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:33 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:33.206176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.387532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7a810-3932-4ffe-9028-0e642412b04e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:33.452184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.470336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:33.471383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.471888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.472313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.474307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccedd4b3b3943638c786ff2631b39fe) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:33.474778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:33.478089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:33.489740 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:33 2022] GET /identity/v3/role_assignments?user.id=eccedd4b3b3943638c786ff2631b39fe&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=43b01aadcec14574861255a746ef1a34 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:33.675314 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:33.689970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c481-5721-40f5-a05d-51e6b778c396 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:33.711603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.736503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:33.737445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.737729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.738177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.754004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:33.759993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:33.760920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:33.765748 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 139/274] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:33.768757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.776135 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:33.880863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296818b1-e7f2-464d-b57c-2d18ed5049d4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:33.924470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c630bb-b6fb-41c9-b915-543e4c963491 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:33.926770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:33.927522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.927975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.928440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.929792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:33.931554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:33.933833 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:33.942565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:33.982739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:33.984025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:33.984529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:33.985192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:33.987020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:33.987579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:33.989645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:34.007145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:34.016516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:34.047500 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:34.124795 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:34.129133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028260-32fa-4149-b21d-112c6ce2ebb4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:34.193110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d918e-6296-4313-ab78-d4e7f99d025d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:34.199003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:34.199907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:34.200283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:34.200562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:34.201294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:34.203035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:34.245697 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 137/277] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:44:33 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:34.251687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:34.252773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:34.253276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:34.253860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] PATH_INFO: `/v3/users/dc5c8df6131744c1a4702fb3a8d33409` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:34.275784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] RBAC: Authorizing `identity:get_user(user_id=dc5c8df6131744c1a4702fb3a8d33409)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:34.277721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a97e-1f03-4cb6-b75c-b089637fad94 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:34.280390 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 141/278] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:34 2022] GET /identity/v3/users/dc5c8df6131744c1a4702fb3a8d33409 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:34.286332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:34.434074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f715a-7194-4748-985a-b26301215aa3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:34.478563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:34.479518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:34.479804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:34.480082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:34.480827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, user.id=dc5c8df6131744c1a4702fb3a8d33409, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:34.481140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:34.482969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988988ac-0036-4d15-98be-75ba6b00dd05 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:34.489151 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 138/279] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 25 00:44:34 2022] GET /identity/v3/role_assignments?user.id=dc5c8df6131744c1a4702fb3a8d33409&scope.system=all&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:34.839440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe41c-7428-4e2c-8390-e0dd88772163 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:34.839832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe41c-7428-4e2c-8390-e0dd88772163 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:34.840005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe41c-7428-4e2c-8390-e0dd88772163 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:34.841848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 142/280] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:34.847488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:34.847853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:34.848123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:34.878702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:34.879992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:34.903001 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:34.986502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 139/281] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:35.306769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe41c-7428-4e2c-8390-e0dd88772163 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:35.422907 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:35.468514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe41c-7428-4e2c-8390-e0dd88772163 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:35.530363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:35.531165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:35.531502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:35.531758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:35.552146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:35.558702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:35.559632 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:35.560422 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:35.565524 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:35.567475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:35.761729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8ffa-3c45-4bea-add3-0f68b319f82f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:35.809425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:35.810441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:35.810915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:35.811378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:35.812241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:35.812732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:35.814359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c280c-d590-4530-bf61-07e758950cbd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:35.824529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 140/283] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:35.835073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:35.900498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b952-a808-4a05-b62c-8da18729e888 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:35.901137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b952-a808-4a05-b62c-8da18729e888 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:35.901692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b952-a808-4a05-b62c-8da18729e888 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:35.903276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 141/284] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:35.909701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:35.910320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:35.910789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:35.939236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:35.940492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:35.960128 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:36.062548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc140-9ac1-464e-803a-1f4c3bbbb909 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:36.088923 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 142/285] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:36.125500 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:36.128060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:36.129339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:36.129720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:36.130046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] PATH_INFO: `/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:36.134218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] RBAC: Authorizing `identity:get_user(user_id=cb67ab5e355a4e2ea0632d8bdc2dcc7f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:36.135806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:36.137935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:35 2022] GET /identity/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:36.143502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:36.294412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff705c9-e2b3-4a79-b588-0bc3520f940f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:36.347089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:36.347647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:36.347925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:36.348197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:36.349318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:36.351698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:36.353671 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:36 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:36.359198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:36.467379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:36.480977 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:36.533713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826e280-8b19-437a-8d04-634f5dc7fc59 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:36.572793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:36.573536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:36.573850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:36.574127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f/roles/2b840863ca9e41d782022e3a563133e1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:36.576174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, user_id=cb67ab5e355a4e2ea0632d8bdc2dcc7f, role_id=2b840863ca9e41d782022e3a563133e1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:36.577686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:36.601416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:44:36 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f/roles/2b840863ca9e41d782022e3a563133e1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:36.664035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc63e-494d-4b35-ab84-b6f41055f98b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:36.719218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:36.719901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:36.720185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:36.720453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:36.738414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:36.744529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:36.745510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:36.746387 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:36.751734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:36.823406 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:36.876302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee52-6e19-464c-87a6-6dfffc595ecf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:36.913926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:36.914547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:36.914825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:36.915096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:36.915771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:36.916069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:36.917489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:36.927088 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:36.932961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:37.016854 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:37.057503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49ddd-3f12-417a-805e-5e7062f59a36 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:37.092925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:37.093601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.093881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.094156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] PATH_INFO: `/v3/users/eccda07ffbf3423a9fb327dd45fc4d86` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.095309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] RBAC: Authorizing `identity:get_user(user_id=eccda07ffbf3423a9fb327dd45fc4d86)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:37.096824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:37.099235 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:36 2022] GET /identity/v3/users/eccda07ffbf3423a9fb327dd45fc4d86 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:37.105708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:37.210249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1f00-dce2-4422-9494-d33419989bca None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:37.234005 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:37.254122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:37.254750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.255025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.255290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.334027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:37.336170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fab0f3-3ee6-41a6-8307-abd19fd0ff9d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:37.477986 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:37.483557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:37.501749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8550-9cf6-496c-a08f-d062ad268030 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.502083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8550-9cf6-496c-a08f-d062ad268030 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.502306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8550-9cf6-496c-a08f-d062ad268030 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.503814 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 148/293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:37.523373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623489c-e52b-4a59-95d0-49e8afd4ad5b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.523723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623489c-e52b-4a59-95d0-49e8afd4ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.523913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623489c-e52b-4a59-95d0-49e8afd4ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.555524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3623489c-e52b-4a59-95d0-49e8afd4ad5b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:37.556759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3623489c-e52b-4a59-95d0-49e8afd4ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:37.588459 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:37.621058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b872944-c7f7-4451-abdd-3ab27f001c42 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:37.644963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 149/294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:37.651055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a6b3-4732-4405-ab95-d12e0ac675cb None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.651338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a6b3-4732-4405-ab95-d12e0ac675cb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.651609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a6b3-4732-4405-ab95-d12e0ac675cb None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.653104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 150/295] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:37.663069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93293-5200-41a3-94d8-ce02dec78c9c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.663501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93293-5200-41a3-94d8-ce02dec78c9c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.663947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e93293-5200-41a3-94d8-ce02dec78c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.675618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:37.676264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.676539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.676815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.677976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:37.680414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655454c-59cb-4abb-b1cf-a707957768fa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:37.682455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 146/296] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:37 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:37.683393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd492da-7ad3-4e59-a1cd-7fa8f4b8931f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.683670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd492da-7ad3-4e59-a1cd-7fa8f4b8931f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.683942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd492da-7ad3-4e59-a1cd-7fa8f4b8931f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.689353 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 147/297] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:37.690188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd492da-7ad3-4e59-a1cd-7fa8f4b8931f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:37.692994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-51e93293-5200-41a3-94d8-ce02dec78c9c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:37.694839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-51e93293-5200-41a3-94d8-ce02dec78c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:37.701428 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:37.789861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:37.799073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.799659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.800108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.830648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd492da-7ad3-4e59-a1cd-7fa8f4b8931f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:37.845675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:37.847174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:37.871609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:37.872491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:37.873050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:37.873917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:37.874864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=eccda07ffbf3423a9fb327dd45fc4d86) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:37.875308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:37.877191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:37.886000 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 148/299] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:37 2022] GET /identity/v3/role_assignments?user.id=eccda07ffbf3423a9fb327dd45fc4d86&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:37.936272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:37.995454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:38.054732 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.108794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfbf-0d9c-47c9-9334-26cb70179418 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.168008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.168664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.168952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.169210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.182021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:38.187686 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:38.188621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:38.189395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:38.196029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.218386 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.228703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.326746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0a1f-ad27-4b8c-ae2c-dbf678a42285 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.373176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ffad1-1447-467d-b266-7a0bf5088f32 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.378243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.378877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.379159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.379432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.381040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:38.382039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.383777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.396345 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:38.397173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.415690 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.425254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.425941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.426379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.426665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.439140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:38.444349 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:38.445490 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 150/303] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:38.450618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.490265 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.519074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3e1db-194a-49d3-b7a1-967efc9fe4c9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.556408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.557040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.557322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.557623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.558748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.560196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.562031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 154/304] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:38.562672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.569633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90ec7-2487-4e6a-9e29-af8a169afd24 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.606374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.606935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.607214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.607485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] PATH_INFO: `/v3/users/dc5c8df6131744c1a4702fb3a8d33409` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.608783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] RBAC: Authorizing `identity:get_user(user_id=dc5c8df6131744c1a4702fb3a8d33409)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.610118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.611855 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 151/305] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/users/dc5c8df6131744c1a4702fb3a8d33409 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:38.617682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.679321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0539e-f810-494f-b325-5124a1ca0737 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.688488 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.716742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.717364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.717736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.718020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.718702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:38.719008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.720394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.734106 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 155/306] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:38.734106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.738835 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.739540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df7b4-7f3b-4dcd-b160-01b075a9fcb7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.778052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.778793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.779221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.779505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.780342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.781896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.808305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 152/307] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 25 00:44:38 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:44:38.808305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:38.858182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8272-7227-486d-8b92-3b8320587c6a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.902621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.903345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.903632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.903912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] PATH_INFO: `/v3/system/users/dc5c8df6131744c1a4702fb3a8d33409/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:38.906019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc5c8df6131744c1a4702fb3a8d33409, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:38.908460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:38.921494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 156/308] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 25 00:44:38 2022] PUT /identity/v3/system/users/dc5c8df6131744c1a4702fb3a8d33409/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:38.942745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c262cc-6cce-4c50-8213-e28d64994f0e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:38.967738 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:38.994436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:38.995104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:38.995388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:38.995726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] PATH_INFO: `/v3/users/7a563a10a93f4fd19429a599c5756c55` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.014050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a563a10a93f4fd19429a599c5756c55)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:39.016049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac936b58-9414-4626-b8f2-296e9e1663b0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:39.018361 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 153/309] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:38 2022] GET /identity/v3/users/7a563a10a93f4fd19429a599c5756c55 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:39.025052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:39.127046 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:39.169651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89cc97-41b3-4cf4-8f19-a370d9656205 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:39.188966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8b62-d966-4ea5-a746-d50e9576fd44 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:39.188966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8b62-d966-4ea5-a746-d50e9576fd44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:39.188966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8b62-d966-4ea5-a746-d50e9576fd44 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.188966 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 154/310] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:39.195605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:39.195919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:39.196152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.214220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:39.214773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:39.214884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:39.215098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:39.215371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.216055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:39.216162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, user.id=7a563a10a93f4fd19429a599c5756c55, scope.system=all) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:39.216398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:39.217876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:39.226353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 157/311] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 25 00:44:39 2022] GET /identity/v3/role_assignments?user.id=7a563a10a93f4fd19429a599c5756c55&scope.system=all&role.id=2b840863ca9e41d782022e3a563133e1 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:39.302660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:39.578589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:39.690157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39197319-9e6b-4105-9747-4b14d69599a7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:39.723585 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:39.730183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:39.731119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:39.731664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:39.732180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.744306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:39.750916 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:39.751836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:39.752619 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:39.755232 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 158/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:39.765467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:39.868178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d7a1d-b723-415b-b36b-01052fe01c93 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:39.875920 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:39.905091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:39.905738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:39.906013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:39.906283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:39.906954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:39.907251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:39.908695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:39.918929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:39.924800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:40.039942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae86-e486-4887-aa67-d9868e8288b3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:40.076030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:40.076674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:40.076959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:40.077236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] PATH_INFO: `/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:40.078517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] RBAC: Authorizing `identity:get_user(user_id=cb67ab5e355a4e2ea0632d8bdc2dcc7f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:40.080108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:40.082083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 159/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:39 2022] GET /identity/v3/users/cb67ab5e355a4e2ea0632d8bdc2dcc7f => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:40.088684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:40.201546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a10c-3d7d-4276-b2f9-632a339cdd40 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:40.237525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:40.238498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:40.238971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:40.239433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:40.276745 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:40.313215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:40.315041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:40.423962 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:40.430794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:40.493493 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:40.540559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4908b-7caf-471e-a38d-d362625fbff4 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:40.577717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:40.578275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:40.578558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:40.578835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:40.580062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:40.581552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994331-6e7c-49f2-9290-1ead72b407f4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:40.583599 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:40 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:40.589737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:40.661768 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:40.701196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374db89b-50bf-455e-9636-00f875eb9df9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:40.745750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:40.746741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:40.747217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:40.747779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:40.748737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, scope.project.id=5bc9b5c719d44717acee19df23ef6450, user.id=cb67ab5e355a4e2ea0632d8bdc2dcc7f) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:40.749251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:40.751002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc986d-fc97-4c9a-bfbd-a2cc5edf5590 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:40.759282 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:44:40 2022] GET /identity/v3/role_assignments?user.id=cb67ab5e355a4e2ea0632d8bdc2dcc7f&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=2b840863ca9e41d782022e3a563133e1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:41.222792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a352-1faa-4af2-bd0b-541e18f032f8 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.223069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a352-1faa-4af2-bd0b-541e18f032f8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.223506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a352-1faa-4af2-bd0b-541e18f032f8 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.225803 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:41.231617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799895c-8250-4ec7-9745-b7b5469bf07c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.232459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799895c-8250-4ec7-9745-b7b5469bf07c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.232871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799895c-8250-4ec7-9745-b7b5469bf07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.252293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b799895c-8250-4ec7-9745-b7b5469bf07c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:41.253727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b799895c-8250-4ec7-9745-b7b5469bf07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:41.322876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ea18-94a5-4bb9-9b6f-c126b09bf8bd None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.323310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ea18-94a5-4bb9-9b6f-c126b09bf8bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.323621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ea18-94a5-4bb9-9b6f-c126b09bf8bd None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.330125 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 162/320] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:41.335185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 159/321] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:41.337104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58548c-cbe6-4a8d-ab81-89521a6d04c9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.337393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58548c-cbe6-4a8d-ab81-89521a6d04c9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.337698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58548c-cbe6-4a8d-ab81-89521a6d04c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.357558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9a58548c-cbe6-4a8d-ab81-89521a6d04c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:41.358771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a58548c-cbe6-4a8d-ab81-89521a6d04c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:41.441298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:41.444137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f695-7da0-484f-9e85-17a0c21b8a8b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.444438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f695-7da0-484f-9e85-17a0c21b8a8b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.444885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f695-7da0-484f-9e85-17a0c21b8a8b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.446482 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 160/323] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:41.452489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.453028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.453473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.473925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:41.475498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:41.540297 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:41.556564 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:41.614119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f695-7da0-484f-9e85-17a0c21b8a8b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:41.688963 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:41.711920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:41.734900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f695-7da0-484f-9e85-17a0c21b8a8b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:41.770048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:41.770684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.770964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.771240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.772885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:41.774376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:41.776228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 161/325] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:41.781636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:41.822714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b10f-4df2-4fde-8bd0-c54c9b80fda6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:41.859076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:41.859717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.860000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.860275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.871166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:41.875950 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:41.876883 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:41.877727 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:41.878863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:41.888193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebbc3d-add1-48fd-bed7-64fe7ee4a6d4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:41.917548 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:41.923911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:41.924556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:41.924836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:41.925115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:41.925795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:41.927254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:41.928529 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:41.942300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 162/327] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 25 00:44:41 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:44:41.943466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.006894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834f3f-fa30-41b6-8692-3f6e14b6f622 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.045525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.046176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.046459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.046732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.058215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:42.061594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33ba1-beec-4b8e-95cb-22cb68a3a58e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:42.063267 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:42.064137 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:42.065003 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 166/328] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:42.071263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.104007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.104648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.105131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.105435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.106513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:42.106852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.108285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.122566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:42.123977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.192946 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:42.197057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e5a-8461-4815-bf32-888f80f8693a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.209796 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:42.246151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.247099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.247483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.247652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.248602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:42.248909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.250856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.253237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f9071-e045-4462-a35e-07ba6b4172e4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.264311 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:42.269703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.296449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.297105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.297389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.298243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] PATH_INFO: `/v3/users/dc5c8df6131744c1a4702fb3a8d33409` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.299630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] RBAC: Authorizing `identity:get_user(user_id=dc5c8df6131744c1a4702fb3a8d33409)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.301085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.303702 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:42 2022] GET /identity/v3/users/dc5c8df6131744c1a4702fb3a8d33409 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:42.309584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.400644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8eb54-2584-47b0-ade3-68f1b1ff7a62 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.444531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd78aa-0cd3-4669-9f28-73be2907382e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.450774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.451443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.451726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.451997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] PATH_INFO: `/v3/users/7a563a10a93f4fd19429a599c5756c55` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.453874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] RBAC: Authorizing `identity:get_user(user_id=7a563a10a93f4fd19429a599c5756c55)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.455401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.457217 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:42 2022] GET /identity/v3/users/7a563a10a93f4fd19429a599c5756c55 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:42.463270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:42.477796 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:42.493010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.493690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.493985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.494255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.495003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] RBAC: Adding query filter params (role.id=fdda722dbaf545f283cce96500a5ed63, user.id=dc5c8df6131744c1a4702fb3a8d33409, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:42.495362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.496936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3ddb-f977-481e-9e63-95bd1e678c62 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.514560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 25 00:44:42 2022] GET /identity/v3/role_assignments?user.id=dc5c8df6131744c1a4702fb3a8d33409&scope.system=all&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:42.526138 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:42.607124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01a3a-9db4-482f-b304-f0f19c95cd17 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:42.647828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:42.648599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:42.648930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:42.649212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] PATH_INFO: `/v3/system/users/7a563a10a93f4fd19429a599c5756c55/roles/2b840863ca9e41d782022e3a563133e1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:42.650782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a563a10a93f4fd19429a599c5756c55, role_id=2b840863ca9e41d782022e3a563133e1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:42.652395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fcc33-9661-480a-9524-e43e86e1d1e1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:42.663713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 25 00:44:42 2022] PUT /identity/v3/system/users/7a563a10a93f4fd19429a599c5756c55/roles/2b840863ca9e41d782022e3a563133e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:44:44.786938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7603f-ae63-460e-8eae-d5b5842f5d1f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:44.787554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7603f-ae63-460e-8eae-d5b5842f5d1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:44.787813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7603f-ae63-460e-8eae-d5b5842f5d1f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:44.789606 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:44.796348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80735-a6fb-4756-90b3-9ba93896cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:44.796870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80735-a6fb-4756-90b3-9ba93896cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:44.797358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80735-a6fb-4756-90b3-9ba93896cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:44.825003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-88c80735-a6fb-4756-90b3-9ba93896cbc1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:44.826283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88c80735-a6fb-4756-90b3-9ba93896cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:44.918160 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:45.039542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3cc5f-e703-460c-bcbf-5894267ea954 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.039841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3cc5f-e703-460c-bcbf-5894267ea954 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.040006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3cc5f-e703-460c-bcbf-5894267ea954 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.041672 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 167/337] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:45.047347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b52b5-6eff-4ee8-bb7f-edc18f499b98 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.047639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b52b5-6eff-4ee8-bb7f-edc18f499b98 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.047918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b52b5-6eff-4ee8-bb7f-edc18f499b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.072187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-400b52b5-6eff-4ee8-bb7f-edc18f499b98 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:45.073390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-400b52b5-6eff-4ee8-bb7f-edc18f499b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:45.108409 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:45.164859 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 171/338] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:45.301993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3cc5f-e703-460c-bcbf-5894267ea954 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:45.447119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3cc5f-e703-460c-bcbf-5894267ea954 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:45.465624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67ca9-dfd3-4c48-b5e6-65423dcfe0b7 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.465908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67ca9-dfd3-4c48-b5e6-65423dcfe0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.466355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67ca9-dfd3-4c48-b5e6-65423dcfe0b7 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.468145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 172/339] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:45.475660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.476198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.476618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.488073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:45.488688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.488969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.489241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.512781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:45.513613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:45.519919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:45.524118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:45.525126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:45.526094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:45.529503 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 168/340] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:45.530546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:45.601906 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:45.659490 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 173/341] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:45.660589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:45.676734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107b888-0d67-48dc-b292-3e09453aa917 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:45.727850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:45.728896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.729385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.729861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.744712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-83f14658-c3aa-4377-86fe-e8f88bdc2be2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:45.750912 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:45.752047 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:45.753172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:45.755296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 169/342] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:45.757160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddb0f-3bf0-46a0-9fda-38cb7ef71a4f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.757651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddb0f-3bf0-46a0-9fda-38cb7ef71a4f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.758338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddb0f-3bf0-46a0-9fda-38cb7ef71a4f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.760168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 170/343] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:45.765119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ddb0f-3bf0-46a0-9fda-38cb7ef71a4f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:45.789359 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:45.801635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345b46c-42ba-44c0-8d1a-0211af094f0a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:45.857795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:45.858339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.858621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.858893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.859569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:45.859870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:45.861255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e9204-3934-4e1e-8aa9-c8037f452e9c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:45.884176 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 174/344] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:45.887379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:45.887588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:45.887865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:45.926626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:45.927888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:45.955248 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:45.964758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ddb0f-3bf0-46a0-9fda-38cb7ef71a4f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.033722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.034605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.035202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.036295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.040175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:46.040710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:46.042287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:46.063426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 171/345] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:46.067254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.073911 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 175/346] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:46.075498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.250945 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.281263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236da13-326f-4c61-b74f-6b2dbd5a5ad8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.287242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245bf27-c838-4130-87fd-52fe25ce51f0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.352108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.353448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.354201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.355475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.355931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.357790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.358240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.360362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.429914 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.478330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:46.480085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:46.485884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:46.487603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:46.598090 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.616825 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 172/347] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:46.617979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.630499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 176/348] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:46.632409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.696630 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.741188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac048e4-b6d9-4768-bff6-3c0db9b25580 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.766014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e458f0-1e0f-485b-8ed7-b772b537119c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.782095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.782735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.783015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.783294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.798646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:46.804189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:46.805341 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 25 00:44:46.806351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:46.807574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 173/349] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:46.808422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.813694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.814988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.815445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.815887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.828745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:46.833704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:46.835501 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:46.836504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:46.839730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 177/350] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:46.840816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:46.896225 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.944201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b93f5-0e99-4252-a430-c942d7f335cb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.965960 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:46.967844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5c4e-2af9-4948-9d9c-2bf78408d3cf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:46.991436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:46.992136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:46.992418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:46.992688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:46.994412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:46.996023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47769-9d09-4536-aabe-e6aaa8401866 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:46.998976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.000158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b9dc-a1e7-4249-b0e4-f06f9878e59c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.000438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b9dc-a1e7-4249-b0e4-f06f9878e59c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.000708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b9dc-a1e7-4249-b0e4-f06f9878e59c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.002233 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 175/352] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:47.002935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b9dc-a1e7-4249-b0e4-f06f9878e59c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.016949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.017991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.018475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.019912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.020945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.022392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.024357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 178/353] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:46 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.029471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.135857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b9dc-a1e7-4249-b0e4-f06f9878e59c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.160607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786be50-65e6-4b3c-83b6-d433a696afa2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.180800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.181448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.181730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.182007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.182909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:47.183219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.184575 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.185385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12195e-43d3-407d-9096-ab406e0f642f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.195168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 176/354] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.196710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.197001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.197272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.218675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:47.218996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.219647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.219897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:47.220001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.220190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.220900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:47.221205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.222624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.233238 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 179/355] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.234389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.288623 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.316480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 177/356] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:47.317470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.366546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd685-c286-4e50-a95f-e0c8ebfb3eee None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.415779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.415968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.416314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.416731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.430432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.432431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.435037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 180/357] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.435989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.446647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59cf07-0b0d-49cf-a8cf-25fcad4a0eb0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.489611 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.496679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.497334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.497647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.497917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.499044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.500488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5572d-1dd7-419e-936f-1d112541346a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.502501 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 178/358] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.504390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe96d-ba63-444a-93d1-24941a2d0f96 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.504516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe96d-ba63-444a-93d1-24941a2d0f96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.504733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe96d-ba63-444a-93d1-24941a2d0f96 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.507279 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 179/359] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:47.507385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbe96d-ba63-444a-93d1-24941a2d0f96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.580677 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.583488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41d85-945b-4c48-964a-c46861984298 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.630034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.630687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.631517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.631888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] PATH_INFO: `/v3/users/7a563a10a93f4fd19429a599c5756c55` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.633679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] RBAC: Authorizing `identity:get_user(user_id=7a563a10a93f4fd19429a599c5756c55)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.635148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.637002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 181/360] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/users/7a563a10a93f4fd19429a599c5756c55 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.637536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.649100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbe96d-ba63-444a-93d1-24941a2d0f96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.693223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.693932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.694218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.694493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.756248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8485-fa7b-48ba-820a-1921db1c8873 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:47.767004 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.779682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.781209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdb50-6295-4108-903c-86de943653e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.809211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:47.809873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.812203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.812494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.816172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:47.816728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:47.818064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:47.825461 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 182/361] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:47.826436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:47.839646 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:47.911116 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:47.912877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:47.913468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:47.913958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:47.938133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:47.939982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:47.977238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3c5e9-95f5-486a-9ff4-34bd9314efd7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.028851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.029810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.030097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.030375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.031494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:48.031629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.034149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:48.040923 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:47 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=43b01aadcec14574861255a746ef1a34 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:48.041932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.047245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:48.049243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.108286 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.231719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4198-2872-4b55-8125-f41ef328db26 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.241804 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.266568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb7eac-ccb4-4522-9130-2727857b75a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.306212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.306867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.307147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.307417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.326041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:48.331559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:48.332522 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:48.333338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:48.335392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.343177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.343817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.344099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.344368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.345109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] RBAC: Adding query filter params (role.id=2b840863ca9e41d782022e3a563133e1, user.id=7a563a10a93f4fd19429a599c5756c55, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:48.345505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.347987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:48.366663 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/role_assignments?user.id=7a563a10a93f4fd19429a599c5756c55&scope.system=all&role.id=2b840863ca9e41d782022e3a563133e1 => generated 510 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:48.367530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.523620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c646-6078-43b6-8421-76a0d9107885 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.534578 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.563710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d35af-4d50-4d4c-854b-3ad96c346d3e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.567338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.567977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.568262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.569248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.570108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:48.570414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.571808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:48.581936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 183/367] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:48.585533 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.587075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.680149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.680796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.681243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.681708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.683256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.684986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:48.691629 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 185/368] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:48.692863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.705385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f28c8-cadc-458e-b5e7-460a1a58518e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.748967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.749199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.749465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.749673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.768640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:48.775280 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:48.776160 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:48.777352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.838898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034d4f-a637-439a-a154-ba8eaf31d5ef None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.861142 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.882689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.883562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.883840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.884393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.909271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d2f3d-1d2d-47a6-85df-5fb215ca21e2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:48.923746 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:48.954310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:48.954957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:48.955241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:48.955517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:48.956758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.958461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:48.960844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 185/370] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:48.961658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:48.967518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:48.969013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.082048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 186/371] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:49.082820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961713-5faa-4773-adb4-ee8d388124ef None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.083282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.125770 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:49.130105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.130738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.131687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.132037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.132689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:49.133252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.135511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.146635 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 186/372] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:49.147575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.154240 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:49.205708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa876-f772-4ce0-bc2a-5252def68d10 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.258615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.259238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.259522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.259945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.261603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=5bc9b5c719d44717acee19df23ef6450) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:49.261943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.263430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.276725 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 187/373] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:49.277612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.296040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02eb-453b-4a8e-b781-5d22c68ea474 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.367425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.368487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.369005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.369515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.373033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.374952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.378154 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 187/374] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:49.390170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.490028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9266d-9aca-4e81-b054-4366cac3b03d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.506328 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:49.543268 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:49.556757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.557800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.558343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.558830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.569785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766ce0c-4223-4c7e-85fe-5c412afbf69f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.611368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.612058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.612342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.612614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.614886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.616400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.618383 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 188/375] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:49.625177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.682747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.684235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.814181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7e7f-20a8-4df4-a6a0-5d1aef207471 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:49.856298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 188/376] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:49.858384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:49.863699 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:49.887539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:49.888072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:49.888350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:49.888620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:49.889356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=5bc9b5c719d44717acee19df23ef6450) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:49.889692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:49.891136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:49.909355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 189/377] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=43b01aadcec14574861255a746ef1a34 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:49.925810 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:50.016724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd790be3-50c4-41c9-8fa6-477718f47b0d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:50.075528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:50.076205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:50.076481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:50.076749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] PATH_INFO: `/v3/projects/703ca81b507b4a13a3d49269a53cbe77` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:50.078048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] RBAC: Authorizing `identity:get_project(project_id=703ca81b507b4a13a3d49269a53cbe77)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:50.079583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:50.081807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 189/378] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:49 2022] GET /identity/v3/projects/703ca81b507b4a13a3d49269a53cbe77 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:50.087976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:50.236495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357843-7c52-45c7-8dd8-ad41718abdb7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:50.285823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:50.286476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:50.286757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:50.287033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] PATH_INFO: `/v3/groups/1fb3e64c6f10411c89bf8080542043d9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:50.299664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb3e64c6f10411c89bf8080542043d9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:50.301136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06721b53-bb60-45ae-9536-77d222a5af31 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:50.303174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 190/379] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:50 2022] GET /identity/v3/groups/1fb3e64c6f10411c89bf8080542043d9 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:50.309147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:50.471699 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:50.479654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1058a-5685-42f3-89b8-bea648fa2f26 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:50.500722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fcdf3-e7b1-4a8c-bd3c-f2b9d0272cb6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:50.500910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fcdf3-e7b1-4a8c-bd3c-f2b9d0272cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:50.501191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fcdf3-e7b1-4a8c-bd3c-f2b9d0272cb6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:50.502889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 191/380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:50.508855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06476d-d026-40d6-a835-4b79e0170ada None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:50.509643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06476d-d026-40d6-a835-4b79e0170ada None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:50.509643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06476d-d026-40d6-a835-4b79e0170ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:50.528738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:50.529357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:50.529686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:50.529954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:50.530690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] RBAC: Adding query filter params (group.id=1fb3e64c6f10411c89bf8080542043d9, role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=703ca81b507b4a13a3d49269a53cbe77) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:50.531000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:50.532488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbd63-2a43-4ee6-a3f2-d0082872abd4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:50.541086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 190/381] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:50 2022] GET /identity/v3/role_assignments?group.id=1fb3e64c6f10411c89bf8080542043d9&scope.project.id=703ca81b507b4a13a3d49269a53cbe77&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:50.558728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cc06476d-d026-40d6-a835-4b79e0170ada None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:50.560016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc06476d-d026-40d6-a835-4b79e0170ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:50.641884 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:50.675975 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:51.012378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d409b4-6020-45ca-ab96-c58e9d3f5004 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.012898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d409b4-6020-45ca-ab96-c58e9d3f5004 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.012898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d409b4-6020-45ca-ab96-c58e9d3f5004 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.014272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 191/383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:51.019614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.019898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.020177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.027250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d409b4-6020-45ca-ab96-c58e9d3f5004 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:51.047442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:51.049724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:51.169723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d409b4-6020-45ca-ab96-c58e9d3f5004 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:51.215280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:51.216576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.217076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.217639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.219500 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 193/384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:51.237311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:51.242693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:51.243569 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:51.244689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 192/385] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:51.249863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:51.392987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d0f66-1634-448b-a433-19c80c59be07 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:51.416345 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:51.450505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:51.451224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.451516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.451788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.452492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:51.452797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:51.454285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:51.470472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 194/386] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:51.476066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:51.502739 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:51.606685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2952-bac6-40d8-be45-7d3cdccc2ee1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:51.655590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:51.656152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.656433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.656708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.657965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:51.659460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:51.661540 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 193/387] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:51 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:51.666981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:51.720007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:51.878763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efeb33-aeb0-4fec-bea7-20be321ff30f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:51.920286 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:51.942649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:51.943338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:51.944120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:51.944404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:51.946537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:51.948025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:51.949781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 195/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:51 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:51.952045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834928f-042f-444a-8a29-7692d40cf997 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:51.962466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.010337 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:52.040536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.041205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.041594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.041781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.064815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:52.070578 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:52.071476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:52.072263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:52.077932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 194/389] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:52.082588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58185be-b062-4abe-b689-1d5cd664dd42 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:52.083507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.125379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.126379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.126841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.127318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.133519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, group_id=18efbfaec0454f6cacac8ac2f2684e73, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:52.135245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0102c-7d97-4bc0-8a74-b7e682df1499 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:52.163817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 196/390] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 25 00:44:51 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:52.233742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd407-c9d0-4426-b574-3b47adfbbd82 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.234924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd407-c9d0-4426-b574-3b47adfbbd82 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.235458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd407-c9d0-4426-b574-3b47adfbbd82 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.237313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 197/391] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:52.254779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14bca-aa8a-4a8b-9a45-20ab3714fe50 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:52.261560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.262181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.262717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.294460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:52.297999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:52.348800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.350246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.350741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.352160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.353074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:52.354426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:52.358777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:52.376534 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 195/392] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:52.381749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.398469 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:52.435870 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 198/393] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:52.503804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e239e36-839e-4ed3-bf9b-5c87fe3e4714 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:52.554709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.555376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.555657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.555928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.562449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:52.563990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ed72-ebbf-4183-a026-0a37c7a95435 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:52.565777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 196/394] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:52 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:52.572288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.632468 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:52.702112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91161a-5721-4f74-b093-f970151644d3 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.702777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91161a-5721-4f74-b093-f970151644d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.703318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91161a-5721-4f74-b093-f970151644d3 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.705239 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 197/395] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:52.710805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.711355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.712984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.732043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:52.733869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:52.748747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b5a3-b451-4336-a0cb-453d1392c405 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:52.790948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.791994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.792502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.792969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.794507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:52.796329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:52.798649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 199/396] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:52 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:52.799843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.826083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 198/397] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:52.833620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:52.836704 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:52.939872 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:52.943376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06407937-6f9c-4465-a70a-38ff2112bef8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:52.984069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:52.985063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:52.985649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:52.986122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:52.988993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087cf6-ac69-4847-adfb-c8a0826aa513 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.006707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:53.011961 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:53.012833 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:53.013658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 200/398] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:53.024035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.056485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.057131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.057333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.057627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.060622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a286d3dc0f444f79a0e9d1453f8db79, group_id=18efbfaec0454f6cacac8ac2f2684e73, role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.062095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.084861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 25 00:44:52 2022] PUT /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/43b01aadcec14574861255a746ef1a34 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:53.193043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbde17-1436-4c5b-a1bb-558f01700a6d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.218961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.248905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.249755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.250030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.250299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.250984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:53.251283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.252736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.263594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 201/400] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:53.269263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.313821 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:53.348427 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:53.410613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621790d-22e9-4d54-a437-f671d7eae675 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.423442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3060-c29f-4db3-9463-e52488d2c5e0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.452188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.452897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.453183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.453500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.461288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.462161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.462585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.463060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.464383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.465512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:53.466272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2df5-d3d4-4f20-abf5-0099d86bb0fb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.468364 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 202/401] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:53.469722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc43a-9e73-48a8-9c19-3c6c58ae389f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.470184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc43a-9e73-48a8-9c19-3c6c58ae389f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.470692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc43a-9e73-48a8-9c19-3c6c58ae389f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.472113 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 203/402] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c9b9e03d-2fe7-4d52-ba15-97d23229fb9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:53.476610 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:53.477854 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:53.478890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:53.482172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc43a-9e73-48a8-9c19-3c6c58ae389f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.482581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.482905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.483342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.506437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:53.508310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:53.594394 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:53.601671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 201/404] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:53.602618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.622117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc43a-9e73-48a8-9c19-3c6c58ae389f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.691838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.692460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.692735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.692999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.693800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:53.694127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.696822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.724865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:53.726056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.726779 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:53.832803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517258c1-9bcf-4354-8da5-045f0ed2c490 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.872867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.873590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.874126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.874470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.875822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.877808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.880243 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:53.887827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:53.910522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479a5d-5960-4b0a-979f-053b9674b992 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:53.958793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:53.961430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:53.962082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:53.963567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:53.965081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:53.967520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:53.969911 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 205/407] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:53.978414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.005549 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.049251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2719-b614-4b9b-a565-e30202eb12d2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.075155 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.086729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898314-32da-402d-b107-881b6940c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.087572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898314-32da-402d-b107-881b6940c193 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.087688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898314-32da-402d-b107-881b6940c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.087917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898314-32da-402d-b107-881b6940c193 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.089999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898314-32da-402d-b107-881b6940c193 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, group_id=18efbfaec0454f6cacac8ac2f2684e73, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.091399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898314-32da-402d-b107-881b6940c193 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.098552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27330f4-cc1c-434b-a920-2a2634521d11 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.109460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 203/408] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 25 00:44:53 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:44:54.109460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898314-32da-402d-b107-881b6940c193 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.180059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.180731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.181012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.181283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.184253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.187254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.189071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:53 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:54.196419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.302947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898314-32da-402d-b107-881b6940c193 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.345156 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.345716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.346136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.346414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.346728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.355495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc453-0667-4ff9-93a3-1ff924a57f8e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.359979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:54.366022 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:54.367031 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:54.367899 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:54.372397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:54.374608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.400725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.401794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.402269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.402733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.405128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9b5c719d44717acee19df23ef6450, group_id=18efbfaec0454f6cacac8ac2f2684e73, role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.406842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.424859 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 207/411] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 25 00:44:54 2022] PUT /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450/groups/18efbfaec0454f6cacac8ac2f2684e73/roles/43b01aadcec14574861255a746ef1a34 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:44:54.437905 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.515149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edd1a-76af-444b-b546-c16f5616b407 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.556529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.557569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.558070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.558534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.559413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:54.559930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.561681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.571968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:54.577379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.697533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f6e1-ae79-4ee3-8f37-419b897fa804 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.742804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.743817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.744379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.744845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] PATH_INFO: `/v3/groups/1fb3e64c6f10411c89bf8080542043d9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.746335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb3e64c6f10411c89bf8080542043d9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.748015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a0177-da28-4637-87c3-f01e53e13d72 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.750177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 208/413] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:54 2022] GET /identity/v3/groups/1fb3e64c6f10411c89bf8080542043d9 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:54.756236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.872003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3e69-b8ce-4fc1-bb32-cdb67ed65ff6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.872541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3e69-b8ce-4fc1-bb32-cdb67ed65ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.872957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3e69-b8ce-4fc1-bb32-cdb67ed65ff6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.874578 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 209/414] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:54.877200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda465-2448-426c-9b78-a624aae68406 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:54.880217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.881370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.881810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.888218 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.912775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:54.914257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:54.928276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:54.929211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:54.929691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:54.930163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] PATH_INFO: `/v3/projects/703ca81b507b4a13a3d49269a53cbe77` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:54.931498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=703ca81b507b4a13a3d49269a53cbe77)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:54.933188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:54.935446 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 206/415] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:54 2022] GET /identity/v3/projects/703ca81b507b4a13a3d49269a53cbe77 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:54.940880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:54.942635 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:54.996379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 210/416] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:55.090047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4bcd-87e2-4b71-8ad5-cf9066b7a2a9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:55.129226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:55.129915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:55.130194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:55.130466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] PATH_INFO: `/v3/projects/703ca81b507b4a13a3d49269a53cbe77/groups/1fb3e64c6f10411c89bf8080542043d9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:55.133656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=703ca81b507b4a13a3d49269a53cbe77, group_id=1fb3e64c6f10411c89bf8080542043d9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:55.135101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:55.155546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 25 00:44:54 2022] PUT /identity/v3/projects/703ca81b507b4a13a3d49269a53cbe77/groups/1fb3e64c6f10411c89bf8080542043d9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 00:44:55.336738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:55.454048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9b08-d010-4c79-80d9-4aa1916b706f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:55.513551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:55.514562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:55.515055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:55.515516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:55.535226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:55.541040 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:55.542003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:55.542794 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:55.545682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 211/418] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:55.554580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:55.603729 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:55.680533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7da2-47c9-4731-8a26-d5cf82429d35 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:55.719250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:55.719854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:55.720130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:55.720396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:55.721051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] RBAC: Adding query filter params (name=member) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:55.721345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:55.722815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c3e4-07d8-4d48-8ced-6f1339bc92de None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:55.732976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 208/419] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:55.739025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:55.757678 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:55.805842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9dba9-58d0-4072-8280-0c7c30b93554 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:55.807009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9dba9-58d0-4072-8280-0c7c30b93554 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:55.807496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9dba9-58d0-4072-8280-0c7c30b93554 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:55.809630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 209/420] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:55.830406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:55.830718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:55.830943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:55.860466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:55.861635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:55.961885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556c6f-5b85-47bb-8364-d0c8fa73556c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:55.994438 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:56.025191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.026226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.026722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.027186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.107361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.109178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.119024 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:56.231494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 212/422] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:56.237365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.270371 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:56.344126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430492c2-7f69-4691-90a1-5ceddf5a7fe1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.381500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.382723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.383456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.383920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.385320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.387012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.389980 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:56.394545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.468716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.562672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba3806-d2b3-40a6-bec0-c8736b8105fe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.577763 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:56.626510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.627172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.627452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.627725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.628855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.630339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.635406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 213/424] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:56.639262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.645746 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:56.657937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a859f8-f5ad-425a-8660-445ed669fd7d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.728123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.728771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.729049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.729317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.753010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:56.758581 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:56.759552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:56.760427 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:44:56.770653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:56.794898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf455-cbf1-4b46-a09a-67f5c9ba64e5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.836076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.836698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.836978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.837251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.838157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:56.838497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.840075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590422f-7ec2-4eaa-b152-87116a204358 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.847548 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 214/426] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:56.929817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cf34-4589-42a3-867b-c236e7f68fc3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:56.974202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:56.975037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.975215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.975424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.976129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:56.976434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:56.977926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:56.983037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cad8-5719-41a1-97db-971d78936001 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.983668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cad8-5719-41a1-97db-971d78936001 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.984140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cad8-5719-41a1-97db-971d78936001 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.987280 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 215/427] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:56.988605 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 213/428] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:56.993301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9fa7-af59-47c3-8e74-6e91377ae714 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:56.993938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9fa7-af59-47c3-8e74-6e91377ae714 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:56.994416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9fa7-af59-47c3-8e74-6e91377ae714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:56.997264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.025810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-47ff9fa7-af59-47c3-8e74-6e91377ae714 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:57.028443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-47ff9fa7-af59-47c3-8e74-6e91377ae714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:57.034638 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.081738 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.157770 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 216/429] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:57.185640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af7d2b-9b4e-4ec2-9d87-fa918cf99cea None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.229745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.230709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.231209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.231677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.316301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.319397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.338098 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.408640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8784-68d6-43d7-96a3-b52ae837cf08 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.408967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8784-68d6-43d7-96a3-b52ae837cf08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.409194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8784-68d6-43d7-96a3-b52ae837cf08 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.410712 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 217/430] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:44:57.417016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.417611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.418078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.440248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:57.441869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:57.450444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 214/431] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:44:57.456323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.538352 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 218/432] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:44:57.539640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.594341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0d7f2-913d-47f2-a33e-a1e7fdb7dc39 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.618571 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.644349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.645927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.646944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.647859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] PATH_INFO: `/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.649503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] RBAC: Authorizing `identity:get_project(project_id=3a286d3dc0f444f79a0e9d1453f8db79)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.652168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.655302 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 215/433] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/projects/3a286d3dc0f444f79a0e9d1453f8db79 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:57.656966 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.660501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.660970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f413b-d277-4097-92d4-41c8b0887c86 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.710927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.711515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.711794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.712073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.728661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:57.733739 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:57.734643 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:44:57.741041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 219/434] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:57.744754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.798491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b629a-89d4-4bfa-a460-e4e9984d86cf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.846282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.847191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.847621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.848040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.850257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.855384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.857841 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 216/435] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:57.863353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.870418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf1a5-1a75-459f-a67d-01c8e9ff9a11 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:57.911475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:57.912617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:57.913011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:57.913613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:57.914369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:57.914676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:57.916087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:57.929559 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 220/436] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:57.932552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:57.939645 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.961148 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:57.993110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2ff01-b012-4ddf-ae00-6729cdeee3a9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.028110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.028720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.029002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.029275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.030043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:58.030353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.031802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1397376-73e9-4599-aa90-3335180dd581 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.038297 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 217/437] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=3a286d3dc0f444f79a0e9d1453f8db79&role.id=43b01aadcec14574861255a746ef1a34 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:58.039491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d3ed-bf8d-43c6-82dd-f937e72466cb None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.039775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d3ed-bf8d-43c6-82dd-f937e72466cb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.040054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d3ed-bf8d-43c6-82dd-f937e72466cb None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.041287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 218/438] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:44:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:44:58.042046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01d3ed-bf8d-43c6-82dd-f937e72466cb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.049213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9e92-dbee-4fe0-9472-d80c1da8c383 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.090504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.091138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.091417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.091686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.160665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01d3ed-bf8d-43c6-82dd-f937e72466cb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.172297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.173830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.184254 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.198653 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.204884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.205841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.206122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.206553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.220033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3c6dd1ea-cbc5-48dd-a8f0-8987b2400ca7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:58.225058 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:58.226304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 219/439] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:58.227979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.228686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.228686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.250917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:44:58.252120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:44:58.309360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 221/440] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:44:58.309360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.337777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 220/441] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:44:58.338657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.436205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db1e4-9a26-4b7e-a8e1-e0f014b5e992 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.460041 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.469509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f71fb-5adf-448c-bce7-b1a90f8a3039 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.477168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.477952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.478062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.478274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.479372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:58.479372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.479894 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.480748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.491522 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 222/442] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:58.496513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.529881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.530967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.531428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.531876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.533318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.535175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.537382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 221/443] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:58.542541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.611036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2de4-2066-4046-92c3-79acdad72ab3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.645550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.646153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.646591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.647093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.648179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c5b2-1f7f-4186-a387-021a2f6e13bf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.683112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.683745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.684030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.684307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.685455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.686919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.688526 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:58.689286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.697990 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.719604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.721127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.734850 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.798521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6b65-4ed5-4098-bfae-d6adfd0a11c1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.828609 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 223/445] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:44:58.829842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.835274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.835903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.836183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.836455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.846764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:44:58.852224 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:44:58.853275 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 223/446] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:44:58.854426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:58.915170 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.934522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814bf20-2fb6-4e7d-aa04-6e66fca29f6e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.956569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1562b5-c41e-455a-baa7-8aa47d81babf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:58.958338 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:58.970362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:58.970970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:58.971249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:58.971521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:58.972253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=fdda722dbaf545f283cce96500a5ed63, scope.project.id=5bc9b5c719d44717acee19df23ef6450) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:58.972555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:58.974041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:58.980347 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 224/447] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=fdda722dbaf545f283cce96500a5ed63 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:58.981149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.006055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.006618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.007703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.008007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] PATH_INFO: `/v3/projects/5bc9b5c719d44717acee19df23ef6450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.009691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] RBAC: Authorizing `identity:get_project(project_id=5bc9b5c719d44717acee19df23ef6450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.011271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.013226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 224/448] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/projects/5bc9b5c719d44717acee19df23ef6450 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:59.018946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.097513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0ced-9719-4501-b0ce-f168ea654534 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.139920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.140645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.140932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.141205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.141961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:59.142267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.142362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2325d-27b4-4598-9de0-ee615b72addd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.143738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.159061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:59.160645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.173284 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:59.189549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.190369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.190656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.191278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] PATH_INFO: `/v3/groups/18efbfaec0454f6cacac8ac2f2684e73` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.192650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] RBAC: Authorizing `identity:get_group(group_id=18efbfaec0454f6cacac8ac2f2684e73)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.194309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.196118 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/groups/18efbfaec0454f6cacac8ac2f2684e73 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:59.201949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.251161 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:59.288432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e6001-5ee0-4761-b928-2a00d2619e5c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.319305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c223f5-f4de-43c9-8aae-49799f7cc4a7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.330065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.330672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.330947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.331217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.359523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.360131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.360411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.360676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.361417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] RBAC: Adding query filter params (group.id=18efbfaec0454f6cacac8ac2f2684e73, role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=5bc9b5c719d44717acee19df23ef6450) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:59.361735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.363179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.370439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/role_assignments?group.id=18efbfaec0454f6cacac8ac2f2684e73&scope.project.id=5bc9b5c719d44717acee19df23ef6450&role.id=43b01aadcec14574861255a746ef1a34 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:44:59.417136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.418654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.429593 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:59.534037 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:44:59.540348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.645054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458cfb-9062-481d-a743-7599d36defb0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.646707 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:59.681249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.681909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.682190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.682460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] PATH_INFO: `/v3/projects/703ca81b507b4a13a3d49269a53cbe77` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.683597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] RBAC: Authorizing `identity:get_project(project_id=703ca81b507b4a13a3d49269a53cbe77)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.685060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.686714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/projects/703ca81b507b4a13a3d49269a53cbe77 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:59.692421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.796754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ad84e-d15e-4e2a-b73a-a50c81167b7d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.806655 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:44:59.830784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.831407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.831683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.831952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] PATH_INFO: `/v3/groups/1fb3e64c6f10411c89bf8080542043d9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.833036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb3e64c6f10411c89bf8080542043d9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.835060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa82fb-3d5b-48ee-805f-245b80d165c8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.836597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/groups/1fb3e64c6f10411c89bf8080542043d9 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:44:59.842472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:44:59.940201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4a95-62b3-436e-85b1-93fc7b148734 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:44:59.973031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:44:59.973647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:44:59.973929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:44:59.974203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:44:59.974984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] RBAC: Adding query filter params (group.id=1fb3e64c6f10411c89bf8080542043d9, role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=703ca81b507b4a13a3d49269a53cbe77) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:44:59.975286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:44:59.976725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b2b5-be7d-40ac-ab44-818400fdc504 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:44:59.982367 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 25 00:44:59 2022] GET /identity/v3/role_assignments?group.id=1fb3e64c6f10411c89bf8080542043d9&scope.project.id=703ca81b507b4a13a3d49269a53cbe77&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:02.825970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610000d5-1bd9-440f-99cc-1c1ec8dd9fa0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.826498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610000d5-1bd9-440f-99cc-1c1ec8dd9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.826498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610000d5-1bd9-440f-99cc-1c1ec8dd9fa0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.828261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:02.833664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1bc3f-44b3-4cac-be58-2b8cabbeba1b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:02.834769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1bc3f-44b3-4cac-be58-2b8cabbeba1b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:02.835074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1bc3f-44b3-4cac-be58-2b8cabbeba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:02.859880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d3b1bc3f-44b3-4cac-be58-2b8cabbeba1b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:02.861091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d3b1bc3f-44b3-4cac-be58-2b8cabbeba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:02.898103 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:02.957851 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:03.025157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf93a-6cf8-4d04-82e4-8dee62b1d7e3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.025729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf93a-6cf8-4d04-82e4-8dee62b1d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.026171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf93a-6cf8-4d04-82e4-8dee62b1d7e3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.027653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 229/458] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:03.044608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe487-f460-48b0-bd90-31ac1fe9c1cb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.044926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe487-f460-48b0-bd90-31ac1fe9c1cb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.045179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe487-f460-48b0-bd90-31ac1fe9c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.070464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6dafe487-f460-48b0-bd90-31ac1fe9c1cb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:03.071740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6dafe487-f460-48b0-bd90-31ac1fe9c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:03.167200 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:03.206157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a46b-3d51-4ea3-8d3c-4d3296e19ee4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.206801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a46b-3d51-4ea3-8d3c-4d3296e19ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.207279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a46b-3d51-4ea3-8d3c-4d3296e19ee4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.208926 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 230/460] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:03.214896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.215479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.216007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.247534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:03.249109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:03.312479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a46b-3d51-4ea3-8d3c-4d3296e19ee4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:03.342896 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:03.476788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a46b-3d51-4ea3-8d3c-4d3296e19ee4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:03.507681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:03.522009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:03.522903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.523328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.523740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.536245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:03.539378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:03.553393 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0e7c433f-8c7f-485c-92cb-a80362178cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:03.562373 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:03.563529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:03.564587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:03.564587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:03.564587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:03.567044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 231/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:03.573357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d6a4-96c9-45c9-9c61-b90902ad4e09 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.574013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d6a4-96c9-45c9-9c61-b90902ad4e09 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.574458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d6a4-96c9-45c9-9c61-b90902ad4e09 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.576028 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 232/463] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:03.576948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1d6a4-96c9-45c9-9c61-b90902ad4e09 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:03.611108 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:03.652753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb815-e2c0-426e-9e8e-a95211a1eb56 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:03.689648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:03.690463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.691139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.691429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.703151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:03.704632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:03.714051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1d6a4-96c9-45c9-9c61-b90902ad4e09 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-37429364-efbb-4368-abbd-2a29b48371ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:03.720901 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:03.721866 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:03.722738 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:03.722738 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:03.722738 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:03.722738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:03.723197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.723640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.724061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.743338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:03.744568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:03.768632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:03.769739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.769739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.769930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:03.770532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:03.770837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:03.773603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:03.808344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:03.808344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:03.823144 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 233/466] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:03.828825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:03.843937 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:03.931819 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:03.948290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464fa7b-cf0e-44a5-af29-276f51e4d50b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:03.989245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868b15f-ecce-4bb4-b1e9-4793f8a047e4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:03.991355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:03.992380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:03.992899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:03.993446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.007455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.009689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:04.028205 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:04.029157 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:04.030473 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:04.030473 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:04.030473 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:04.032088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 234/467] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:04.033090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.038411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.039063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.039407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.039689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.041731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:04.042047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.043569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.060671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 234/468] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:04.066452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.166031 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:04.168029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5032-b28e-4989-b175-b87143cae8a2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.212516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a693ad-b088-4137-a68f-04b1ef261af0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.214408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.215092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.215383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.215658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.216310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.217819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.233530 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:04.250200 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 235/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:04.251639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.267257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.268309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.268791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.269269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.271020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:04.271792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.273544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.298323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 235/470] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:04.299576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.412260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e180f-7ba4-417d-88c2-522ade5d94bf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.457843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.458471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.458583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ac4f7-aa6b-4bab-9c96-1ed2d7d980a9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.460931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.460931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.460931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.462006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.492389 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 236/471] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:04.492975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.506921 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:04.521081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.522519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.523063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.523472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.543107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.544984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-019009e5-6b00-49e2-9466-180d86ad176c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:04.575171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:04.576147 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:04.577682 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:04.577682 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:04.577682 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:04.577682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 236/472] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:04.579638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7f77-06dc-4368-951e-e1d2c4214c60 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.579638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7f77-06dc-4368-951e-e1d2c4214c60 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.579818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7f77-06dc-4368-951e-e1d2c4214c60 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.583269 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 237/473] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:04.587505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7f77-06dc-4368-951e-e1d2c4214c60 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.607543 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:04.683972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a3ad-68ff-44cc-bf03-6bc8d54389d3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.723761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7f77-06dc-4368-951e-e1d2c4214c60 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.728934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.730446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.730446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.730446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.730802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.732270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ba629-fea9-49bb-b84f-abac29513723 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.760858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 237/474] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:04.762653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.763107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.763925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.768839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.769553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.769889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.770167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.770841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:04.771617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.773109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:04.788652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 238/475] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:04.790669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:04.792116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:04.794362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:04.848227 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:04.892253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:04.939492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dbd5-5fa1-4a23-bcbc-dc14b666dd19 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:04.996022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:04.996651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:04.996932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:04.997203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:04.997916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:04.999388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:05.037462 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:04 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:45:05.245666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.291900 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:05.364821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033defc6-4cd3-4f50-96f6-29cdfcbb702d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.411088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.415019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.415019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.415019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.415019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:05.415019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:05.433821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.sql.core [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:45:05.433821 n-d-master-1 devstack@keystone.service[81863]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 00:45:05.433821 n-d-master-1 devstack@keystone.service[81863]: [parameters: {'id': 'b220738711d34434bd79ca3f276cb00f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 00:45:05.433821 n-d-master-1 devstack@keystone.service[81863]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81863) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 25 00:45:05.455621 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return ref.to_dict() Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:45:05.456552 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application yield resource Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise self.value Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application session.commit() Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:45:05.457546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:45:05.458430 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:45:05.459483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:45:05.460278 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [parameters: {'id': 'b220738711d34434bd79ca3f276cb00f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:05.461042 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 25 00:45:05.467901 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:05.471419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 25 00:45:05 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:05.478178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:05.618937 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:05.627608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcab42-9198-436a-99b8-dfc85e9deb5d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:05.673104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:05.674150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:05.674628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:05.675090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:05.708121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-09a54694-e01d-41ca-82d7-6e7d91eb1165 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:05.714900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:05.715815 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 25 00:45:05.716597 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:05.724235 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:05.726005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:06.039706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ebd4-2181-472f-8451-de7ca118b6dc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:06.045723 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:06.127462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:06.128461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:06.128932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:06.129395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:06.130306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:06.131332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:06.132915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b321-0f79-4b20-bc60-10d0cda8c73a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:06.152528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:07.020058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a76f-4b70-4264-9357-57b29b5a12ab None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.021217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a76f-4b70-4264-9357-57b29b5a12ab None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.021752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a76f-4b70-4264-9357-57b29b5a12ab None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.023565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:07.028797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648011d-2248-4f73-a21d-c3ce1c66cee4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.029717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648011d-2248-4f73-a21d-c3ce1c66cee4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.030202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648011d-2248-4f73-a21d-c3ce1c66cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.058429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8648011d-2248-4f73-a21d-c3ce1c66cee4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:07.059941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8648011d-2248-4f73-a21d-c3ce1c66cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:07.155705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:07.481662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d8a2-dc00-4bcd-829e-95c9a6f73562 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.482021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d8a2-dc00-4bcd-829e-95c9a6f73562 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.482208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d8a2-dc00-4bcd-829e-95c9a6f73562 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.483830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 242/483] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:07.489330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.489714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.490705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.494324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d8a2-dc00-4bcd-829e-95c9a6f73562 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:07.538455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:07.540005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:07.617380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d8a2-dc00-4bcd-829e-95c9a6f73562 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:07.676914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:07.677686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.678137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.678622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.690239 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:07.710363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-dea35745-3892-41ac-8c3b-2ec84779f985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:07.717486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:07.718540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:07.719434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:07.727109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:07.777534 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:07.836534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7916-ca8d-4fb2-9a9b-918914b1531b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.836859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7916-ca8d-4fb2-9a9b-918914b1531b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.837067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7916-ca8d-4fb2-9a9b-918914b1531b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.839342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 244/486] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:07.860317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184223-c372-4134-ac63-4ebbcc8e48d3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.860616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184223-c372-4134-ac63-4ebbcc8e48d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.860848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184223-c372-4134-ac63-4ebbcc8e48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.882176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc184223-c372-4134-ac63-4ebbcc8e48d3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:07.883645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc184223-c372-4134-ac63-4ebbcc8e48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:07.894539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f309abd-7662-4d56-9ce7-f01893b0cf81 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:07.897156 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:07.934011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:07.934573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.934938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.935216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.935891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:07.936298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:07.937716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eadbe-f9d2-4fb5-b632-771cdda48d92 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:07.947143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 243/487] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:07.953295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f6bf-b2d3-41f0-bacb-3d3503c11f7d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.953610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f6bf-b2d3-41f0-bacb-3d3503c11f7d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.953894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f6bf-b2d3-41f0-bacb-3d3503c11f7d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.955325 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 244/488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:07.956027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6f6bf-b2d3-41f0-bacb-3d3503c11f7d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:07.965363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:07.966660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:07.966949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:07.967224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:07.987314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:07.988546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:08.101703 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 246/490] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:08.109669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.131815 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.167768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6f6bf-b2d3-41f0-bacb-3d3503c11f7d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.237704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.241446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.241778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.242051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.259840 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.262596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:08.264519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:08.280738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:08.281762 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:08.282583 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:08.282583 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:08.282583 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:08.283236 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 245/491] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:08.283986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.289688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2089-72c4-4e49-99c2-dc6e4aa4642c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.330544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.331799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.332224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.332953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.346773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:08.354539 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:08.355624 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.356591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:08.363684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 247/492] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:08.363684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.405343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b147d7-1bcc-4450-b08f-5fd350401501 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.449008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.449887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.451083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.451381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.461745 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.467306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:08.473823 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:08.475747 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.476745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:08.480769 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 246/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:08.481653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.490846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ce57-a52c-43ad-821f-9a8dfde604ab None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.531188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.531906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.532189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.532457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.533117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:08.533432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:08.534848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:08.537375 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.554546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 248/494] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:08.554546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.610291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4aab8-4f69-4303-8e30-b08f2b9e1301 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.649062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.649716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.649996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.650269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.650932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:08.651234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:08.652619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:08.660695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 247/495] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:08.661533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.681354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea434e-aceb-4cca-b760-43cb85682878 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.721490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.722246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.722534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.722810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.725625 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.735436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:08.741489 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:08.742451 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 249/496] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:08.743848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.775837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c7d9-a39b-4807-9f7e-6a4ebc241fed None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.808273 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.815197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.816111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.816572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.817049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.818068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:08.818578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:08.820887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:08.830226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:08.831344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.865336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba818d-49ef-45f9-a00a-80e82a4b79ec None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.902533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.903169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.903452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.903725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:08.914726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:08.917531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:08.936503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:08.937540 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:08.938448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:08.939004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:08.953062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3355-78b0-4446-abf6-2a87a3eea091 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:08.978885 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:08.995479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:08.996420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:08.996707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:08.996984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.010922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.012460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:09.030380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:09.031346 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:09.032874 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:09.032874 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.032874 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:09.032874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:09.032874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.064336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a88d23-e32c-498c-b4aa-58f11962a6cd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.081816 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.106861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.107610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.107894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.108167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.108976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:09.109629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.111065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.120385 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:09.121247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.157892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6792-f163-4ded-8b92-5da15e8acd8e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.194031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.194776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.195054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.195367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.206750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.208243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:09.225086 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:09.226254 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:09.227276 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:09.227276 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.227276 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:09.227276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:09.227276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.231603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f894ae2-a115-4ae7-84ed-ecd845e24a59 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.259276 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.267794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.268406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.268682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.268954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.269718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:09.270019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.271818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0561-83b1-484e-bf0e-5fd15041d564 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.311831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 252/502] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:09.313110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f575-b995-4934-ba60-2beea1519795 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.313393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f575-b995-4934-ba60-2beea1519795 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.313696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938f575-b995-4934-ba60-2beea1519795 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.314942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 253/503] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:09.317738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938f575-b995-4934-ba60-2beea1519795 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.337670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbfbc9-0639-4bda-a760-c330eeda5163 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.357502 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.383593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.387358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.402146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:09.403026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.450690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938f575-b995-4934-ba60-2beea1519795 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.489759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.490644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.490934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.491211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.502251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.503758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.517055 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:09.522612 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:09.523813 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:09.524659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:09.524659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:09.524659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:09.524659 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 254/505] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:09.524659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.533630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261527fb-75d7-41c3-bcfc-ca126ccd1378 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.571709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.572317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.572593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.572862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.574224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:09.574224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.575205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ee6d7-e154-48d1-9b81-682accc7721b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.587513 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:09.588810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.589059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.589333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.607657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:09.609174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:09.623750 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.648144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30135e-f905-4b97-9785-f9cffc56c85e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.683627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.684926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.685215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.685522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.689241 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 253/507] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:09.690739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.770219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.772088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.788524 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.816833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25283f4e-40a6-4cf3-94ae-77534b6f97f0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:09.855678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:09.856302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:09.856581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:09.856905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:09.867984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:09.869485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:09.869857 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:09.884220 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:09.885240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 254/508] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:09.886241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:09.895547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:09.896939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.012399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d27cb-05aa-4861-ae55-161e138275ad None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.017250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aec60-974a-4518-8b8b-9e46c55a925f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.050535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.051081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.051359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.051632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.056049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.056656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.056937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.057207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.057886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.058187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.059580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.061800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.062183 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.063828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.074049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 255/510] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.074897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:10.076568 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.077716 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 256/511] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.078665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.133848 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.194135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743c5b-596c-4f75-9f4a-6ff584d213cb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.194717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6e94-0b45-4912-aeca-f26f9f892e7a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.231478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.232107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.232212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.232387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.232657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.232810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.233165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.233484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.234256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.234732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.236495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.244202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.245734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:10.260985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.262159 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:10.263027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:10.263027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.263027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:10.263027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 257/512] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.263244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.281523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 256/513] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.282407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.346986 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.367188 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.371274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201258-4ba7-427d-b7f5-2b122a0832e6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.394465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc73f92-0ba8-4bce-890e-c5130112e62a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.406482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.407120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.407404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.407678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.418689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.420188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.429157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.429809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.430090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.430360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:10.434982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.436001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:10.437033 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:10.437033 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:10.437033 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:10.437033 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 258/514] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.437033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.438774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.441091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:10.453542 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:10.454483 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:10.455369 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 257/515] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:10.455929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.540241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24e3ad-df3f-4fb0-8b40-08b53513f8c5 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.558715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3200e-b5a8-4b44-9f7c-db4842d959ec None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.572563 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.574784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.575400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.575679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.575954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.576690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.576994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.578507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.595406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.596014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.596289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.596557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.597246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.597383 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 259/516] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.597527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.598261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.598926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.609365 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.613088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 258/517] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.614103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.699795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780615-19f3-487c-b354-f83d0efa7ee1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.716308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfefa-2090-4419-855e-8ce1de611713 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.734667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.735278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.735555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.735821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.752133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.752752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.753035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.753308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.754019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.754322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.756278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.768086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 259/518] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.768908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.803727 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.808100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.809598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.820045 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:10.871216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1ae-b0a7-493c-9957-952cee969657 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:10.906730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:10.907337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:10.907616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:10.907887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:10.908615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:10.908918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:10.910397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:10.912411 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 260/519] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:10.913271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:10.929698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 260/520] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:10.930547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.017467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3122a-b597-4622-80c3-9ec3ee2274d2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.024339 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.027831 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.033841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d24789-4b55-4c3f-a570-04f833d9e23b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.053889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.054506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.054778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.055042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.069309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.069978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.070261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.070538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.077279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.078794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:11.091525 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:11.092410 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:11.093226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 261/521] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:11.093840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.124693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.126120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.198365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f135e8-a2ea-4143-a322-3ff722dbeedb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.225747 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 261/522] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:11.226612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.233902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.234562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.234850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.235124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.235777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.237221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.238302 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.260609 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 262/523] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:11 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:11.261541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.282219 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.349603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae9c4-bef5-4900-8307-cebb8f30e3a7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.394823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.395492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.395772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.396665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.400623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6afe-1678-4c83-9793-66db9dc7044f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.408009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.409578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:11.433552 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:11.434533 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:11.435455 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:11.435455 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.435455 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:11.435455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 262/524] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:11.435676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.449799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.450423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.450705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.450978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.505143 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.538144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.539786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.550699 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.551183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3660-7278-4b9f-b3bd-515401b1744f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.590325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.590973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.591254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.591506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.592330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:11.592637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.594245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.618411 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 263/525] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:11.618411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.664432 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 263/526] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:11.664432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.733397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892506f0-1b15-4c61-a698-0834403fe3cc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.755490 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.772303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.772940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.773221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.773567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.775412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d82af-be5e-4f91-b9fb-4b446295d4b0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.786289 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:11.787328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.789840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:11.809503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:11.810573 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:11.811439 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:11.811439 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:11.811439 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:11.812081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 264/527] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:11.812326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.819661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.820281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.820562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.820834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.821516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:11.821819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.823207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.840228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 264/528] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:11.840228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:11.933881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8b422-c5ca-4860-934b-9826be0e5be6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.959062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c5a1-86ef-4ce2-8c20-c00dc5ac5123 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:11.970454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:11.971057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:11.971348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:11.971612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:11.972348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=8565cc85e8a149ac8761b7f687ff7552) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:11.972654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:11.974222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:11.985433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 265/529] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/role_assignments?user.id=8565cc85e8a149ac8761b7f687ff7552&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:11.985433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.009163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.009940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.010292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.010684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.024081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.025727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.035105 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:12.044398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:12.045371 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:12.046258 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:12.046258 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:12.046258 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:12.050415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 265/530] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:12.051436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.076739 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.118528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95cba-7ed8-4726-bc4d-e256457624ef None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.158212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.159273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.159847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.160321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.161188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.162336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.164144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.166407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc4b9-1df7-4d14-ac93-c05f7331dc97 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.183340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 266/531] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.184802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.209868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.210415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.210703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.210949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.221809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.223428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:12.237677 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:12.238608 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.239451 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:12.244034 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 266/532] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:12.245618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.310536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff00024-7bfe-40c4-9e6c-922ddf003997 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.341815 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.352926 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.361152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.362985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.363453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.364260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.366244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.367214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.369514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.375590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e792-4ae0-4ad0-83a4-e94f5b586bd8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.386545 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 267/533] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.387683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.419793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.420552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.420902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.421249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.428670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.430816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:12.443911 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:12.444797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:12.445885 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 267/534] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:12.447069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.522812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22946ef-aec0-4a69-947c-821c39f86df4 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.559960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.560758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.561085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.561504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.562301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.562703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.564243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.570459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6efa41-a946-4d5a-a6ee-5315f56664ba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.578044 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 268/535] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.579069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.598495 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.616729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.618700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.619146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.619566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.628356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.630253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.634163 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:12.649325 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:12.650347 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:12.651206 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:12.653244 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 268/536] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:12.654210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.696804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb09e0-c45d-4ebc-a917-586ffdeff39f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.735054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.735793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.736139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.736476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.737292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.737686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.739189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.751849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 269/537] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.752772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.781611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095d45-10d4-4252-9984-c02169d44a7f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.828113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.829154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.829770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.830214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.831109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.831597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.833241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.837661 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.842175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 269/538] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.844347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.864164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dda4d-8626-4c4d-94db-15c7931d2240 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:12.908210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:12.908825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:12.909103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:12.909373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:12.910282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:12.910590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:12.913051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:12.926583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 270/539] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:12.931097 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:12.933310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:12.999142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b2e8-ddd9-4b42-8997-9c18b3468b88 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:13.046305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:13.047551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:13.048033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:13.048502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:13.048821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e933eb-a03d-47bc-8cd3-07ce080b3125 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:13.049723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=fe9dafd81a8947f79616064549817153) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:13.050336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:13.052111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eda5a0-e5cd-49a1-8546-a1a9fb68e960 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:13.059633 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 270/540] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/role_assignments?user.id=fe9dafd81a8947f79616064549817153&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:13.093417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:13.094077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:13.094362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:13.094634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:13.095406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=910f4364ae7543ab928a58d9a13e2d2a) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:13.095716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:13.097397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82ab13-ef66-4e3a-9018-00276bcf98dd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:13.101086 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:13.109559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 271/541] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:12 2022] GET /identity/v3/role_assignments?user.id=910f4364ae7543ab928a58d9a13e2d2a&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:13.594831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194bfd-656d-4946-898c-aebc2368de50 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:13.595845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194bfd-656d-4946-898c-aebc2368de50 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:13.596349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194bfd-656d-4946-898c-aebc2368de50 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:13.598007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 271/542] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:13.604671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:13.605180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:13.605284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:13.634578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:13.635807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:13.733221 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 272/543] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:14.237494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194bfd-656d-4946-898c-aebc2368de50 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:14.378088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194bfd-656d-4946-898c-aebc2368de50 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:14.424040 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:14.434415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:14.435080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.435364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.435638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.462382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:14.467314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:14.468181 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:14.468952 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 272/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:14.474634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:14.609936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3acc-b458-4a1a-a3b2-2b56ac2a8d59 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:14.655296 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:14.661887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:14.662836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.663117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.663388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.664055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] RBAC: Adding query filter params (name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:14.664353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:14.665757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843922-0b85-4141-b4ed-2b23e0cb423e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:14.676789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 273/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:14.683104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:14.814624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651e3-ef32-49c9-b7a9-cbcd4ccf0445 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:14.859376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb58f5-05ee-446b-a161-860c48a490af None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.859376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb58f5-05ee-446b-a161-860c48a490af None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.859376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb58f5-05ee-446b-a161-860c48a490af None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.860184 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 274/546] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:14.865836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.866351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.866826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.895565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:14.897174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:14.900527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:14.901171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:14.902263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:14.902263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:14.915625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:14.916240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:14.940247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:14.941201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:14.942069 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:14.942069 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:14.942069 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:14.950941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 273/547] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:14.954372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.049285 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.057699 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 275/548] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:15.151720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2493d7b-cc1a-49e4-8112-657a00815595 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.206117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.206743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.207027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.207305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.207961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:15.208268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.209792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.224673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 274/549] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:15.230404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.347462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.385536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7456-c803-4a8b-abde-cf03392cda0c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.416684 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.432982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.433816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.434342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.434835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.442892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.445168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:15.457781 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:15.458920 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:15.459863 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:15.467017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 276/550] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:15.468623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.586910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e975-2993-4547-af9a-daf5b27cac25 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.605853 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.609637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10451e5c-8223-462d-97bf-6855555b2e0c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.659087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.660414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.661069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.662667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.663708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:15.664471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.667695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.689725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.691220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.692084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.694010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.717789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 277/551] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:15.723280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:15.725033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:15.736318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:15.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:15.739367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 275/552] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:15.744275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:15.783428 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:15.857588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9e2eb-38a3-4396-a841-f60801d8fa28 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.905121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19296-4552-4161-aa22-c4ebf91919f5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:15.908997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.909650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.909933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.910202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.962054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:15.963036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.963549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.964039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.965193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:15.965702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:15.969355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82210-28f6-4cd7-8692-8b5513755bc2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 276/553] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92e990-e6c2-4daa-b21f-7f154e1d98fd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92e990-e6c2-4daa-b21f-7f154e1d98fd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92e990-e6c2-4daa-b21f-7f154e1d98fd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 277/554] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166cc0-52a8-47ee-b560-eb2af69ce134 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:15.989445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166cc0-52a8-47ee-b560-eb2af69ce134 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:15.990257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166cc0-52a8-47ee-b560-eb2af69ce134 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:15.992245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 278/555] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:15.993301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166cc0-52a8-47ee-b560-eb2af69ce134 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.009252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.010841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a78ee-8b54-4c8c-8e93-c70c6090f42a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.027322 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.061010 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.127822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166cc0-52a8-47ee-b560-eb2af69ce134 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.134302 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 278/556] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 00:45:16.135635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738afc3-2a52-4b57-b0b2-c383c3763af5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.135917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738afc3-2a52-4b57-b0b2-c383c3763af5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.136188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738afc3-2a52-4b57-b0b2-c383c3763af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.157176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e738afc3-2a52-4b57-b0b2-c383c3763af5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:16.159293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e738afc3-2a52-4b57-b0b2-c383c3763af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:16.177329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.178034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.178320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.178595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.190110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.191613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a5c73a62-99a8-4d33-b522-01257addd833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:16.210380 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:16.212700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 279/557] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.214450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.232447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:16.233711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:16.249675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 279/558] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:16.250954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd880a74-3444-45c0-9d2a-f27989335be9 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.251244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd880a74-3444-45c0-9d2a-f27989335be9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.251502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd880a74-3444-45c0-9d2a-f27989335be9 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.253652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 280/559] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:16.254463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd880a74-3444-45c0-9d2a-f27989335be9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.333434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 280/560] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:16.333434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.336926 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.377243 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.446544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd880a74-3444-45c0-9d2a-f27989335be9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.492165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06c69-9250-4a7a-b728-1e23f9a87d86 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.506183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.508271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.508975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.509510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.538227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.541989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.562960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.563585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.563862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.564133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.564794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:16.565092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.566523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a033ed06-38c7-4048-9756-fe1896fefbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:16.567591 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:16.569642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:16.570657 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:16.570657 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:16.570657 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:16.579739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 281/561] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:16.579739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.579739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.579739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.589926 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 281/562] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:16.595379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.596747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:16.598013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:16.689959 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.701096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 282/563] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:16.704523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.762563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c817-02a1-45c0-a989-eb138e2a1f85 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.784603 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:16.821821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.822377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.822659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.822936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.837462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:16.844398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:16.847401 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 282/564] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:16.848291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.866134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23e0b-9a51-49cd-b9a1-8e78948fb10f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:16.915881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:16.916612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:16.916889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:16.917160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:16.917843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:16.918144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:16.919608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:16.935976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 283/565] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:16.942961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:16.986886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccffe-559a-41a8-b534-8a106eca22b9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.016087 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.027994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.028632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.028914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.029185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.037935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.039409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:17.053645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:17.054697 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 283/566] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:17.055644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.074556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5573fe-49db-4c29-aa4b-b27652ca8ebd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.089630 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.113667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.114301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.115413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.115727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.127834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:17.138869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:17.140055 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:17.141986 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 284/567] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:17.143272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.174617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1baf-9fad-49ad-a10e-2ade75ac6c24 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.213191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.213843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.214119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.214390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.215057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.215358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.216733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.226323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 284/568] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.227206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.281999 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.288359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27751829-76c0-4d3d-b1ba-f7f413abf9b7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.326730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.327453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.327806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.328169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.335922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.337397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.344311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404a4f-c8c7-4c31-8b3e-1e9a81f85d1b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:17.350333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:17.352157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 285/569] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:17.353703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.391371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.392844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.393284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.393757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.397018 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.409259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:17.416314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:17.418209 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 285/570] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:17.419776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.485740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7623d-f5ca-4179-8a4e-bfc001696ec3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.526925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.527539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.527813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.528086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.528824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.529126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.530607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.550715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 286/571] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.551114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24d88a-f022-4e86-a6c7-b5c7d37ff7a0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.551450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.561908 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.596764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.597538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.597968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.598331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.599236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.599629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.601140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.611273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 286/572] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.612691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.673832 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.687861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b581-3fc4-4378-bd15-a524c4c7e9b7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.729396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.730828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.731221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.731631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.745654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.747648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.752352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee8ed-2659-4eb7-a6f1-0a00ff51f7e5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:17.766545 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:17.768605 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:17.769931 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:17.769931 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:17.769931 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:17.769931 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 287/573] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:17.770277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.800956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.801723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.802090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.802895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.803666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.804048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.806376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.826821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 287/574] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.828252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.869015 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:17.907298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5ea4-58cd-4383-85be-6cb245ff94b0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.956568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:17.957549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:17.958006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:17.958538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:17.959671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:17.960161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:17.962335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:17.976728 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 288/575] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:17.978351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:17.980238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3324-d72d-4020-af9f-dbc4e059ea94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:17.985106 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.032407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.033239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.033643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.034016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.046565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.048071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:18.064384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:18.066478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:18.068953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:18.068953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.068953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:18.068953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 288/576] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:18.070795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.124165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c5cf-0061-46a4-9519-83e27a63a2d8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.165191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.165527 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.166294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.166486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.166871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.181794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.183548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.190730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18ad3a-5dff-4bf5-8671-299335259cce None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:18.207106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:18.209961 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:18.211864 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:18.211864 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.211864 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:18.211864 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 289/577] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:18.211864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.243797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.244574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.245021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.245394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.246376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:18.246778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.248431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.264957 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 289/578] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:18.266053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.287669 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.337528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75299ee4-bf57-4352-9b69-3750b639d7c8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.378214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.378979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.379382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.379838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.381199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=46f1c1451849424fa2b09e7ea786a539) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:18.381723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.384524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.394121 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 290/579] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/role_assignments?user.id=46f1c1451849424fa2b09e7ea786a539&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:18.395602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.432096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a029d-1220-41f3-abbf-a91acb49d803 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.478480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.479233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.479579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.479914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.492898 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.498177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.499810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:18.523381 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:18.524398 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:18.525290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:18.525290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:18.525290 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:18.529837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 290/580] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:18.531133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.583100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984269d1-7269-4062-9bb8-c6664efa510b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.608505 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.632387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.633784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.634295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.634794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.636026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:18.636884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.639370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.657477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 291/581] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:18.658711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.692605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322378a0-80b7-4fe5-b41b-9564bc8c8476 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.733491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.734086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.734373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.734646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.735293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:18.735594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.737034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.760958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 291/582] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:18.760958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.800449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fb17-772b-47c2-a6a1-24669a7ebbdc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:18.847312 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.859983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:18.860918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:18.860918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:18.861232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:18.869392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:18.870905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:18.885392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:18.887359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:18.890343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:18.893799 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 292/583] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:18.893799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:18.941705 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:18.941977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acb06-a528-4473-9895-5eec63f28573 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.006959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.007997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.008747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.009245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.010482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.011033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.013499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.016997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deddaf-a048-426a-b9cb-fc46c24ac09b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.036261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 292/584] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.041528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.069150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.070170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.070537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.070985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.082023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.085065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:19.104699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:19.105856 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:19.106951 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:19.113888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 293/585] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:19.116013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.223157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536e5a-b6ca-4197-9426-676fa02c289f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.240790 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.266950 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.269498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.270376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.271327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.271884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.272462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30696-5ef8-4571-bb09-646a50133ea2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.283262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.285183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:19.299953 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:19.302592 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:19.305300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:19.311233 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 293/586] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:19.311233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.321245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.322077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.322533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.322968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.323817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.324226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.325964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.354406 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 294/587] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.354406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.462710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f207-0fde-4d8a-9c57-2357f2faea96 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.480803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0257d-58c7-4c4d-8fcd-c7efb6753e5a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.507033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.507678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.507955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.508221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.516770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.518356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:19.531318 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:19.532313 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:19.533351 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 294/588] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:19.534528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.542748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.543802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.544309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.544763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.545996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.546535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.549297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.568899 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 295/589] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.570136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.578804 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.605588 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.685150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aeac4-f90d-43cc-9f36-56c482d31e79 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.710412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae7da-16c4-48f8-aeef-353acb6b9a94 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.738634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.740335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.740800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.741238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.742533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.743037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.745266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.763502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.764263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.764648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.765017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.778949 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 295/590] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:19.778949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.786058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.788435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:19.807013 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:19.808629 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:19.809567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:19.809567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:19.809567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:19.809567 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 296/591] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:19.809567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:19.901736 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.921034 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:19.937486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1bede-76dc-45d9-9324-348c02d30ae0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.942458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28645-6785-44ea-81cd-02b9609c567c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:19.982768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:19.983431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:19.983714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:19.983987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:19.984901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:19.985235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:19.986944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.009709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.015755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 296/592] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.015979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.015979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.015979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/8565cc85e8a149ac8761b7f687ff7552/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.016241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.042291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=8565cc85e8a149ac8761b7f687ff7552, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.045013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.064855 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 297/593] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:19 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/8565cc85e8a149ac8761b7f687ff7552/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:20.066787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.163924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961183c2-ec96-4561-bbf7-2409f48d0475 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.236064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.236953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.237510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.237997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.240428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c6a80-5131-4557-89c3-07ee83fa3084 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.260519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.263486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.271676 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.282416 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:20.298285 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.299384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:20.300311 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:20.300311 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.300311 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:20.301174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.302298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.302956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.303500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.304395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:20.305595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.305807 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 297/594] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.307353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.307819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.322342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 298/595] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.323576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.469035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78d74-51f4-4b61-ab53-cfdc9465f0d4 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.487979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de31-a336-4275-9a2a-ebce68fa8a88 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.541359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.543350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.544203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.545370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.547625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:20.548853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.554041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.561692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.562829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.563384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.563929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.583805 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 299/596] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:20.585549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.586483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.589256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:20.628079 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.629708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:20.631494 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:20.631494 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:20.631494 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:20.632764 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 298/597] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.633741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.667125 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.755031 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:20.764019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcc9de-f5b9-4526-9ce6-3fac3b947147 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.827065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f135-0fc4-49d2-b8df-df39e99d7d33 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:20.829958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.831936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.832711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.834020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.846662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.850319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:20.871229 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.872845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:20.874486 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:20.875264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:20.875264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:20.876216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:20.876216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:20.878999 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 300/598] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.881382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:20.885592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:20.887137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:20.901118 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:20.902943 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:20.904626 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:20.908809 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 299/599] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:20.909964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.023638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b7ab4-e72c-45b8-893c-d24222854e42 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.040400 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.067273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.068611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.068986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.069610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.070455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:21.070934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.072707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.078015 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.085943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725db-9535-4ff2-a9af-8eaa6cd7a8fb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.089967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 300/600] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:21.091032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.157256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.158702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.159419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.160137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.162151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:21.162953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.165906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.191929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 301/601] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:21.195039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.223152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53f13-2cc3-4d4f-8f8b-e836305d61cf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.270029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.271578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.271930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.272354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.273180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:21.273607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.275447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.296406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 301/602] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:21.297548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.336901 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.349254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71b8b-b2fc-4ce1-86d1-0ef8d8a23390 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.398190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.399195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.399659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.400120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/910f4364ae7543ab928a58d9a13e2d2a/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.420925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=910f4364ae7543ab928a58d9a13e2d2a, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.422955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.439664 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 302/603] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:21 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/910f4364ae7543ab928a58d9a13e2d2a/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:21.440816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.441325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09acf87-66aa-4cb1-8c0b-843db3c67a4d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.460579 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.494112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.495148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.495445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.495885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.504594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.506701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4cdbc277-8b50-4d4a-854f-0985b12cdd23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:21.524627 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:21.525819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:21.526840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:21.527604 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 302/604] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:21.529579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a81cd-40c2-4d9f-b9ab-d964bea4c584 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.531092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a81cd-40c2-4d9f-b9ab-d964bea4c584 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.531092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a81cd-40c2-4d9f-b9ab-d964bea4c584 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.536960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 303/605] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:21.538105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a81cd-40c2-4d9f-b9ab-d964bea4c584 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.635437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d2cd-0731-4dab-9148-6a9db6109cac None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.688495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.689843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.690301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.690770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/fe9dafd81a8947f79616064549817153/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.715592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=fe9dafd81a8947f79616064549817153, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.717827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12859d8a-eea2-43b9-a0e5-a4b9fae6eb9d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.718380 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.735495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a81cd-40c2-4d9f-b9ab-d964bea4c584 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:21.742513 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 303/606] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:21 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/fe9dafd81a8947f79616064549817153/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:21.743887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.744225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.744508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.787310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:21.788884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:21.802851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:21.803485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:21.803765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:21.804121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:21.804980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:21.805320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:21.806992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:21.829430 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 304/607] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:21.834531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:21.905860 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:21.934932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 304/608] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:22.040681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2be80-c101-4937-abf3-827ef22d4c22 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:22.108078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:22.109323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:22.109802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:22.110242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:22.136470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=664154bf7b8d4ec9b0be57b37687ecb3, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:22.138386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:22.156141 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 305/609] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:21 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:22.312503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:22.524917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11bce1-65cc-4920-9a49-fd2a4bfc36a2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:22.593046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:22.594088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:22.594596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:22.595089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:22.615729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:22.625326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:22.626355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:22.627181 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:22.628505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 305/610] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:22.634331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:22.642117 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:22.767953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b13c7-9e65-42a6-9d4a-ed37b83122f5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:22.807610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:22.808290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:22.808571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:22.808839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:22.809556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:22.809862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:22.811403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:22.823755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 306/611] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:22.829524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:22.943988 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:23.042202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fa921-5fe4-4a94-baa2-db9f61574f99 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:23.106654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:23.107310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.107590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.107860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.123746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:23.125276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:23.148728 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:23.149895 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:23.150793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:23.150793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:23.150793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:23.151412 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 306/612] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:23.161080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:23.261884 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:23.309214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd131c1-0e50-47f3-92a5-e5a4efcc9cb1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:23.349571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:23.350592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.350907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.351221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.351921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:23.352226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:23.353718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92652-8b7a-4e1c-a467-94d2332fbbaa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:23.368088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 307/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:23.378685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:23.455327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e7fbf-e3c8-431a-a70d-a8495ac59d9e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.455825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e7fbf-e3c8-431a-a70d-a8495ac59d9e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.456206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e7fbf-e3c8-431a-a70d-a8495ac59d9e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.459537 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 308/614] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:23.464479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.464756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.465034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.510533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:23.511769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:23.613387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9360d-5931-494c-8d37-f3ec14b3a458 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:23.618823 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:23.671091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:23.672256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.672397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 309/615] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:23.672872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.673142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.694822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:23.696310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:23.718541 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:23.719715 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:23.720823 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 307/616] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:23.727226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:23.829112 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:23.920376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d770-3e93-4ecd-86ec-dc179ce3972c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:23.969632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:23.970257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:23.970533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:23.970800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:23.971550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:23.971847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:23.973292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:23.998521 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 310/617] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:23.999897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.133783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562bc74-77f0-4e53-a107-079f7636ab2a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.219173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.220156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.220657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.221159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.243037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.245810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:24.276281 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.277285 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:24.278219 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:24.278219 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:24.278219 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:24.278927 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 308/618] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:24.285021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.431389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.459811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30733c-afa6-4570-9c94-cd0ee303d872 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.487917 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.491478 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.501155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.501817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.502116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.502372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.503011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:24.503405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.504702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.518240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 311/619] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:24.525951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.649265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dad45-4294-4d9e-9c34-a3d76c570a04 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.664972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8143c-455f-4186-9b0a-65dd58c6cf55 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.694533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.695184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.695462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.695734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.704153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.705681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:24.705858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.706704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.707095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.707366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ddd9c5c8-1d7c-4f5f-8ace-6f35ae85d0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:24.720124 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.721958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:24.725432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:24.727094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:24.727342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:24.733873 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:24.737218 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:24.740524 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:24.747738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16553-043d-4c15-b38c-1498995d35e5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.747738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16553-043d-4c15-b38c-1498995d35e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.748194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:24.748426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16553-043d-4c15-b38c-1498995d35e5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.748426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 313/622] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:24.748882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.757591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16553-043d-4c15-b38c-1498995d35e5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:24.823147 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.901343 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:24.934915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16553-043d-4c15-b38c-1498995d35e5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.939787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fffb0a-da12-4150-9196-20c44424c00b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:24.992431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:24.994091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:24.994956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:24.995674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:24.997266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:24.998219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:24.999384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.000085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.000839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.000839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.001574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:25.001947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.003550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.003774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14ffaa-3fbe-43b3-ae2f-fad06d7bf0a8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.023788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:25.025301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.025647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.025888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.033970 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 314/624] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:25.035536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.047516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:25.048841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:25.134022 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 311/625] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:25.134979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.175560 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.186037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6ea9-d86f-4657-8527-3a811806977c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.232276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.233497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.234055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.234546 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.235041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/46f1c1451849424fa2b09e7ea786a539/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.255802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=46f1c1451849424fa2b09e7ea786a539, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.257651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5928d-61e9-4b6a-9904-c680a8fa60f0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.277135 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 315/626] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:25 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/46f1c1451849424fa2b09e7ea786a539/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:25.279094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c167cc-a356-44d1-8dd9-4c0b3a89966c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.279601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c167cc-a356-44d1-8dd9-4c0b3a89966c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.280276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c167cc-a356-44d1-8dd9-4c0b3a89966c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.282422 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 316/627] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:25.288552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19fa97-4c05-47eb-8073-fa0051732434 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.289470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19fa97-4c05-47eb-8073-fa0051732434 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.290513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19fa97-4c05-47eb-8073-fa0051732434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.316626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412030a-f3bf-4302-a92d-e92e07bef954 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.319838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d19fa97-4c05-47eb-8073-fa0051732434 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:25.321200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d19fa97-4c05-47eb-8073-fa0051732434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:25.410669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.412717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.413516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.414240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.439896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.445453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:25.485468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:25.487054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:25.488016 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:25.488016 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:25.488016 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:25.492197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:25.494138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.505646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 317/629] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:25.507395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9751-20f5-4522-9131-b5d3ca3dd62a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.507605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9751-20f5-4522-9131-b5d3ca3dd62a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.507874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9751-20f5-4522-9131-b5d3ca3dd62a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.514963 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 318/630] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:25.516031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e9751-20f5-4522-9131-b5d3ca3dd62a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.650574 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.693162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e9751-20f5-4522-9131-b5d3ca3dd62a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.726663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126fa14-96fd-4392-b183-5be93488ed82 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:25.751460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.752231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.752643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.753077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.754688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:25.755697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:25.757327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965a64d-27cf-445a-96c6-5e0e59bc29ad None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:25.766499 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:25.779048 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 319/631] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:25.782225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.782823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.783255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.811050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:25.812007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:25.812819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:25.813183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:25.813677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:25.814125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:25.829543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:25.837051 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:25.838269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:25.839270 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:25.842012 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 313/632] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:25.843360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:25.935350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 320/633] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:25.936873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.012080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aabd-2f39-4eeb-a612-f45bcee1d2f7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.053704 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.080288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.081006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.081317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.081626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] PATH_INFO: `/v3/users/glance` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.092862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:26.094399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:26.108308 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:26.109488 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 314/634] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:26.110911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.137521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df4399-3704-414c-8cf3-ce7c54e3b857 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.167881 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.206750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.207960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.209489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.209925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.210797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:26.211250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:26.212820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:26.225583 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 321/635] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:26.226775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.249791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf48-74b8-41b9-ae3e-55fa2e6ecced None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.294018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.295260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.295260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.295540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.310661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:26.316744 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:26.318843 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:26.320566 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:26.324116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 315/636] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:26.325128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.402107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947e28-39da-4516-aeb4-066b3c694ecc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.441383 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.455076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.455949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.456296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.456578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.457973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:26.458477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:26.460284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:26.475838 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.484075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16af914-e6eb-4177-a8a7-83dabfe0c37a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.488954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 322/637] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:26.490246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.542803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.543453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.543730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.544091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.558647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:26.560266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:26.577504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:26.579070 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:26.581018 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:26.581018 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:26.581018 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:26.581018 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 316/638] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:26.581018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.678944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34062ab-3c98-4bce-a8a1-cf5b6dd1429a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.731712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4604-f296-4daa-a4be-f376c9ae6da5 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:26.739235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.740978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.741522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.742023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.743279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:26.743826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:26.746830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:26.764811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 323/639] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:26.766400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.801427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:26.803392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:26.803885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:26.804374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:26.827659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:26.839719 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:26.840828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:26.841707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:26.847501 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 317/640] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:26.847501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:26.856651 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.870883 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:26.950924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec877-0b67-43b4-bfc9-ae3e5760adaf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.015572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.016680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.017149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.017684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.065008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dd8b-a83f-4d94-9f44-9d152fc15a3f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.121292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.124057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.129843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.131463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.131744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.132011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.132683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:27.132982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.134777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.149369 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 318/641] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:27.150249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.223953 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.285209 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.313818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 324/642] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:27.315333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.331399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd41a-0b13-4ef8-a252-eaf155685e70 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.375714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.376441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.376848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.377158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.392283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.393624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:27.415198 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:27.416717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:27.418075 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:27.418075 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:27.418075 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:27.418075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 319/643] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:27.418075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.499199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2b09-ddee-4a19-a7c1-df91dd9b80a7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.555971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.556667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.556989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.557384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.558525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:27.558525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.559799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.563077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bbcc4-4a71-4610-ba78-4520976cf97a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.572262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 325/644] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:27.573631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.591823 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.598028 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.626963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.627550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.627865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.628159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.638747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.640273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:27.653615 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:27.655529 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 320/645] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:27.658370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.739159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc931e-f669-45f4-914c-56c69b64aee2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.784736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.785560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.785874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.786913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.795324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb272c2-c390-4ee3-bbac-1a6fb24dde36 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.799869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.801690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:27.823530 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:27.824965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:27.826152 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:27.826152 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:27.826152 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:27.829573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 326/646] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:27.831328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.840562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:27.841186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:27.841495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:27.841765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:27.842419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:27.842724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:27.844106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:27.858980 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 321/647] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:27.859837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:27.915226 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.915801 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:27.967538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b33f1-0b64-4bf8-97e7-6f07c533d943 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:27.986221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf33d5-2dd0-4baa-b1dc-efe50a0cca94 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.012948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.013626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.013899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.014169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.026666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.028152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.029288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.030334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.030693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.031307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.032136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.032501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.034399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:28.044061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:28.046098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:28.048102 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:28.048102 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:28.048102 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:28.048102 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 327/648] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:28.048102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.062101 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 322/649] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 25 00:45:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:28.063254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.164639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9def8b-3a05-44d6-a26e-38cfd0083ee3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.188258 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.193967 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.198346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe2a4-e194-4e9b-8565-f5eca8fa95cd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.206662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.207341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.207660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.207938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.209152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.209485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.210893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d7ce9-139b-4e61-988d-7a7110a3a079 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.224991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 328/650] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:28.226443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f048b-8f88-4c9f-b00c-f2528f5937e4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.226735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f048b-8f88-4c9f-b00c-f2528f5937e4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.227043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f048b-8f88-4c9f-b00c-f2528f5937e4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.228443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 329/651] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:28.229076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f048b-8f88-4c9f-b00c-f2528f5937e4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.241304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.241977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.242267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.242513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.251943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.253533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:28.271179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:28.278737 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 323/652] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:28.280688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.355348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f048b-8f88-4c9f-b00c-f2528f5937e4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.394895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fba03-8531-499a-95ad-592fce18173b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.407203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.408182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.408748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.409205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.410030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.410362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.415199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.430852 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 330/653] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:28.431700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.437223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.437916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.438201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.438524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.472524 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.473363 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.527406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.529063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.556529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c2c3-461e-4c78-a492-d6dbcfa20314 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.606048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.606719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.606996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.607269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.616538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.618078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9485e5b2-00bb-4593-9391-b5f5a3a8b60f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:28.631412 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:28.632484 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:28.633796 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:28.634380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.634380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.634578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.654239 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 324/655] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:28.655619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.658918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:28.660917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:28.725344 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.749067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 332/656] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:28.749968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.777527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7365-abd3-4ffa-bd1e-776e0caffe41 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:28.797373 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:28.821440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:28.822468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:28.822971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:28.823519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:28.824466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:28.824957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:28.826743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:28.858535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 325/657] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:28.858535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:28.940647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59545530-7d1d-450f-88b5-5fd58135eb72 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.004645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.005417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.005735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.005842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4a9b-94a4-4dcb-8db1-7232d0435cc3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.006344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.016914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.018582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:29.035703 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:29.036810 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 333/658] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:29.037919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.041451 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.068739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.070303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.070906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.071268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.072589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:29.073188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.075773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.097364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:29.098378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.169481 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.199022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55992-37e0-4718-9efc-18260938ce63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.219231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf597-21c5-42cc-bb2a-e6f1f610ac04 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.255486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.255936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.256093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.256471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.264833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.265512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.265838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.266116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.269171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.270757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:29.287253 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:29.289334 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:29.291719 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:29.291719 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:29.291719 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:29.292693 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 334/660] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:29.294101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.326117 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.352019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.353833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.436231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62eba-0148-4663-a99d-64b5efe487da None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.479871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 327/661] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:29.480871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.487055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.487671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.487951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.488221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.492615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:29.492987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.494802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.498297 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.534517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 335/662] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:29.534517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.570202 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.605487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9072a2-15af-460e-9eb4-b065c0bb8a13 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.647266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.647906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.648187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.648459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.659411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:29.664871 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:29.666919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 328/663] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:29.668549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.685631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b001cd-e43f-427f-9c31-42b2627368bc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.724694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.725378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.725682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.725947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.726681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=8565cc85e8a149ac8761b7f687ff7552) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:29.726983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.728443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.737268 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 336/664] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/role_assignments?user.id=8565cc85e8a149ac8761b7f687ff7552&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:29.738430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.820315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3c3e-21e5-42a1-8d48-39da728b04d0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.834132 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.882170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.883037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.883212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.883786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.884731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:29.885196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.887429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.893396 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:29.896446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e943f5-1ac0-403f-8e8b-52a62b9246f7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:29.912238 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 329/665] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:29.913689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:29.947581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:29.948252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:29.948546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:29.948820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:29.962407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:29.963988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:29.985210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:29.986805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:29.988384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:29.988384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:29.988384 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:29.988384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 337/666] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:29.988384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.084836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1ae6-9c5c-4d44-bffa-6bd2aa704c46 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.135153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.135829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.136163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.136443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.157311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974abd5-a915-45f4-be4b-fa741bc856cb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.174046 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.217035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.218361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.218872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.219431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.220091 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.220723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:30.221286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.224173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.230735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.233575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.236821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 338/667] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:30.237793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.397454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 330/668] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:30.398494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.398602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb209c-738e-44ae-b367-c7bf35c944b4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.439171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.439844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.440137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.440421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.448589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.450213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:30.463113 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:30.464207 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:30.465222 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:30.469456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 339/669] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:30.470400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.516664 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.524839 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.533781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbfe1-d96b-443c-af0f-6b7ccb2b9922 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.591860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.592498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.592842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.593013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.593801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:30.594123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.595582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.615428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 331/670] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:30.616768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.625492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0b92-7b26-4d46-aa2a-14fbd9c89ea4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.684029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.684918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.685432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.685889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.706622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.709315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:30.737639 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:30.738672 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:30.739678 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:30.739678 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:30.739678 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:30.739678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 340/671] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:30.741144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.774841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934aae3-e046-436d-8291-0bc3c37ecaaf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.819904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.820916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.821484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.821998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.834917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.836752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:30.855937 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:30.856954 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:30.858586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:30.858586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:30.858586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:30.858586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 332/672] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:30.858824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:30.875874 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.899938 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:30.928664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1302ae-ab91-4bf2-a8a6-299cbb019b6f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:30.971531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:30.972504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:30.973438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:30.974160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:30.975586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:30.976161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:30.977837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:30.994818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 341/673] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:30.996013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.003453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929396-f26d-4a10-af19-0b9330180105 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.051497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.052672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.052968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.053218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.064504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.065968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:31.080001 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:31.081084 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 333/674] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:31.084679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.172573 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.188113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e03a-f13c-4fda-b8d9-eab2274978a5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.217759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab6d9-01d1-4952-8690-35b8502f9c79 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.256925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.257903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.258381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.259117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.260974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:31.261869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.264395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.265342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.265983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.266262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.266532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.267480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:31.267796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.269709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.283679 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 334/675] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:31.284533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.292142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 342/676] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:31.293054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.298051 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.451001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913548b-2770-43ff-8364-2920f456bc58 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.469557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc56c-70ac-477a-ba2c-40538a9b0356 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.502688 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.524934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.525316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.525737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.526049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.526169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.526409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.526510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.526695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.527559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=910f4364ae7543ab928a58d9a13e2d2a) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:31.527696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:31.527956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.528052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.529668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.530586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.549972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 335/677] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/role_assignments?user.id=910f4364ae7543ab928a58d9a13e2d2a&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:31.549972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.553624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 343/678] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:31.554615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.635567 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.683457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaacb65-736c-4ff2-81ae-40b53131b5ec None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.706864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf34a2-1522-4c45-8cc5-daba43a8a0d3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.731600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.732271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.732523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.732793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.742943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.744742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:31.760631 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:31.762148 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:31.763372 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:31.766839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 344/679] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:31.767722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.772871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:31.774072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:31.774555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:31.775255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:31.786502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:31.789708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:31.808537 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:31.809868 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:31.811056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:31.813500 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 336/680] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:31.814583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:31.907365 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:31.934983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572917a-dea7-4d26-b5ed-5e763c82f82b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.976134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bbe6b-b194-4842-b971-e4a9c8fa39b6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:31.987994 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:32.014842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.015670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.016111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.016575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.017689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:32.018158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.022363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.035284 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 345/681] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:32.036069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:32.039675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.040834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.041448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.042023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.043155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:32.043811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.045737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.080254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 337/682] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:32.088864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:32.233925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f556-0acb-4cd3-ade8-390f3c37251f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:32.289829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.290876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.291422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.291956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.293288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:32.293975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.295936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52ba8-2ebe-4424-94d9-73e910e5fa3f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.314007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 346/683] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:32.316501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b19a8-28c3-45a1-a4d0-79b6b2e5f0c3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.317141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b19a8-28c3-45a1-a4d0-79b6b2e5f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.318203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b19a8-28c3-45a1-a4d0-79b6b2e5f0c3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.322259 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 347/684] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:32.323855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b19a8-28c3-45a1-a4d0-79b6b2e5f0c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:32.336035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847922c-2118-496d-af5b-7b2a95a5d963 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:32.352396 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:32.385494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.386403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.386692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.386973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.392193 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:32.479863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.481673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.482135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b19a8-28c3-45a1-a4d0-79b6b2e5f0c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:32.532112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.533047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.533484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.533761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.534499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=fe9dafd81a8947f79616064549817153) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:32.534803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.536410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788c98-9f37-45ee-86e8-60e23e368a27 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.543863 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 348/685] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:32 2022] GET /identity/v3/role_assignments?user.id=fe9dafd81a8947f79616064549817153&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:32.545067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66100d4-f219-44be-8658-49c36377b896 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.545349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66100d4-f219-44be-8658-49c36377b896 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.553905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66100d4-f219-44be-8658-49c36377b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.597828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c66100d4-f219-44be-8658-49c36377b896 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:32.599282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c66100d4-f219-44be-8658-49c36377b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:32.649036 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 338/686] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:32.657931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:32.681639 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:32.822787 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 349/687] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:32.837753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2109e-72d9-45b1-b6b6-a572eecde045 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:32.895575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:32.896314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:32.896596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:32.896866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:32.909134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:32.910702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:32.936851 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:32.939316 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:32.941307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:32.941307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:32.941307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:32.941307 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:32.945759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66100d4-f219-44be-8658-49c36377b896 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:32.998334 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:33.066463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66100d4-f219-44be-8658-49c36377b896 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:33.108076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683119e-deea-490a-828f-78680a848f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:33.108611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683119e-deea-490a-828f-78680a848f72 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.108890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683119e-deea-490a-828f-78680a848f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.109163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683119e-deea-490a-828f-78680a848f72 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.109858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683119e-deea-490a-828f-78680a848f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:33.110159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683119e-deea-490a-828f-78680a848f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:33.111543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683119e-deea-490a-828f-78680a848f72 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:33.125175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:33.133235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.187214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683119e-deea-490a-828f-78680a848f72 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.253848 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:33.375850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4847-e6d5-4106-86f0-0730168005eb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:33.427430 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:33.436374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683119e-deea-490a-828f-78680a848f72 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:33.472806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:33.473854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.474321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.474819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.493814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:33.496556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:33.529780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647669-3770-4549-8325-f323e31054b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:33.529994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:33.530845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:33.532158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:33.532954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647669-3770-4549-8325-f323e31054b7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.532954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647669-3770-4549-8325-f323e31054b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.532954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647669-3770-4549-8325-f323e31054b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.533163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 340/690] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:33.537653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.545712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81647669-3770-4549-8325-f323e31054b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:33.547198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81647669-3770-4549-8325-f323e31054b7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-81647669-3770-4549-8325-f323e31054b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:33.564051 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:33.566343 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:33.568945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:33.568945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:33.568945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:33.568945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 351/691] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:33.580677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647669-3770-4549-8325-f323e31054b7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.805560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81647669-3770-4549-8325-f323e31054b7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:33.827479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3018-4848-4e48-81c2-c220e51bda25 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:33.855370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:33.856117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.856466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.856776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.861426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:33.861426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:33.861426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:33.880543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 352/692] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:33.887846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:33.909827 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:33.910080 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:33.940750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:33.941378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:33.941731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:33.942013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:33.943271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:33.943685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:33.945256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:33.992263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 341/693] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:34.014512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.035426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16458e-a63b-49db-82f3-f974bdf86fe6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.101622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.102505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.102989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.103438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.104320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.106387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c34b22-abc2-4487-a09c-cbce7d7e708c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.136753 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 353/694] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:45:33 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:45:34.205707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b285fc-5cc2-4f40-862f-d8a00907eaf6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.213937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe818f-2f68-4212-a4ac-00fdf3526c41 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.214228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe818f-2f68-4212-a4ac-00fdf3526c41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.214508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe818f-2f68-4212-a4ac-00fdf3526c41 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.220297 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 354/695] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:34.222325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.222738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.223079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.259714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.260724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.262267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.262729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.263990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=46f1c1451849424fa2b09e7ea786a539) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:34.266830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.268649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.283764 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 342/696] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/role_assignments?user.id=46f1c1451849424fa2b09e7ea786a539&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:34.285199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:34.286860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:34.369775 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:34.381390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 355/697] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:34.693928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.762422 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:34.828929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4f88-c7a1-46a7-9fba-cef7f124fa62 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:34.869816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:34.870474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.870760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.871032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.871633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:34.873031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-5c0f03a0-d7f1-415e-a13d-49e3444611d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:34.886059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:34.887402 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:34.888257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 343/698] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:34.893385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:34.910445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153ad0-8228-4557-9a02-e5d311423de9 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.910774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153ad0-8228-4557-9a02-e5d311423de9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.910997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153ad0-8228-4557-9a02-e5d311423de9 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.914442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 344/699] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:34.919515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:34.919799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:34.920076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:34.951574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:34.953393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:35.127814 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 345/700] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:35.140221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ae33-d558-48b2-9702-2f46d847e1e1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:35.197447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:35.198506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:35.198988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:35.199470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:35.200606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] RBAC: Adding query filter params (name=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:35.201136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:35.203790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:35.212020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:35.218865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:35.279295 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:35.363849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ce9e-ce60-4b6c-8170-cbf34e8a0b1a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:35.420457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:35.421179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:35.421487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:35.421768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:35.422447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:35.422748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:35.424210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6ab7-8b8b-43a0-8a61-5658ff400bf1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:35.433832 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:35.605777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:35.696739 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:35.700695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5bf4-4e9a-4b45-ad63-8de84f782eb0 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:35.701243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5bf4-4e9a-4b45-ad63-8de84f782eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:35.701243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5bf4-4e9a-4b45-ad63-8de84f782eb0 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:35.703015 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 347/703] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:35.711056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:35.711532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:35.711866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:35.743329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:35.744564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:35.775735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb9a4-bd0b-4904-89e3-9b1e1770e8bf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:35.829779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:35.830447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:35.830768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:35.831125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:35.844060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:35.852818 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:35.853938 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:35.854886 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:35.855546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 357/704] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:35.862288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:35.874722 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 348/705] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:35.980493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db6b9-4c17-4984-b18e-eba16c9fdeb9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.008342 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:36.022153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.023133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.023639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.024109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.025006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:36.025539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.027138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.037433 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 358/706] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:36.044491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.098293 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:36.213918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff216e-af02-4189-90b3-cc9494268904 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.256155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.273503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.275982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.275982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.275982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.287032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.288671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:36.308187 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:36.309222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:36.310180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:36.310180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:36.310180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:36.310180 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 349/707] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:36.321617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.471133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1354d85-ab2c-466a-8c21-4c2fbce94582 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.511565 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:36.533449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7ec0-7854-4cc6-a55d-c99ae0af12ab None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.565525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.566550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.567270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.568726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.569789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.572113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:36.591314 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:36.592413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:36.593247 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:36.599412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.600637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.601117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.601630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.602489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:36.602986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.603092 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 359/708] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:36.609166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.611760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.625298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 350/709] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:36.633888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.756689 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:36.823299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23863e8c-e892-4ddf-af02-926c4a48ca18 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.853335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aefe0e-ea59-4ba6-9dab-06c668eaa8dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:36.878213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.879221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.880416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.880905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.890605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.892508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.902241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:36.902883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:36.903177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:36.903455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:36.904107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:36.904412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:36.905830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:36.908168 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:36.909154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:36.910196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:36.913426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 351/710] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:36.917538 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 360/711] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:36.918893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.921806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:36.930540 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.125644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298d49-cae5-4908-87fd-df67846cea80 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.144578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99fe3-3740-4f30-b172-37f4bf23e798 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.146036 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.173110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.173934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.174302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.174702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.175446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:37.176023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.178220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c826-4585-47c1-a786-6c5327c3b77f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.186231 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 361/712] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:37.192481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718f48-bff6-487c-9d3f-83eb8f13df10 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.192481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718f48-bff6-487c-9d3f-83eb8f13df10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.192481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718f48-bff6-487c-9d3f-83eb8f13df10 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.192481 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 362/713] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:37.198925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.199516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.199919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.200773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.201592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.202042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.202464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.203359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:37.203815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.205742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.246985 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 352/714] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:37.251761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:37.251761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:37.253273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.404817 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.421256 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 363/715] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 00:45:37.478236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42b5a8-a5bd-4b7b-988b-f5c72323bde2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.545807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.546852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.547348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.547827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.680891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:37.683827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ec3d-488c-4142-995c-61aafd9803ce None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:37.766789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.838671 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.927243 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 353/716] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:37.929855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94733-0769-4b59-990c-589a26b69e03 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.930311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94733-0769-4b59-990c-589a26b69e03 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.930750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94733-0769-4b59-990c-589a26b69e03 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.933595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 354/717] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:37.939378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a94733-0769-4b59-990c-589a26b69e03 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:37.944039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929381-46f5-4f19-b407-b4bc28dd5ea6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:37.952012 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:37.985010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:37.985680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:37.985956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:37.986226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:37.999084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8e7cf01c-2621-4134-9239-51b13fad701e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:38.004468 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:38.005594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:38.006426 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:38.007054 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 364/718] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:38.010061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.010061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.010061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.033832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:38.035155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:38.117332 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 365/719] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:38.118445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.129519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a94733-0769-4b59-990c-589a26b69e03 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.195089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.196432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.197157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.197931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.218119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:38.221326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:38.234066 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:38.241723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e33b-4eca-4e7a-b671-01c551309699 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:38.252482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:38.254678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:38.256755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:38.256755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:38.256755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:38.260707 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 355/720] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:38.270163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.309792 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:38.325373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.326178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.326507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.326796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.327513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:38.327845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:38.329670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:38.343274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 366/721] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:38.350002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.486648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55c06-a51d-426b-8f65-bfd4731a9990 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.535184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.535815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.536168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.536990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.537705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:38.538014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:38.539644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:38.554580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2618-e97f-477c-9eac-d594ea055524 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.558928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 356/722] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:38.560379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.600350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.601103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.601336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.601738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.615172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:38.616676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:38.633996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:38.636319 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:38.638540 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:38.638540 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:38.638540 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:38.638540 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 367/723] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:38.638540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.654024 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:38.758246 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:38.789331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8e7f-b73f-4551-a1c3-b99b4920dfe4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.794345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd512-1906-4e9a-a6f1-81b82ac5142c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:38.839086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.840002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.840317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.840598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.847136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:38.848359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.849371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:38.849508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.849712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.850874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:38.863466 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:38.864772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 368/724] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:38.866615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.870656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-798f5f76-e058-4ea2-b419-fea8b8d961d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:38.877286 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:38.878634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:38.879572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 357/725] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:38.881578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8722b1-43aa-4037-87b8-bcd8991e6eb6 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:38.888408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8722b1-43aa-4037-87b8-bcd8991e6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:38.888408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8722b1-43aa-4037-87b8-bcd8991e6eb6 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:38.888408 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 358/726] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:38.888408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8722b1-43aa-4037-87b8-bcd8991e6eb6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:38.962314 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.007260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c2a81-b673-4ba2-a501-7267e45c155e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.027036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8722b1-43aa-4037-87b8-bcd8991e6eb6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.048936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.049819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.050183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.050589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.051423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.051967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.053869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.070698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 369/727] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.071814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.090934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.091889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.092246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.092688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.093748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.094291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.096548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eac7d-8f27-41cf-ad81-4f546feac7dd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.101531 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.117431 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 359/728] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.117431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.117431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.117431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.138986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:39.140172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:39.214517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64146e9-e422-459d-946b-4188e5a6dc5a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.218501 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 360/729] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:39.219364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.264852 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.273014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.273740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.274030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.274306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.275071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.275379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.276771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.289919 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 370/730] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.290800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.368382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a405be-0782-4b50-a242-489dbf42fafa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.423762 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.435483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.436636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.437127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.437722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.446955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.448748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.449612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a782-ab82-4278-820f-4c49fbb71e5d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:39.463307 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:39.464601 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:39.465661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:39.468419 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 361/731] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:39.469698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.521637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.522715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.523202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.523721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.524692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.525379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.527214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.534976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 371/732] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.536543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.625035 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.628365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3cf98-a0f4-4158-a531-6390239689a1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.679354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.680109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.680611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.680893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.696127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.698248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.704202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6c39-b1e9-408c-be06-76f381a009ee None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:39.720182 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:39.721237 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:39.722687 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:39.722687 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:39.722687 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:39.722687 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 362/733] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:39.724807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.747882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.748920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.749207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.749512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.750554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.750871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.752500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.777930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 372/734] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.778794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:39.806544 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.913940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91cc0-f3ce-49aa-8ab5-ab480fe99762 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.919396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc57e-6f87-47e9-9509-054488e8573b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:39.936726 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:39.966418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.967940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.968494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.968943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.969873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:39.970351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.972208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.978226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:39.979029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:39.979524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:39.979951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:39.980650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:39.982576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:39.990517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 373/735] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:39.992314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:40.006017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 363/736] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:45:39 2022] POST /identity/v3/services => generated 240 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:40.007663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:40.235831 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:40.252797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57a38-a0dc-4e84-8c52-7d80366996bd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:40.281393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d61d-d50a-4e51-bb63-554486b1abec None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:40.308448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:40.309209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.310275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.310275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.320209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:40.321660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:40.334803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:40.335605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.335994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.336382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-05e99a83-e872-439c-9c8e-cee71572d41e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:40.337312 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:40.338668 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:40.339673 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 364/737] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:40.340369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c527a-83ca-4a98-89ce-22db5e31957f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.340369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c527a-83ca-4a98-89ce-22db5e31957f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.340490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c527a-83ca-4a98-89ce-22db5e31957f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.342022 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 365/738] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:40.344381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c527a-83ca-4a98-89ce-22db5e31957f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:40.400696 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:40.447894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:40.450776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41757e-0e76-4876-8c5f-cf8d4492914e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:40.513853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c527a-83ca-4a98-89ce-22db5e31957f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:40.571687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:40.573079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.573644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.574532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.575964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:40.576501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:40.579402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:40.582189 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 374/739] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:39 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:40.584816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.584816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.584816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.606711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 366/740] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:40.607123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:40.608117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:40.608567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:40.631125 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:40.693760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 375/741] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:40 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 00:45:40.694973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:40.699392 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:40.747979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea176e6-4c80-4253-9f5c-2a6b831d0917 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:40.825851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c63c-0657-4e5e-b43e-8085dbccf244 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:40.868245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:40.868908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.869444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.869865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.880717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:40.881752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:40.882248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:40.882804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:40.918913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:40.921280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:40.957465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:40.957465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:40.961920 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:40.979243 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:40.980321 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:40.981295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:40.981295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:40.981295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:40.989973 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 367/742] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:40.995507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.086972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 376/743] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:40 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 00:45:41.088478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.128740 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.177219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dafa-72a5-4060-bae7-c6b8d605237c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.228255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3700a4-0f27-41d7-a75c-88b3c37d7449 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.230437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.231533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.232978 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.234292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.234906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.236199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:41.236684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.238277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.257204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 368/744] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:41.258344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.276989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.277793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.278170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.278559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.279323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.280953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.313210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 377/745] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:45:41 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:41.318468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.505988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916a8-3d25-47dc-8e21-f84138f0f458 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.522678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f3ad-e972-4864-95a1-1a6b8002e46b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.555284 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.569574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.570233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.570516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.570788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.589226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.590978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.603506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.605983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.606690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.606987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:41.615683 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:41.616750 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:41.617677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:41.617677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:41.617677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:41.619334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.619750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 369/746] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:41.624490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.625805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:41.635599 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:41.636575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:41.638881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 378/747] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:41.643111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.672255 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.758066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94300f1-79ae-4694-996d-09ed10ab9367 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.774887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8a1f-93c7-4ff4-9830-6b4d85181db1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:41.804365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.805886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.806759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.807595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.809219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:41.810227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.813137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.814872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:41.815502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:41.815790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:41.816062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:41.816764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:41.817070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:41.818983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:41.832912 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 379/748] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:41.836216 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 370/749] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:41.841448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.845869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:41.926384 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.941786 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:41.965960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200c20-9492-461e-9fd5-378f3006c93e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:42.028067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:42.028725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.029011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.029290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.030094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=54042d352c6b4bbb95af7eed835a7e37) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:42.030460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:42.031992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:42.039672 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 380/750] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/role_assignments?user.id=54042d352c6b4bbb95af7eed835a7e37&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:42.066513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e85659-10e1-40cf-b8aa-52c13aa73ab8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:42.134621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:42.135765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.136260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.136734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.145519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:42.147586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-aceb7186-ec5d-44cf-8b6c-bddd249bd0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:42.170361 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:42.171304 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:42.172194 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:42.174556 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 371/751] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:42.181252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:42.220452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e0f19-60f1-41a2-861d-4ccb8bb444d7 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.221121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e0f19-60f1-41a2-861d-4ccb8bb444d7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.221683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e0f19-60f1-41a2-861d-4ccb8bb444d7 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.223641 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 372/752] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:42.230131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.230791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.231303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.253470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:42.255378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:42.368745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b84d-a3f6-43d7-a535-073a8de01522 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:42.373144 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 373/753] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:45:42.419869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:42.421003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.421510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.422018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.423053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:42.423601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:42.425695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:42.452872 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 381/754] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:42.460083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:42.504951 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:42.618107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b47b4-6cb9-40d5-9fc1-29b4825eb39b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:42.695677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:42.696677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.697184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.697705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.699007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=46f1c1451849424fa2b09e7ea786a539) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:42.699573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:42.702619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c89f0-b946-437c-9cbd-102d373dc91b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:42.713659 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 374/755] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:42 2022] GET /identity/v3/role_assignments?user.id=46f1c1451849424fa2b09e7ea786a539&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:42.767338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:42.771567 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:42.904116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0172-bf7f-4e9f-adbd-31daeffe634d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:42.927911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78a99-958f-47fe-8900-0409edb25074 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.928439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78a99-958f-47fe-8900-0409edb25074 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.928439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78a99-958f-47fe-8900-0409edb25074 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.931416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 375/756] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:42.936096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.936427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.936641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.953077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:42.954620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:42.955140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:42.955691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:42.968017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:42.969161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:42.970445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:42.976463 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:42.977632 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:42.978595 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:42.981820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 382/757] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:42.987544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.089174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 376/758] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:43.104761 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:43.175568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8cfe1-711c-4317-b11f-a78a4e312c73 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:43.231255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:43.231798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:43.232080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:43.232358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:43.233038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:43.233342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:43.234765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:43.248623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 383/759] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:43.254719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.286670 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:43.377872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5856f9-141d-4f8c-bbdd-09717d929b8f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:43.398235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.418443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:43.419200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:43.419601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:43.425445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:43.431849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:43.433396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:43.451042 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:43.452154 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:43.453266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:43.453266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:43.453266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:43.453266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 377/760] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:43.465472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.620799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea900-328c-48f2-9bee-849b76fedc87 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:43.629271 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:43.683882 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:43.684641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61eb3f-e91f-40ef-8416-e00603c8e529 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:43.714281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:43.714952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:43.715237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:43.715510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] PATH_INFO: `/v3/services/network` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:43.716127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:43.717713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:43.734680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:43.736033 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:43.736959 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:43.741444 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 384/761] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/services/network => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:43.745175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:43.745900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:43.746182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:43.746511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:43.747189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:43.747498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:43.748944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:43.750583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.782861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 378/762] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:43.804956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:43.900450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aebd9-7098-4d5a-ba4f-ad18a82608ad None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:43.940441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:43.941063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:43.941339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:43.941631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:43.942376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:43.942875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:43.944494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:43.962768 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 385/763] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:43.963759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.038579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d569-df89-411a-b98d-fff722974215 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.086020 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:44.107857 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:44.109536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.110260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.110585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.110915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.119743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.121493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:44.137293 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:44.140828 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 379/764] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:44.144704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.202930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fbaf-d0e7-49dc-ba89-806cdefd2aa5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.275021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.275642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.275921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.276192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.276814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:44.277113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.279170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.291957 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 386/765] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:44.297510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.334952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543b13c-6d8a-478f-a077-b36960a7fc6a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.443532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.444144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.444423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.444693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.445451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:44.445757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.447197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.453288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f2b13-6a91-490c-b588-08fd3c5f56a8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.478559 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:44.492738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 380/766] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:44.498500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.500142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.500861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.501150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.501486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.502237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] RBAC: Adding query filter params (interface=public, service_id=d82bd65814ab40b48e7894a9b5c16bda, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:44.502551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.504371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.517211 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 387/767] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:45:44 2022] GET /identity/v3/endpoints?service_id=d82bd65814ab40b48e7894a9b5c16bda&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:44.526698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.612618 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:44.675791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d92a6-d96e-4f90-9333-2ec77189562d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.716482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.717057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.717364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.717724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.718046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e946c-7fe1-4900-a394-e5bed6662fc1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:44.730398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.732392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-38d93855-7e0e-478a-b747-7a7faaca54ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:44.751359 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:44.752444 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:44.753392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:44.753392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:44.753392 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:44.753392 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 381/768] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:44.757439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c098e4-a502-482b-bfd2-32692f9d360d None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.757439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c098e4-a502-482b-bfd2-32692f9d360d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.757439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c098e4-a502-482b-bfd2-32692f9d360d None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.757439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 382/769] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:44.762323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c098e4-a502-482b-bfd2-32692f9d360d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:44.768529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:44.769162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.769463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.769757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.771034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:44.772842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fce988-548e-473f-be4e-b4d4385a3e8e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:44.779391 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 388/770] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:45:44 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:44.780968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:44.781307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:44.781639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:44.815970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:44.817674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:44.950034 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:45.019098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 389/771] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:45.046795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c098e4-a502-482b-bfd2-32692f9d360d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:45.049122 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:45.102681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:45.103590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.103973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.104465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.105616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:45.106121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:45.108468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e04c-3f39-4518-8658-ceec53e0dd2b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:45.128423 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 383/772] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:45.135612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:45.272446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7436f-8afa-45ad-a878-6552b9131932 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:45.285470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194cf6-a792-477b-b45f-88367b99578b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.286652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194cf6-a792-477b-b45f-88367b99578b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.287146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25194cf6-a792-477b-b45f-88367b99578b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.289783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 384/773] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:45.298516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.298843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.299164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.346325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:45.347794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:45.353690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:45.354767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.355248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.355730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.371471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:45.373460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:45.393308 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:45.394260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:45.396174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 390/774] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:45.402569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:45.444569 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:45.489662 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 385/775] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:45.491139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:45.527039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cbba-eb39-4a0d-8ff0-bb075b29eabb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:45.576856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:45.578001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.578515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.578941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.579811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:45.580426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:45.582083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2993-97d0-47ea-bba3-5f1dacd12063 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:45.597049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 391/776] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:45.599560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce86-0c0d-4fe8-8210-c468e61cd0b7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.600041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce86-0c0d-4fe8-8210-c468e61cd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.600483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce86-0c0d-4fe8-8210-c468e61cd0b7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.602407 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 392/777] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:45.604761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ce86-0c0d-4fe8-8210-c468e61cd0b7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:45.623213 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:45.635176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aefdd0-8329-414d-8f2a-74894551e4ee None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:45.692901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:45.696202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.696642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.697068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.697853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:45.699409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-d1f96578-ef70-4583-95ea-3850ad191b83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:45.711024 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:45.712222 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:45.713078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:45.721093 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 386/778] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 25 00:45:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:45.721093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.722900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.723184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.745460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:45.746753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:45.763206 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:45.773741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ce86-0c0d-4fe8-8210-c468e61cd0b7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:45.825367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:45.826317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:45.826748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:45.827162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:45.829716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=664154bf7b8d4ec9b0be57b37687ecb3, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:45.831516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:45.845452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 387/779] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:45.845452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:45.854885 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 393/780] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:45 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:45.855966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.029178 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.062704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75df19-e315-4f96-9c24-06b53ce10148 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.111227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130b13-8b72-4559-b684-9eb53f0452d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.121490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.122221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.122502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.122822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.123718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:46.124173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.127002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:46.135579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 388/781] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:46.142854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.157890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.158940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.159400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.159891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.177171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:46.184510 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:46.185723 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:46.186561 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:46.187233 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 394/782] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:46.193798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.221772 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.322607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d56cc6-2cd9-4da4-93c7-8410a6fe7446 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.358859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200877-7bdf-4a96-91da-e2c70914ad4b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.373542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.374387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.375156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.375515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.376568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:46.376921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.379291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:46.388881 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 389/783] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:46.389928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.408924 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.424482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.425605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.426095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.426401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.427242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:46.427562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.430109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:46.455906 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 395/784] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:46.456964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.544133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04571324-a358-4fb8-89c2-9365d2415dd1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.559782 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.602810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735018-1e41-473f-bab8-31f7569f68a8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.607362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.608117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.608510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.608839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.627972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:46.638702 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:46.639697 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:46.640565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 390/785] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:46.646113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.654119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.655117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.655608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.656090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.657121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] RBAC: Adding query filter params (interface=public, service_id=1ed9e93705ad40168031901e3fd74480, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:46.657718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.659429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:46.667260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 396/786] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/endpoints?service_id=1ed9e93705ad40168031901e3fd74480&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:46.668354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.768267 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.803116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019143f7-4af0-4956-8c75-036fe51f9b4c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.805064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756afed8-e6a6-4b0a-b795-b41b0a72a558 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:46.848888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.849748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.850133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.850509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.851313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:46.851721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.853356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:46.869482 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 397/787] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:46.869482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:46.877620 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:46.976505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:46.977092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:46.977370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:46.977677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:46.989832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:46.991427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:47.008065 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:47.009338 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:47.010277 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:47.010277 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:47.010277 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:47.010277 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 391/788] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:47.010277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.016700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad13d-9487-40fa-9c3d-66466983bf22 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.063313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.064340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.064835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.065313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.066234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.068076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.080720 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 398/789] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:45:46 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:47.083291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.191470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54f6b-64c8-433f-89f4-4c7dae96e0d6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.230313 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:47.264116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.265245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.266008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.266480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.278493 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:47.312214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.314397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:47.358755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:47.360893 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:47.364311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:47.364311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:47.364311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:47.364311 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 392/790] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:47.371526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.375511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715bec-7197-4bc2-9cd4-57956248a1c1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.441378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.443314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.444565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.445093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.446108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:47.446762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.448423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.463904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 399/791] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:47.470256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.527814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123ed9-0905-425b-9721-21985ba083ac None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.600940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0976-8b45-4a6f-9c8e-0ad8828ee8e4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.621956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.622684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.622974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.623246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.623914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:47.624215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.625795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.638300 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:47.641997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.642750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.643031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.643303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.652541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.654583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.657553 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 393/792] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:47.663144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:47.668699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:47.669759 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:47.670712 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 400/793] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:47.677044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.748835 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:47.834945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cdbd1-0e57-4a48-8786-b585b86ecd3c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.854410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9930-9ee4-4a9e-877f-02c2bf41d52a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:47.878704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.880302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.881220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.881939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.892851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.893842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:47.894546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.894895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.895304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.896008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.896186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:47.896630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:47.898218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b4746201-4ed4-40ed-93b4-58b18c5547d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:47.911976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:47.913158 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:47.914180 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:47.917066 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 394/794] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:47.918720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3e00-bc3b-48f8-a71e-3de742423e22 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:47.919206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3e00-bc3b-48f8-a71e-3de742423e22 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:47.919660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3e00-bc3b-48f8-a71e-3de742423e22 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:47.920348 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 401/795] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:47.921742 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 395/796] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:47.922769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:47.925839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3e00-bc3b-48f8-a71e-3de742423e22 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.001445 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.046298 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.052442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3e00-bc3b-48f8-a71e-3de742423e22 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.092803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70064a-7ce3-4362-8b1c-f4bfccc3464e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.102797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.103734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.104165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.104644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.120680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.122564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.141490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.142454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-0b53ae67-2313-4d1e-abb1-54c12f6b9ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:48.142748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:48.143860 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:48.144962 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:48.144962 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:48.144962 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:48.145521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.145968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.146834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 396/797] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:48.147145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:48.147639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.148381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.148762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.149150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.150069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.169646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:48.171031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:48.184052 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 402/798] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:48.184928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.277627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 397/799] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:48.277627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.388189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2840-d45d-40cd-9cf9-8ebcbbcb31f2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.399000 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.500256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.501324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.501965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.502479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.503717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:48.504264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.508197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.544255 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.546144 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 403/800] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:48.553311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.586121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39394575-d5c0-4814-8d19-c3c40e52e69f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.625559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.626201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.626600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.626881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.639778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.641177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8ae95be5-9eff-44ad-b1a9-90ec0d5ea0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:48.670483 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:48.672279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:48.674554 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:48.674554 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:48.674554 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:48.674554 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 398/801] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:48.675177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701f82-6a9b-437d-af4b-e9d661893cd3 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.675586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701f82-6a9b-437d-af4b-e9d661893cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.676142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701f82-6a9b-437d-af4b-e9d661893cd3 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.678886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 399/802] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:48.680371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701f82-6a9b-437d-af4b-e9d661893cd3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.700588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02849b11-f4fa-4b34-a7ec-1c7f54746eca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.741753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.742405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.742686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.742960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.750351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.751818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:48.765516 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:48.767342 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 404/803] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:48.769083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:48.801248 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.825435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701f82-6a9b-437d-af4b-e9d661893cd3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.866433 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:48.871738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.873027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.873312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.873621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] PATH_INFO: `/v3/services/network` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.874214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.875605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-19e25e71-2415-4c58-ad58-18cd89127f8c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:48.888823 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:48.890353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:48.891300 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 400/804] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:48.892398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.892398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.892398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.914467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:48.916390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:48.924431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8b27a-b51e-48a9-8c10-ce8740626c74 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:48.981256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:48.983160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:48.983160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:48.983461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:48.984546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:48.985102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:48.987353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.009447 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 401/805] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:49.009447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.015592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 405/806] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:49.017066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.167532 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.177487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb089c5-c314-40ff-8f6c-25b85293da5f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.192489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ea74-761d-4e8b-aa74-b71a4d178ed1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.214137 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.226306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.226884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.227258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.227671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.228555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:49.228928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.230736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.246708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.247776 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 402/807] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:49.249026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.254393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.255089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.255752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.256841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] RBAC: Adding query filter params (name=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:49.257447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.260572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.273634 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 406/808] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:49.274732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.396829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fbcd8-866e-4d2d-a54e-c89ccf988dcd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.422287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878114c9-b92b-42e4-adf9-7aad42ccf843 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.452657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.453673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.454087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.454492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.463984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.465598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.478483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.479249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.479530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.479806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/54042d352c6b4bbb95af7eed835a7e37/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:49.482019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:49.483503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:49.485171 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 403/809] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:49.487406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.511155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=54042d352c6b4bbb95af7eed835a7e37, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.512627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.522356 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.541446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 407/810] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:49 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/54042d352c6b4bbb95af7eed835a7e37/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:49.541446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.559778 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.635142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613f227-c769-46da-92d4-451d2cbe0839 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.695294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.696185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.696571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.696913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.697704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] RBAC: Adding query filter params (type=network) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:49.698014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.698125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3c46-661c-4e44-af3b-16d35c5896f3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.699552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.709724 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 404/811] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:49.711291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.752610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.753317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.753591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.753870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.767824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:49.774083 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:49.775110 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 408/812] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:49.776061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.855413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc61b9e-8a8e-4103-bbed-55b4f1de1478 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.868996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.878593 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:49.903383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.904129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.904326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.904574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.905291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:49.905626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.907161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:49.926033 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 405/813] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:49.927606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:49.931119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e757-80b5-4303-8fbe-be0f33fd5996 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:49.976467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:49.977004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:49.977415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:49.977826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:49.978510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:49.980468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3fae1-ec96-47c8-ba70-975fcc3dd592 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 409/814] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:45:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0667-8794-427b-a37f-d5fc4ffc9514 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0667-8794-427b-a37f-d5fc4ffc9514 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0667-8794-427b-a37f-d5fc4ffc9514 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 410/815] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:50.017446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be0667-8794-427b-a37f-d5fc4ffc9514 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.090882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f049fb-efa4-473a-b9d1-4c4a0fcdebe2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:50.163298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:50.164260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.164616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.165534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.166989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:50.167393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:50.169173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6f37d-7512-4e71-9638-7fb7e6962cbe None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.169746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be0667-8794-427b-a37f-d5fc4ffc9514 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:50.187916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 406/816] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:50.189745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.190215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.190762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.203559 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:50.217439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:50.220198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:50.239655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:50.240808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.241113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.241777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/46f1c1451849424fa2b09e7ea786a539/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.245334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=46f1c1451849424fa2b09e7ea786a539, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:50.247792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.260273 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:50.267035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 411/817] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:45:50 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/46f1c1451849424fa2b09e7ea786a539/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:45:50.267707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.356917 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 407/818] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:50.456482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b506-aeb8-4655-beb5-27c0b83d8832 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:50.514815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:50.516343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.516939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.517652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.539499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:50.541667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:50.564095 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:50.565546 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:50.566859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:50.566859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:50.566859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:50.568982 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 412/819] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:50.577305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.690953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.726441 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:50.738326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8c930-dff3-4a03-bd83-30bab48a9ff4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:50.784929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:50.785611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.785955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.786235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.786915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:50.787310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:50.789131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.810828 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 408/820] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:50.812604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.839152 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:50.841976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef968da-14a9-4b8f-a12e-ab5ccc424d14 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:50.889247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:50.890213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:50.890671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:50.891399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:50.892753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:50.894818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:50.909503 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:50.910593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 25 00:45:50.912505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:50.916225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 413/821] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 25 00:45:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:50.922466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:50.963728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca514d-c934-416d-a350-9bdeb3ae3146 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.015083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.016140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.016632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.017133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.026599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.028684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:51.043097 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:51.044071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:45:51.045026 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:51.051003 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:51.052906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 409/822] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:45:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:51.055403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:51.066197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce089e-a466-4ef4-b34e-bdc05a978064 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.114579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.115636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.116090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.116553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.117612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:51.118291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.119994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.133243 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 414/823] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:51.135068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:51.162682 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:51.200986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fc41-0a1e-4870-a2be-075de81aeb80 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.242070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.243141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.243141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.243537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.244380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:51.244849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.246413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.283352 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 410/824] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:45:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:51.287618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c2755-e1bb-430d-b4c9-0fed83e98855 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.289964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:51.340150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.341013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.341489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.341911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.342696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:51.343150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.344736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.357846 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 415/825] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 25 00:45:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:51.359534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:51.386839 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:51.431577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545a52-5884-40c7-a82d-f8599133cf5d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.469060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.469866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.470323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.470727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.475123 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:51.493509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39120c5-1f68-4526-851d-1cbd3fc917bf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.535065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.536184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.536613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.537028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:51.537880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.540123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.546627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:51.548204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:51.573673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 416/826] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:45:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:51.674681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 411/827] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:51.680842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:51.769986 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:51.822120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff8f-4132-4b6a-8337-3d014c00eb88 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:51.882011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:51.883117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:51.883602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:51.884321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.070517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:52.073267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-24a0784e-3c66-40b0-9010-71344279cecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:52.101673 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:52.103054 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:52.103921 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:52.103921 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:52.103921 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:52.104101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 417/828] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:52.114292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.151621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ecb6-3f55-4e3f-9c81-c1f1af40e54a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.151944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ecb6-3f55-4e3f-9c81-c1f1af40e54a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.152157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ecb6-3f55-4e3f-9c81-c1f1af40e54a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.153793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 418/829] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:52.163173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839908d1-b12c-4292-8442-6178b96b205f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.163471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839908d1-b12c-4292-8442-6178b96b205f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.163714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839908d1-b12c-4292-8442-6178b96b205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.174652 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:52.188726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-839908d1-b12c-4292-8442-6178b96b205f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:52.189958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-839908d1-b12c-4292-8442-6178b96b205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:52.251450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1320cb-f7be-4da6-8985-09790abe3bc7 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:52.272952 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 419/830] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:45:52.292563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:52.293604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.294107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.294594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.295448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:52.295964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:52.297664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:52.311051 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 412/831] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:52.321453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839908d1-b12c-4292-8442-6178b96b205f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.375819 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:52.444805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839908d1-b12c-4292-8442-6178b96b205f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:52.484619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:52.485258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.485566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.485837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.493106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:52.494604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:52.512353 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:52.513292 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:52.514227 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:52.515176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 420/832] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:52.523983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.599308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.705226 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:52.715692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c4ed-a32c-4979-9dd7-2b732e60cbab None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:52.733646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f311-8ee2-45d4-a1be-7dad9ba6e2a1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:52.747936 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:52.754118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:52.754773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.755065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.755314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.756020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:52.756765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:52.758256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13b358-0f6c-4e13-a3b5-ae8851124c9b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:52.771257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:52.771890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.777001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.777126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 413/833] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:52.777205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.777301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f460f3-dca3-4b3c-a86a-888821875427 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.777301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f460f3-dca3-4b3c-a86a-888821875427 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.777301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f460f3-dca3-4b3c-a86a-888821875427 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.777301 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 414/834] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:52.780376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f460f3-dca3-4b3c-a86a-888821875427 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.789294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ead8fcd6-4127-4e9e-9a69-f94a1fc4c29f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:52.794142 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:52.795260 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:52.796126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 421/835] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:52.801167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.801517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.802014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.820192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:52.821393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:52.894342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f460f3-dca3-4b3c-a86a-888821875427 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:52.895930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:52.909453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:52.942328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:52.942945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:52.943380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:52.943591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:52.944653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:52.944777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:52.946200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:52.956074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 415/837] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:53.034983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5029ca-a291-439b-92a0-0d6120ef717b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.037942 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.076929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.077589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.077869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.078139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.078833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:53.079133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.080693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.090945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 423/838] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:53.096802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.127910 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.202600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.228022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ba47-22ae-45ef-ba50-d7d14decbe77 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.277114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.278113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.278394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.278666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.293620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.295090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:53.318634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:53.319845 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:53.320900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:53.320900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:53.320900 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:53.320900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 416/839] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:53.326924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.334412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490742b-9694-4c48-87f9-b2e63fe92f13 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.374996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.375701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.375983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.376254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.394299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:53.400808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:53.401799 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:53.402638 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 424/840] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:53.408489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.440287 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.446734 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.507101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8d87-1853-45d7-bf62-5e60c38d1716 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.537309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7116-9bd3-4ab1-b02c-fd694e7a1f5b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.556517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.557618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.558097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.558545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.559401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:53.559920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.561961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.580732 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 417/841] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:53.582238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.587143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.589807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.593853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.594249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.595639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:53.596060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.598104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.615361 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 425/842] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:53.622540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.720620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104db8a-6aef-4257-bc12-405ebe45e36d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.735870 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.755435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6f44-e0ec-47b9-8ef6-093fe8bd2b5a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.766882 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:53.775315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.776340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.776820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.777294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.787499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.790350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.804347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.804999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.805329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.805640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:53.807986 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:53.808919 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:53.810673 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:53.813753 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 418/843] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:53.816298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.825991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.827505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:53.843134 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:53.844129 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:53.845023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:53.845023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:53.845023 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:53.850287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 426/844] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:53.851274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:53.951711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f32b-05de-4032-8489-d652500a3781 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:53.990027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:53.990674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:53.990959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:53.991235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:53.992060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:53.992274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:53.993770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a721c-dd7f-45fd-a19a-c6c0c07d9a28 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:53.997604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4add-e935-4029-85ea-741b809be869 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.017811 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 419/845] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:54.019339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b16ce-d88b-4daf-a6e7-d13650423260 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.019339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b16ce-d88b-4daf-a6e7-d13650423260 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.019616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b16ce-d88b-4daf-a6e7-d13650423260 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.025724 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 420/846] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:54.025724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b16ce-d88b-4daf-a6e7-d13650423260 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.049452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.050171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.050523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.050868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.051653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:54.051955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.053339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aceae5-408c-4a33-9351-9c1741aa5476 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.065872 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.082219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 427/847] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:54.084221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.084584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.084773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.087611 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.105249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:54.106503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:54.153180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b16ce-d88b-4daf-a6e7-d13650423260 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.187847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 428/848] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:54.188494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.198480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.199909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.200403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.201325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.300251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691e74-7898-4499-9620-bf1da1aee298 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.301576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.304507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.348100 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.357511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.358162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.358819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.358819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.362891 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.367350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.368719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:54.381805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:54.382807 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 25 00:45:54.383783 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:54.388446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 429/849] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:54.389056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.438404 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 421/850] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:54.446883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.497033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3e87b-1d9b-4dc7-9436-3915bd54cd21 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.534537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.535147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.535427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.536310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.537484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:54.537794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.539262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.560298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 430/851] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:54.561490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.573761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd39c62-d9bc-49fe-8331-6bcfb969999b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.613786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.614560 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.615291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.615691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.615937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.627575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.628982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:54.644699 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:54.645981 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:54.647174 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:54.647174 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:54.647174 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:54.650181 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 422/852] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:54.651890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.655023 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.678032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606c942-f8c6-41a4-baae-9d257140196f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.714699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.715337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.715610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.715878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.716469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.717858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:54.728310 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:54.734295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:54.735185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 431/853] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:54.735982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.796656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcab1-98f2-42ca-81bf-9177de891c8d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.833505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.834029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.834311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.834585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.844978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840774-e453-4eed-9688-c96e99df107b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:54.857590 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:54.887485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:54.888466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:54.888466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:54.888722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:54.889321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:54.889661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.891139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.909296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 432/854] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:54.909296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:54.918634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:54.920107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:54.922067 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.032480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec7839-4a29-4c8a-afa8-87e17c0dfa64 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.043892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 423/855] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:45:55.043892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.076540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.077268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.077593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.077870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.078524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:55.078829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.080890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.092283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 433/856] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:45:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:55.092283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.140201 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.167897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44d3cd-4a3a-4d7b-b0be-caafd30f7966 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.170635 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.208509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.209308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.209583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.209852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.217760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.219347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.220834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68d247-1741-40d6-b8cb-f97880940eba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:55.231948 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:55.232876 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:55.233782 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 424/857] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:55.234781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.262848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.263488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.263766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.264042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.275026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.276487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:55.291699 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:55.292926 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:55.294081 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:55.294081 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:55.294081 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:55.297580 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 434/858] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:55.298480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.352073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7b9c-57be-4a1a-bc33-73e251e27f6f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.393907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.394524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.394794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.395166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.395781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:55.396081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.396877 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.397815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.402732 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 425/859] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:55.403545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.418860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eafc10-a3c6-4ee5-a682-24eadacf822b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.454618 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.458215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.459136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.459417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.459691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.460405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:55.460714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.462211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2fb6d-167a-4b2d-9968-17172037234f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.476451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 435/860] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:55.477784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf5605-4974-41fe-b9da-a8854f3a6944 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.478074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf5605-4974-41fe-b9da-a8854f3a6944 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.478348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf5605-4974-41fe-b9da-a8854f3a6944 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.483819 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 436/861] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:55.483819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf5605-4974-41fe-b9da-a8854f3a6944 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.552132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692869-19e0-40a4-acb2-5058831ce399 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.591061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.591737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.592014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.592196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.592842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:55.593138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.594549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544feaea-182d-435b-bf48-3ec0b3c9d526 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.602626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf5605-4974-41fe-b9da-a8854f3a6944 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.607940 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 426/862] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:55.609197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83907-2eea-4252-a730-708a174c402d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.609500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83907-2eea-4252-a730-708a174c402d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.609768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83907-2eea-4252-a730-708a174c402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.628579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-98e83907-2eea-4252-a730-708a174c402d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:55.630393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-98e83907-2eea-4252-a730-708a174c402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:55.651859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.652607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.652865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.653138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.653909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=54042d352c6b4bbb95af7eed835a7e37) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:55.654214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.655934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.673434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 437/863] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/role_assignments?user.id=54042d352c6b4bbb95af7eed835a7e37&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:55.673434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.687473 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.733574 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 427/864] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:55.801119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f123a2-d3de-4f1e-aae1-d23a79e395d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:55.839992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:55.840640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:55.840918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:55.841190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:55.849309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:55.852194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:45:55.864883 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:55.865853 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:55.866737 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 438/865] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:55.872510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83907-2eea-4252-a730-708a174c402d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:55.896316 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:55.987230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83907-2eea-4252-a730-708a174c402d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:56.025787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:56.026407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:56.026687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:56.026959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:56.027657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:56.028029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:56.029573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:56.035318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:56.047352 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 428/866] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:56.048589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:56.124277 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:56.138617 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:56.162803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f90f6-4133-40cb-9f1d-079c1b323cbc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:56.163166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381b05-547b-4a11-9b20-b7a385bf0326 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:56.201025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:56.201580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:56.201720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:56.201957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:56.202290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:56.202960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:56.203066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=46f1c1451849424fa2b09e7ea786a539) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:56.203368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:56.203746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:56.204221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:56.204826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:56.205193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:56.206880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:56.212026 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 429/867] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:45:56 2022] GET /identity/v3/role_assignments?user.id=46f1c1451849424fa2b09e7ea786a539&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:56.217361 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:56.218338 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:45:56.219224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:56.222240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 439/868] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 25 00:45:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:56.230567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:56.356508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc36d-a069-4474-9c55-2357b086ebe0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:56.404083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:56.404699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:56.404981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:56.405249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:56.405913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:56.406213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:56.407586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b262-08e9-4edf-a807-bba3ca931488 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:56.413871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 430/869] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:45:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:45:56.419761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:56.529938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111364-a4b6-46c1-a635-d5573e4399fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:56.565768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:56.566386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:56.566662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:56.567114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:56.568122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:56.568427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:56.569848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09aec7-4835-4c79-b779-3a90bed8a01f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:56.571316 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:56.576442 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 440/870] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:45:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:57.692987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee282c-10ad-4082-997d-9da56b24fd21 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:57.693676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee282c-10ad-4082-997d-9da56b24fd21 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:57.693676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee282c-10ad-4082-997d-9da56b24fd21 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:57.695081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 431/871] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:57.700874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8869-2da6-467f-99cf-e7c7bf69dd2e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:57.701932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8869-2da6-467f-99cf-e7c7bf69dd2e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:57.702559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8869-2da6-467f-99cf-e7c7bf69dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:57.722222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d72f8869-2da6-467f-99cf-e7c7bf69dd2e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:57.724699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d72f8869-2da6-467f-99cf-e7c7bf69dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:57.805528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 441/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:58.078285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee282c-10ad-4082-997d-9da56b24fd21 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:58.083915 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:58.205356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356b7d-c635-4918-9d35-f5b2278b2647 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.205658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356b7d-c635-4918-9d35-f5b2278b2647 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.206416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356b7d-c635-4918-9d35-f5b2278b2647 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.210482 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 442/873] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:58.215905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeba5c1-54df-4017-a0e2-4ce470e30b65 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.216525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeba5c1-54df-4017-a0e2-4ce470e30b65 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.217027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeba5c1-54df-4017-a0e2-4ce470e30b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.228007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee282c-10ad-4082-997d-9da56b24fd21 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:58.237296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3aeba5c1-54df-4017-a0e2-4ce470e30b65 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:58.239784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3aeba5c1-54df-4017-a0e2-4ce470e30b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:58.268700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:58.269306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.269604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.270390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.271440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:58.273649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:58.305429 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 432/874] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:45:58 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:58.346692 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 443/875] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:45:58.625093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:58.682050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe456a7-471e-4541-8877-321332085cbf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.682336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe456a7-471e-4541-8877-321332085cbf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.682884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe456a7-471e-4541-8877-321332085cbf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.684867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 444/876] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:45:58.691110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6ac4-9556-4941-8d8c-9bcf7a239746 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.691755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6ac4-9556-4941-8d8c-9bcf7a239746 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.695221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6ac4-9556-4941-8d8c-9bcf7a239746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.715578 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:58.727417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-91ea6ac4-9556-4941-8d8c-9bcf7a239746 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:58.730548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-91ea6ac4-9556-4941-8d8c-9bcf7a239746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:58.768598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f060cc-2a9e-4eb3-9756-87738cba1b08 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:58.801112 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:58.812783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:58.813542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.813745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.814023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.824741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 445/877] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:58.825042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:45:58.825963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b0d3f-9179-4db2-88f2-827e46fe5c87 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.826243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b0d3f-9179-4db2-88f2-827e46fe5c87 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.826508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b0d3f-9179-4db2-88f2-827e46fe5c87 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.827874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 446/878] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:45:58.832087 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:58.833670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:45:58.834512 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:58.835132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:58.835132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:58.835257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:58.837277 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 433/879] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:45:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:58.843053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:58.863426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:45:58.866658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:45:58.965529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 447/880] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:45:58.979047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadd063-4ead-4f94-b774-6accbb484bd2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.009745 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.020377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.021609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.022063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.022494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.023314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:59.023757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.025346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.036092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 434/881] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:45:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:59.042596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.102362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.160049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d2a1-f4c5-4ac0-a775-89f2c0ee905b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.175920 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.198617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.199635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.200061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.200605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.212508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.214371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.221334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef192-3d68-4faf-8aba-8cfc14fc72be None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:45:59.231899 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:59.233120 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:45:59.234239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:45:59.234239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:45:59.234239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:45:59.236084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 448/882] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:59.242699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.260096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.261027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.261580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.262010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.262753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.264475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:59.274223 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:59.275257 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:59.276078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 435/883] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:45:59.276854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.348624 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.371032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215900-7791-4d1f-be7d-a86ffbf8e3cc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.406590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583c78-886c-4dfb-97ae-10eb442b8dcc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.421725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.422335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.422625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.422896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.423545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:59.424025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.425575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.440945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 449/884] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:59.447238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.448185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.448802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.449082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.449353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.450044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.451525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.469102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 436/885] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:45:59 2022] POST /identity/v3/services => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:45:59.470911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.483438 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.587171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8a-6d4b-46c4-a6cc-543dc543f661 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.640278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd641f6-aeff-41ec-9ffd-7aa3e4a92c52 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.649659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.650418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.650699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.650999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.651804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:59.652110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.653794 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.654616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.667459 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 450/886] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:59.669234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.702098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.702750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.703036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.703312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.714297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.716356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:45:59.731425 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:45:59.732430 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:45:59.733364 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:45:59.741146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 437/887] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:45:59.742487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:45:59.796837 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:45:59.809477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517f9d7-3c7f-4e85-90d8-0aa37647a1a1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.853596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.854565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.855026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.855490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.856397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:59.856889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.858716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.865946 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 451/888] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:59.893013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e51aa-e36f-4792-92f2-27209c1951bb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:45:59.936970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:45:59.938101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:45:59.938567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:45:59.939020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:45:59.940238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:45:59.940815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:45:59.943412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:45:59.965677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 438/889] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:45:59.974236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:00.104757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46b16-f2b1-4ddb-b7fe-3024d4cf380a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:00.147149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:00.148070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.148503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.148926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.178360 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:00.228163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:00.229701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:00.338300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 452/890] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:45:59 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:00.346531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:00.374780 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:00.462828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844904f5-1479-46e5-87c3-6af95219e4c3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:00.501691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:00.502726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.503220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.503760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.516199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:00.518103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-54e10b33-bb32-4def-809a-13e5ad6ae4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:00.536880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:00.537943 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:00.538879 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:00.538879 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:00.538879 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:00.545585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 439/891] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:00.547757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:00.611447 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:00.655161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbfa5-18b2-40a6-a07f-05f838b33ee9 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.655770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbfa5-18b2-40a6-a07f-05f838b33ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.656245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbfa5-18b2-40a6-a07f-05f838b33ee9 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.656622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491149-9950-4c4b-bda4-d81140693147 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:00.658154 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 440/892] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:00.664569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.665162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.665710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.687054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:00.689239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:00.694658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:00.695236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.695630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.695974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.696697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:00.697068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:00.698573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:00.715372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 453/893] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:00.717126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:00.778072 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 441/894] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:00.834335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2870a5-7850-4765-82d9-0dc0753dc0cf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:00.850583 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:00.872650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:00.873734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:00.874295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:00.874771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:00.884221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:00.886266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:00.899615 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:00.900578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:00.901492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:00.908504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 454/895] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:00.910160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:00.920163 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:01.022257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba561e-08a0-46f3-9001-8ff6d0d98bf3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.059894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.061842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.062968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.063646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.064259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.065237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:01.065894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.068899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.083098 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 442/896] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:01.094619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.165904 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:01.177284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5299fd-5167-415e-84be-2bcf1315a36b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.203973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d445b37-bdc6-45c7-9f09-75422e906473 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.215316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.216183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.216703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.217181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.218007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.219644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:01.229824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:01.231098 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:01.231946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:01.239867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 455/897] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:01.241388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.246620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.246620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.247011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.247388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.248224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] RBAC: Adding query filter params (role.id=e637553524924775aa37f7b2ba619fe9, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=54042d352c6b4bbb95af7eed835a7e37) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:01.248625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.250192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.265527 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 443/898] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/role_assignments?user.id=54042d352c6b4bbb95af7eed835a7e37&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=e637553524924775aa37f7b2ba619fe9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:01.290157 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:01.362246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70db1-ef0c-42da-beab-490932c30667 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.404213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.404975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.405261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.405573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.406231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:01.406535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.407960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.419536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 456/899] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:01.425251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.540989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd587a-37b6-4994-a679-5528a24130a4 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.574975 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:01.579874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.580576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.580862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.581134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.581812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:01.582116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.583602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.589490 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 444/900] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:01.595303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.704528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae47-d0e8-451b-bbcb-8f3c9708ca12 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.706015 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:01.743162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.743781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.744064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.744337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.745045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] RBAC: Adding query filter params (interface=public, service_id=1decaf01772348c2836dcf27ce1f86e8, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:01.745352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.746762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0464128-5204-4e0d-b918-c52d27a3af50 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.752704 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 457/901] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/endpoints?service_id=1decaf01772348c2836dcf27ce1f86e8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:01.758415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:01.884736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c32ac-7ea8-4efb-be32-411202053341 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:01.890024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fad9-7b91-4438-84f1-498a99c0b011 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.890500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fad9-7b91-4438-84f1-498a99c0b011 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.890595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fad9-7b91-4438-84f1-498a99c0b011 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.892130 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 458/902] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:01.898052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6abdba-c5b8-42fb-bc2c-6339918011cf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.898338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6abdba-c5b8-42fb-bc2c-6339918011cf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.898616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6abdba-c5b8-42fb-bc2c-6339918011cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.917644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3f6abdba-c5b8-42fb-bc2c-6339918011cf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:01.918844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f6abdba-c5b8-42fb-bc2c-6339918011cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:01.929158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:01.930256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:01.930537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:01.930810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:01.931853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:01.933656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:01.941969 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 445/903] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:01 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:46:02.006026 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 459/904] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:02.300967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:02.310155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42827f8-809f-4cd0-9260-02cc771768a5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.310513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42827f8-809f-4cd0-9260-02cc771768a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.311174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42827f8-809f-4cd0-9260-02cc771768a5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.312383 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 460/905] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:02.318426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.318717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.318995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.337558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:02.338807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:02.374595 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:02.426226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 461/906] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:02.432018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46cb0-070b-4f66-a753-85564ebc775d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:02.476041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:02.477145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.477647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.478152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.478924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:02.480607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:02.491585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:02.492555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:02.493534 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:02.496338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 446/907] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 25 00:46:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:02.502062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:02.533082 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:02.609470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be0745-c57c-4788-9f58-b7440b6b6119 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:02.646053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:02.646531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.646816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.647092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.647734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:02.648039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:02.649512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:02.654862 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 462/908] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:02.660578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:02.701269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:02.783286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cc21-52a2-4ac7-933b-3d0d716d67c3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:02.806253 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:02.817062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d531dd-754d-42e8-ada0-eca287833310 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:02.817748 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:02.828597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:02.829321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.829637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.829915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.830553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:02.830854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:02.832407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:02.838923 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 447/909] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:02.844908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:02.864354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:02.865085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:02.865370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:02.865698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:02.866390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:02.867790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:02.885165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 463/910] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:46:02 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:02.988251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131290-583a-4b6e-a7cf-68d65a86fbcd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:03.046495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:03.047123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:03.047400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:03.047693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:03.048669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] RBAC: Adding query filter params (interface=public, service_id=0067c69dba0e402a8a42903e7d6f5fd9, region_id=RegionOne) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:03.049000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:03.050710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961097-bbeb-495e-9ba5-ff940972dd82 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:03.063062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 448/911] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:46:02 2022] GET /identity/v3/endpoints?service_id=0067c69dba0e402a8a42903e7d6f5fd9&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:03.069346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:03.200211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d042-2cbf-4ddf-8627-342f7f8d0b87 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:03.236498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:03.237189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:03.237503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:03.237779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:03.238397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:03.240579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7960-9668-4cfe-9e9b-b929ef5bfd66 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:03.247653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 464/912] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:03 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:46:03.686267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5bee-8962-4f21-b6ef-f941cacd9c01 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:03.686614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5bee-8962-4f21-b6ef-f941cacd9c01 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:03.686864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5bee-8962-4f21-b6ef-f941cacd9c01 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:03.688579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 449/913] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:03.695071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b043-31c2-4fd6-8a59-79f660f4ca24 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:03.695358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b043-31c2-4fd6-8a59-79f660f4ca24 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:03.695620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b043-31c2-4fd6-8a59-79f660f4ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:03.715421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2543b043-31c2-4fd6-8a59-79f660f4ca24 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:03.716626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2543b043-31c2-4fd6-8a59-79f660f4ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:03.729202 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:03.797755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 465/914] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:04.084736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e5bee-8962-4f21-b6ef-f941cacd9c01 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.140781 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:04.203469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b563d-4b3b-4677-9db5-50d71e882029 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.203999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b563d-4b3b-4677-9db5-50d71e882029 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.203999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b563d-4b3b-4677-9db5-50d71e882029 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.206934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e5bee-8962-4f21-b6ef-f941cacd9c01 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.209895 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 466/915] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:04.212365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.212650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.212920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.232000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:04.233197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:04.247542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.248596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.249182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.249718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.261994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:04.267366 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:04.268266 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:04.269106 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:04.271546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 450/916] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:04.279872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.317484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 467/917] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:04.390704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fa550-aae9-4113-b2c0-35357e000c8e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.413009 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:04.430759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.431674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.432091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.432499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.433304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:04.433767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:04.435268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:04.449541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 451/918] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:04.451270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.539280 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:04.571196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60d5a-b9cf-4c9b-be83-c5fb2d400568 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.589797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.612776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.613452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.614009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.614555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.627584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:04.629830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:04.648624 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:04.649616 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:04.655856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:04.655856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:04.655856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:04.655856 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 468/919] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:04.657707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.725777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6bc3-2d7a-48ef-a303-a4157c91923e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.775629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.776632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.777592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.778065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.779068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:04.781357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:04.791322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914442-8d03-4413-90df-c5fe087b86c2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:04.795032 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:04.795985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 25 00:46:04.796799 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:04.800108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 452/920] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:04.807249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.829003 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:04.843213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.844322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.844691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.845196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.845891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:04.846192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:04.848757 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:04.849581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:04.872499 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 469/921] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:04.873964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.933700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e5dd-4a00-4420-9cd0-749788d4b1c9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:04.972632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:04.973483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:04.973997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:04.974284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:04.974912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:04.975212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:04.976709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:04.986913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 453/922] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:04.987948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:04.991234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117f21-0488-4704-a025-d2eda688e21c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.040693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.041331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.041657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.041927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.053336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.055075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:05.072954 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:05.074201 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:46:05.075344 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:05.079394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 470/923] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:05.080967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.115556 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.124215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c438-1aed-4e7d-ab6d-01075be820f1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.153095 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.169813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.171026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.171935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.172675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.173798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:05.174689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.176897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.185515 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 454/924] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 25 00:46:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:05.191008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.223556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf85e-759a-4fbf-aa6e-3f6909028885 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.261284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.261951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.262231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.262503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.263238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:05.263544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.264980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e323-5c0b-49b1-ba50-82a35e595aa1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.284230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 471/925] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:05.285617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9cd1-1964-4baf-8ae3-c730dee3c9cb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.285910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9cd1-1964-4baf-8ae3-c730dee3c9cb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.286181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9cd1-1964-4baf-8ae3-c730dee3c9cb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.287586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 472/926] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:05.292248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9cd1-1964-4baf-8ae3-c730dee3c9cb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.304911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361ec6-cac8-43cb-a66a-3d23068f7555 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.340311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.340920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.341200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.341502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.342171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.343554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a233c-8628-4646-b48a-0b2c1e53bf1e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.369452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 455/927] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:05.371559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068928-db15-48f6-8643-fef71231af29 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.371943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068928-db15-48f6-8643-fef71231af29 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.372276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068928-db15-48f6-8643-fef71231af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.399465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f1068928-db15-48f6-8643-fef71231af29 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:05.400935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1068928-db15-48f6-8643-fef71231af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:05.423734 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.430072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9cd1-1964-4baf-8ae3-c730dee3c9cb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.445713 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.484778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.485595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.485934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.486193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.500680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.502211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.517877 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 456/928] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b52b15dd-3375-45ec-b271-4e6ca35130b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:05.523873 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:05.524896 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:05.525821 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:05.525821 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:05.525821 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:05.525821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 473/929] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:05.535021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068928-db15-48f6-8643-fef71231af29 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.573319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfdf24-f960-44a2-8c92-78f24ce9d8c0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.573658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfdf24-f960-44a2-8c92-78f24ce9d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.573923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfdf24-f960-44a2-8c92-78f24ce9d8c0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.576278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 474/930] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:05.583413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.583827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.584224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.606154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:05.607360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:05.673684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068928-db15-48f6-8643-fef71231af29 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.693731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 475/931] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:05.716257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.716784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.717059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.717324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.718009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:05.718293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.719721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.733586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 457/932] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:05.739635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.799794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.817763 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.839457 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:05.867385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342d07-5444-47ad-8c3b-d5ec7dece964 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.920244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.920897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.921177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.921491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.930668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.932315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:05.937011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b809972-b110-4448-a8b3-b05b6382e2b0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:05.946603 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:05.947571 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:05.948674 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 476/933] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:05.953826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:05.987012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:05.987797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:05.987797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:05.988305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:05.989585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:05.990983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:06.000462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:06.001850 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.002693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 458/934] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:06.003518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.083442 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:06.086734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a97af-3397-4589-8cef-5ab460db4994 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.120596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e128411-3bf9-4deb-babe-bfcdd3bbc20e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.126527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.127252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.127606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.127949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.128738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:06.129614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.131132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.150891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 477/935] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:06.150891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.150891 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:06.167126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.168337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.168734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.169015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.169660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.171078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:06.181077 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:06.182269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 25 00:46:06.183369 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:06.187294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 459/936] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:06.188231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.288461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3443-50b9-4b50-8ada-0bbf12c2e165 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.321995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7ad-f27c-4045-9c68-ad28fed3949f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.336125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.336747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.337485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.337485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.338234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:06.338399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.339722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.345051 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 478/937] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:06.351231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.375537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.376206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.376485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.376752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/54042d352c6b4bbb95af7eed835a7e37/roles/e637553524924775aa37f7b2ba619fe9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.387641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=54042d352c6b4bbb95af7eed835a7e37, role_id=e637553524924775aa37f7b2ba619fe9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.387641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.388664 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:06.405644 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 460/938] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:46:06 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/54042d352c6b4bbb95af7eed835a7e37/roles/e637553524924775aa37f7b2ba619fe9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:46:06.406651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.489493 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:06.591355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122f09-363e-4b49-aaf0-da68051e9fcb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.614484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544076e-aafc-4af4-94b4-74d7eb3fbb66 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.655545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.656168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.656455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.656766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.657455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:06.657858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.659403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.665718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 461/939] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:06.674901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.705227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.708523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.709785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.711120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.713979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:06.714770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.717611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.728468 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 479/940] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:06.734452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.804679 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:06.876176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b467-1060-48ce-90ee-c79817329ba4 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.927890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:06.929069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:06.932292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:06.932819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:06.933777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] RBAC: Adding query filter params (interface=public, service_id=dab9fdca27b64a729d64fe9f8e69a073, region_id=RegionOne) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:06.934294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:06.936127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:06.950273 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 462/941] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/endpoints?service_id=dab9fdca27b64a729d64fe9f8e69a073&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:06.951174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:06.959791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547ae6e-b989-4756-bd55-1e280358fd64 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:06.996593 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:07.004801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:07.005805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:07.006314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:07.007045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:07.008440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:07.009527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:07.011241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:07.017567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 480/942] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:07.023513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:07.073694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094a8a1-2982-4392-bac4-bd29af2beb93 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:07.100398 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:07.115119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:07.116368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:07.116877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:07.117470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:07.118389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:07.120046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d1d72-7a38-4ed7-8ca9-2efb8a703a6f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:07.127711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 463/943] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:06 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 00:46:07.142194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376789be-2053-473a-a56f-75afaeb5b21b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:07.186993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:07.187687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:07.187973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:07.188252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:07.188965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:07.190431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0ab1-1631-4b56-a5a6-dc5dd5f7cd6e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:07.216675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 481/944] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:07.757823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0939-372f-4264-abed-789e9b45c6dd None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:07.758016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0939-372f-4264-abed-789e9b45c6dd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:07.758289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0939-372f-4264-abed-789e9b45c6dd None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:07.760020 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 464/945] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:07.765579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:07.766015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:07.766225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:07.785674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:07.786985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:07.839511 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:07.868751 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 482/946] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:08.144947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0939-372f-4264-abed-789e9b45c6dd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:08.260607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0939-372f-4264-abed-789e9b45c6dd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:08.296680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:08.297296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:08.297621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:08.297896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:08.298635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:08.300086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:08.302812 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.common [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 25 00:46:08.322489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.sql.core [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:46:08.322489 n-d-master-1 devstack@keystone.service[81862]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 00:46:08.322489 n-d-master-1 devstack@keystone.service[81862]: [parameters: {'id': 'a10e16e1a4a241418c423172017c6445', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 00:46:08.322489 n-d-master-1 devstack@keystone.service[81862]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81862) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a10e16e1a4a241418c423172017c6445.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a10e16e1a4a241418c423172017c6445. Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:46:08.339170 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 25 00:46:08.340056 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application yield resource Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise self.value Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.commit() Sep 25 00:46:08.341184 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:46:08.342108 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:46:08.343005 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:46:08.343793 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [parameters: {'id': 'a10e16e1a4a241418c423172017c6445', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:08.344620 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:08.347494 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a10e16e1a4a241418c423172017c6445. Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:08.350651 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 465/947] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 25 00:46:08 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:08.359731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:08.481287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3641-a83b-455e-ae45-4cab17150c1f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:08.523433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:08.524096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:08.524379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:08.524702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:08.533162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:08.534962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2abdb3b9-7e17-4bf9-a2f7-a533be2af2c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:08.547593 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:08.549634 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:08.550729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 483/948] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:08.556444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:08.606117 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:08.669052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b03c-fb60-421b-844b-68f3cb42dbef None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:08.705096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:08.705757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:08.706038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:08.706313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:08.706998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] RBAC: Adding query filter params (name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:08.708005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:08.709768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792077b-b7f5-4ea8-b56c-3af081d6f034 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:08.735558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 466/949] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:08.846322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52ab81-bb8b-4194-9694-b63acf034cd3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:08.847331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52ab81-bb8b-4194-9694-b63acf034cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:08.848417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52ab81-bb8b-4194-9694-b63acf034cd3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:08.850387 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 484/950] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:08.855877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:08.856172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:08.856448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:08.882371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:08.884597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:08.964625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 467/951] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:09.238183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52ab81-bb8b-4194-9694-b63acf034cd3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:09.278162 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:09.351276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52ab81-bb8b-4194-9694-b63acf034cd3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:09.395956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c552d-b836-4427-a219-606912209d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:09.396934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c552d-b836-4427-a219-606912209d06 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.397382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c552d-b836-4427-a219-606912209d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.397860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c552d-b836-4427-a219-606912209d06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.423141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c552d-b836-4427-a219-606912209d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-580c552d-b836-4427-a219-606912209d06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:09.429879 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:09.431261 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:09.432336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:09.434929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 485/952] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:46:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:09.441013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:09.476151 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:09.530318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790182c5-fcbf-483e-8e87-d54541b3854a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.530654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790182c5-fcbf-483e-8e87-d54541b3854a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.530863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790182c5-fcbf-483e-8e87-d54541b3854a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.532520 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 486/953] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:09.538501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033b4-9ef5-403a-a1f8-854153b29ac9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.538799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033b4-9ef5-403a-a1f8-854153b29ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.539057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033b4-9ef5-403a-a1f8-854153b29ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.559779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e6c033b4-9ef5-403a-a1f8-854153b29ac9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:09.560981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6c033b4-9ef5-403a-a1f8-854153b29ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:09.583723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a2646-ecb6-4432-81fa-63b3a22a0479 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:09.623807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:09.624433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.624709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.624978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.625728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:09.625985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:09.627448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07752f57-608a-4589-8e1b-aa7667a196b4 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:09.636838 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 468/954] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:46:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:09.637961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc16-7fe3-4327-8d58-642a0ce99498 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.638274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc16-7fe3-4327-8d58-642a0ce99498 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.638522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc16-7fe3-4327-8d58-642a0ce99498 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.639881 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 469/955] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:09.649823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddbc16-7fe3-4327-8d58-642a0ce99498 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:09.650044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 487/956] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:09.650044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.650044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.650044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.673766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:09.676066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:09.710176 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:09.771899 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 488/957] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:09.779280 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:09.790337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddbc16-7fe3-4327-8d58-642a0ce99498 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:09.829843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:09.830838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:09.831353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:09.831838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:09.846808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:09.849744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:09.866295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:09.867344 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:09.868271 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:09.868271 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:09.868271 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:09.870566 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 470/958] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:09.878262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:09.927033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.013379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb461-9149-4634-bbb8-cdcefeeea446 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.052731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.053756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.054240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.054743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.055609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.056107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.056222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b7e08-74a1-4f46-a61d-fdeac558b25b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.057817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.070930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 489/959] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.072127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.091976 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.096269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.096923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.097181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.097485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.098108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.099491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:10.110295 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:10.111607 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:10.112691 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:10.117451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 471/960] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:10.117451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.131944 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.191116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79cd26-2657-4c27-a8bf-2314bcd699f7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.224503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae5743-8ed0-475f-b3ed-2e92cfc4b910 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.228621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.229335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.229707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.230045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.230759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.232315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:10.243671 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:10.244726 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:10.246288 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 490/961] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:10.247286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.263112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.263750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.264031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.264302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.272978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.274481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:10.286824 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:10.287814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 472/962] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:10.288748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.346601 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.366042 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.367278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83e99-22e0-4e00-aed6-543d4419534b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.404142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.404762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.405042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.405315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.405970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.406272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.407644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.407976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba655-b96c-4cae-a4e6-c803f635c0c2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.414341 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 491/963] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.414341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.452209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.452946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.453139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.453466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.454042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.455029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.455718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.465625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 473/964] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.465625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.534983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8928c6-8d31-43c2-9bf8-4b38d19d215f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.570675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacb0b-9f63-4251-980a-e74842f5ff79 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.571733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.572360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.572643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.572916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.573707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.574014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.575474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.596300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 492/965] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.598861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.602081 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.612393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.613008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.613308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.613619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.614257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.614604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.615932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.617355 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.630670 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 474/966] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.632158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.736548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579572ef-4260-44a7-bae2-25e3cf5761fb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.761789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a74a-fe1f-44e5-ac74-b4ee1d1daf3a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.785388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.786926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.787211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.787487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.788498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:10.788810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.790418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.801680 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 493/967] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:10.804423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:10.805044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.805707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.805988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.806258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.889657 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.892148 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:10.897437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.900316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8451aab-6e3f-4460-93e1-4f6275593cdf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:10.931506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9aec1-26df-4699-8594-c51151c8d188 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:10.978372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:10.979246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:10.979537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:10.979816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:10.981787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:10.983187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.011937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 494/968] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:11.039970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 475/969] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:11.045352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.099596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba52a1-7ed7-410b-981d-7f831cea6f2c None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.099919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba52a1-7ed7-410b-981d-7f831cea6f2c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.100188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba52a1-7ed7-410b-981d-7f831cea6f2c None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.105552 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 476/970] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:11.107687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.107983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.108263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.127813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:11.129765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:11.186197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afa7-13a9-43d2-9e4c-be1aba66ecc5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.212965 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:11.218485 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 477/971] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:11.237115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.237792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.238071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.238395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.250911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.252356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:11.268578 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:11.269700 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:11.270629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:11.270629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:11.270629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:11.270629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 495/972] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:11.275386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.309282 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:11.391816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e294293-b804-41b2-983c-1d2be13d11c8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.429830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.430448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.430729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.431001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.431653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:11.431958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.433338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.446558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 478/973] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:11.452026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.491357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.576028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381345-3206-4ca2-a424-ca4e7a9b07e3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.610274 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:11.620605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.621666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.622157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.622715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.627044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ac244-fd67-4b4f-a228-040eb4efeaf3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.631432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.633168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:11.647379 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:11.648363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:11.649270 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:11.652043 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 496/974] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:11.657270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.670136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.670764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.671046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.671323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.671976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.674058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.695607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.sql.core [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:46:11.695607 n-d-master-1 devstack@keystone.service[81862]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 00:46:11.695607 n-d-master-1 devstack@keystone.service[81862]: [parameters: {'user_id': 'd3eda8918c074c98b69ef75022b880c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 00:46:11.695607 n-d-master-1 devstack@keystone.service[81862]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81862) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 00:46:11.698278 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 00:46:11.707693 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:46:11.708656 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application yield resource Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise self.value Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.commit() Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 00:46:11.714822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.flush() Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application compat.raise_( Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 00:46:11.715729 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 00:46:11.717374 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 00:46:11.719861 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd3eda8918c074c98b69ef75022b880c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:11.721960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 25 00:46:11.724600 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 479/975] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 25 00:46:11 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:11.727209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.803776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c8e6-5a10-4b9b-995f-06f786d6b067 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.843220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.844241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.844780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.845296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.846225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:11.846774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.849376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.858187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95f66d-96ce-48ea-802d-afedee0670ce None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:11.865035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 497/976] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:11.873348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.902249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:11.903319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:11.903607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:11.903884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:11.915284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:11.916976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:11.932195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:11.933215 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:11.934555 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 480/977] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:11.940189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:11.960510 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:11.990542 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:12.001923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa52a-c35d-400d-94a8-f71de208877f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:12.047750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:12.048806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:12.049206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:12.049625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:12.050587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] RBAC: Adding query filter params (role.id=e637553524924775aa37f7b2ba619fe9, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=54042d352c6b4bbb95af7eed835a7e37) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:12.051090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:12.052727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59bc21-cf54-4654-8e20-ce09fd34ea50 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:12.065595 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 498/978] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/role_assignments?user.id=54042d352c6b4bbb95af7eed835a7e37&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=e637553524924775aa37f7b2ba619fe9 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:12.077912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4553a3-cd38-46d7-87fe-5ad53d1ae065 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:12.118134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:12.118859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:12.119141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:12.119421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:12.120134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:12.120441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:12.122079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ccc9-feb4-4518-93bb-2a86eb91c3c7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:12.166153 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 481/979] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 25 00:46:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:13.017687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1c3a-5d06-4c99-a470-f4df6c5c27e6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:13.018252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1c3a-5d06-4c99-a470-f4df6c5c27e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:13.018252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1c3a-5d06-4c99-a470-f4df6c5c27e6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:13.019831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 499/980] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:13.026186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c5a-d58c-4794-a4f3-b53ef5c8c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:13.026936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c5a-d58c-4794-a4f3-b53ef5c8c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:13.026936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c5a-d58c-4794-a4f3-b53ef5c8c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:13.055042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-89605c5a-d58c-4794-a4f3-b53ef5c8c0c4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:13.056580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-89605c5a-d58c-4794-a4f3-b53ef5c8c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:13.131632 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:13.139111 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 482/981] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:13.420045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1c3a-5d06-4c99-a470-f4df6c5c27e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:13.429153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065a9e-d8a3-4801-a3d7-4fadb2521e27 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:13.429538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065a9e-d8a3-4801-a3d7-4fadb2521e27 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:13.429752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065a9e-d8a3-4801-a3d7-4fadb2521e27 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:13.431627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 483/982] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:13.436828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:13.437607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:13.437607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:13.458075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:13.459296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:13.541198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 484/983] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:13.547462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1c3a-5d06-4c99-a470-f4df6c5c27e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:13.591077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:13.591688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:13.592033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:13.592310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:13.592981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:13.594405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:13.612815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 500/984] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:46:13 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:13.822645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:13.947337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cfd9-013d-4a90-9eff-b0b8b8f14327 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:13.977692 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:14.001144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:14.002263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.011374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.011374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.011374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:14.011374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:14.026471 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:14.030169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:14.031127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 485/985] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:14.037895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:14.062112 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:14.217938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ffe9-9860-4679-a5a1-69194114ed69 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:14.283650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:14.285030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.286032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.286310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.287014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:14.287321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:14.288854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936ffea-9c8e-4dc7-a1c7-c43c48d5546e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:14.305439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 501/986] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:14.308945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:14.369452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5ac7-8ba8-4705-be90-681987bb4435 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.369651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5ac7-8ba8-4705-be90-681987bb4435 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.369896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5ac7-8ba8-4705-be90-681987bb4435 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.371338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 502/987] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:14.376390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.376690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.376939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.397529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:14.398728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:14.478311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df343eb4-c9ab-474c-bbf0-a97d143d1957 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:14.484416 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 503/988] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:14.523991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:14.524745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.525028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.525319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.525952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:14.526251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:14.527628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:14.533957 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 486/989] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:14.540604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:14.555007 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:14.653461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5afc-8d14-4fc7-9114-55ae3007f752 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:14.689043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:14.689685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.689965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.690238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.690949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] RBAC: Adding query filter params (interface=admin, service_id=dab9fdca27b64a729d64fe9f8e69a073, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:14.691258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:14.692700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:14.701489 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 504/990] 10.222.0.16 () {56 vars in 1249 bytes} [Sun Sep 25 00:46:14 2022] GET /identity/v3/endpoints?service_id=dab9fdca27b64a729d64fe9f8e69a073&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:14.704047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:14.763980 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:14.820299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d19e03-2066-4c37-b72e-7794f6a0d94d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:14.835511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:14.862701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:14.863402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:14.863685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:14.864122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:14.864753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:14.866192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:14.874328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 487/991] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:14 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:46:14.944369 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:14.986034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de97-6d9f-488b-94d8-be7d5869a6b3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:15.025649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:15.026315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:15.026599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:15.026873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] PATH_INFO: `/v3/services/image` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:15.027475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:15.028902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:15.039225 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:15.046105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:15.047229 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 505/992] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 25 00:46:14 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:15.049345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:15.164949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf2fd-fc5b-408c-b59c-306b94b25c55 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:15.183503 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:15.203808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:15.204725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:15.205215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:15.205722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:15.206540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] RBAC: Adding query filter params (name=image) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:15.207167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:15.208921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cee0f-0b97-4560-9bcd-f1823b7d5867 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:15.214707 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 488/993] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:15.220104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:15.328840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ad72f-5567-4dec-a4ad-6e206a714f01 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:15.367383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:15.368405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:15.368866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:15.369355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:15.370243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] RBAC: Adding query filter params (type=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:15.370702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:15.372427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694ce0b-f1a6-4055-b526-aa391d732450 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:15.375356 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:15.384899 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 506/994] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:16.105698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f5d8-1df8-4134-92fa-b15e7d86236c None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:16.106498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f5d8-1df8-4134-92fa-b15e7d86236c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:16.106498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f5d8-1df8-4134-92fa-b15e7d86236c None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:16.107895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 489/995] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:16.116437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:16.117212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:16.117212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:16.136915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:16.138145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:16.217798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 507/996] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:16.509922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3f5d8-1df8-4134-92fa-b15e7d86236c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:16.619958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3f5d8-1df8-4134-92fa-b15e7d86236c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:16.656622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:16.657183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:16.657482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:16.657874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:16.658465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:16.659850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:16.670603 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:16.671670 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:16.672661 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:16.677357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 490/997] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:16.678779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:16.813556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c477-b5db-44d3-9388-2dc4fed309ca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:16.851105 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:16.859162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:16.859779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:16.860059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:16.860350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:16.861016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:16.861330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:16.862777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:16.869991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 508/998] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:16.875719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:16.958562 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:17.037114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2636e-98d3-4573-8191-606867262f95 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:17.077847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:17.078463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.078749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.079010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.079653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:17.079966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:17.081365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:17.087425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 491/999] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:17.093904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:17.278297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13898ba-3376-4b30-9538-4d255e4a29f5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:17.338996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:17.340003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.340531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.340998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.342316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] RBAC: Adding query filter params (interface=public, service_id=15298e5497cd4a1d96167b2ec5920929, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:17.342856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:17.345553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fbc7b-c001-49aa-8dbf-0e8439946177 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:17.360226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 509/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:46:17 2022] GET /identity/v3/endpoints?service_id=15298e5497cd4a1d96167b2ec5920929&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:17.361934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:17.472811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1be56-59b6-4ecb-a14f-9e537746c185 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.473301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1be56-59b6-4ecb-a14f-9e537746c185 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.473893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1be56-59b6-4ecb-a14f-9e537746c185 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.476422 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 510/1001] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:17.491362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e240-378a-4d58-8d09-f0b607539404 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.491807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e240-378a-4d58-8d09-f0b607539404 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.492227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e240-378a-4d58-8d09-f0b607539404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.528225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25c0e240-378a-4d58-8d09-f0b607539404 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:17.528504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25c0e240-378a-4d58-8d09-f0b607539404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:17.562621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12578-13ee-433c-8bc6-a083ba0e9f0d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:17.581023 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:17.623002 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:17.623448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:17.623963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.624251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.624535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.625659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:17.626999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f3eb-c164-4d2e-985a-8479cbf7eea8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:17.636690 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 492/1002] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:17 2022] GET /identity/v3/services => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:46:17.645483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 511/1003] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:17.700049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3fd8-b82d-45b6-9c14-827234fe572f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.700315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3fd8-b82d-45b6-9c14-827234fe572f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.700664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3fd8-b82d-45b6-9c14-827234fe572f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.702340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 493/1004] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:17.710305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:17.710921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:17.711513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:17.746043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:17.748188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:17.885059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 512/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:18.002368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de3fd8-b82d-45b6-9c14-827234fe572f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:18.184469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:18.187763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de3fd8-b82d-45b6-9c14-827234fe572f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:18.239020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:18.239646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:18.239917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:18.241103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:18.241103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:18.242180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:18.259054 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:18.260636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:18.262193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 494/1006] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 25 00:46:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:18.270187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:18.327179 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:18.355519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7411d4-25cf-4da6-801b-a9d39b888789 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:18.389083 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:18.420009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:18.421285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:18.421848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:18.422292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:18.423143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:18.424727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:18.447754 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 513/1007] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:46:18 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:18.459724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3c33-48c6-4034-b29e-b6bee44c0de3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:18.547513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:18.548540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:18.548926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:18.549361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:18.550117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:18.550431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:18.552753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:18.563958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 495/1008] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:18.565441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:18.745553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a3293-daa1-4218-9254-30f2849b2c9b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:18.794570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:18.795283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:18.795629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:18.795901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:18.796685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:18.797109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:18.798749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df8b2-ed22-433c-b946-f9176d8f0322 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:18.806427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 514/1009] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 25 00:46:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:18.813298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:18.957856 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:18.971322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e400475-89a8-41de-8747-1f03bc2fe8d0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:19.019050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:19.020539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:19.021060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:19.021636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:19.022512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:19.024263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492740-e26f-49d6-9bca-7fef5f197f03 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:19.049183 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 496/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:20.229216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009020ed-6079-4f25-b624-a38dd557a46a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:20.229803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009020ed-6079-4f25-b624-a38dd557a46a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:20.229803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009020ed-6079-4f25-b624-a38dd557a46a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:20.231566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 515/1011] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:20.238553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:20.239303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:20.239303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:20.262159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:20.263375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:20.359775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 497/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:20.648205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009020ed-6079-4f25-b624-a38dd557a46a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:20.703716 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:20.784408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009020ed-6079-4f25-b624-a38dd557a46a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:20.845951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:20.846932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:20.847226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:20.848258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:20.849086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:20.850569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-912bbe6d-2b51-4954-984f-71806246eba5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:20.861594 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:20.862859 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 25 00:46:20.863776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:20.865927 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 516/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:20.873505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:20.978321 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:21.001506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfe0c-69c1-4294-9ce5-1e778460661e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:21.003532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbabf1-ed24-42ad-9731-5db4785fcaf3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.004439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbabf1-ed24-42ad-9731-5db4785fcaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.004924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbabf1-ed24-42ad-9731-5db4785fcaf3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.007291 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 517/1014] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:21.014273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.014619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.014880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.037317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:21.038831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:21.062780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:21.063944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.064437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.064810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.065481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] RBAC: Adding query filter params (name=compute) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:21.065845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:21.067976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:21.081601 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 498/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:21.087608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:21.145599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 518/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:21.222304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8970-aaf3-46f9-9cfb-bb2fc636e2da None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:21.266037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:21.267863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.268476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.269006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.270452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:21.270992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:21.272596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:21.280042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 499/1017] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 25 00:46:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:21.288412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:21.338483 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:21.433804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:21.440457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fc063-fd64-49c1-8bd2-814d044dcd16 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:21.447576 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:21.484203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:21.485242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.485734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.486143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.487222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:21.490029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868629-a84a-4b5f-9e2b-5ccd79bf64af None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:21.514265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 519/1018] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:21.541340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014f7d-936d-4b76-aa44-fa18d684a0a6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.541630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014f7d-936d-4b76-aa44-fa18d684a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.541979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014f7d-936d-4b76-aa44-fa18d684a0a6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.543582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 520/1019] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:21.551638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.551925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.552314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.576209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:21.578926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:21.584868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddb27-2dd7-4b22-a496-95ea03f930e5 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:21.666710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:21.668349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.668854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.669321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] PATH_INFO: `/v3/services/image` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.670355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:21.673164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:21.684516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:21.685970 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:21.687279 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:21.691677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 500/1020] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 25 00:46:21 2022] GET /identity/v3/services/image => generated 86 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:21.692980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:21.704815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 521/1021] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:21.781107 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:21.821650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702661-b1cf-491f-8453-5fbc47ddf95c None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:21.862699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:21.863880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:21.864335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:21.864794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:21.865555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:21.865861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:21.867385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:21.873802 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 501/1022] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:21.882045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:21.916600 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:22.014350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab4d1-54a9-4fd6-933f-f4e9b2c01f44 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:22.017281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:22.061329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:22.062017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:22.062327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:22.062724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:22.063439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] RBAC: Adding query filter params (type=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:22.063855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:22.065349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:22.080042 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 522/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:22.081731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:22.161964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9bf2-1717-43e7-897c-4f3326cfddf2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:22.208648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:22.209444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:22.209760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:22.210038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:22.211423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:22.213284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:22.215616 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:22.215780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 502/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:22.221962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:22.225158 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:22.240022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9cd57-c4d8-47ed-a88e-c7ffbe0aa88d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:22.289235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:22.290233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:22.290233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:22.290552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:22.291262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] RBAC: Adding query filter params (interface=public, service_id=56b382447aea4274a32fed87f5f449c3, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:22.291569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:22.293117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:22.304330 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 523/1025] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:46:22 2022] GET /identity/v3/endpoints?service_id=56b382447aea4274a32fed87f5f449c3&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:22.306037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:22.382049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e113-a822-4aa2-a3ff-7f5dc2fe141d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:22.429250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:22.430036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:22.430187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:22.430432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:22.431095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:22.432557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db53e4-7627-42af-8f2a-69d879ba3508 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:22.466438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120273-5661-4a4d-8cf4-289b82ca601b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:22.485742 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 503/1026] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:46:22 2022] POST /identity/v3/projects => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:22.526974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:22.527611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:22.527947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:22.528595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:22.530069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:22.532690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ecd71-c50c-42a4-a7d4-7aa5cc6d2df8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:22.542601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 524/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:46:22 2022] GET /identity/v3/services => generated 1957 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 00:46:24.043519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2142-b20c-49f6-931c-9ed3e88c2cbc None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.044201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2142-b20c-49f6-931c-9ed3e88c2cbc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.044201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced2142-b20c-49f6-931c-9ed3e88c2cbc None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.046025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 504/1028] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:24.052006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.052495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.052575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.074522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:24.076036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:24.093314 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:24.190556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 525/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:24.484578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced2142-b20c-49f6-931c-9ed3e88c2cbc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:24.558751 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:24.614691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced2142-b20c-49f6-931c-9ed3e88c2cbc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:24.654378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:24.654929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.655252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.655480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.668022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8ea1ea93-046a-40ee-af8d-e361d38e43c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:24.672985 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:24.677733 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:24.678644 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 505/1030] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:46:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:24.680604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:24.853499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6602-bfd0-4f62-b56f-d4fa52f517f9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:24.871860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bba4c-668d-40d8-a210-e53d754f61f1 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.872288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bba4c-668d-40d8-a210-e53d754f61f1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.872692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bba4c-668d-40d8-a210-e53d754f61f1 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.877249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 506/1031] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:24.888149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcdd2-137b-4334-9a72-cd67e0a9e688 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.888623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcdd2-137b-4334-9a72-cd67e0a9e688 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.889043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcdd2-137b-4334-9a72-cd67e0a9e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.912396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:24.913060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:24.913247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d8fbcdd2-137b-4334-9a72-cd67e0a9e688 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:24.913374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:24.913629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:24.914312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:24.914616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:24.914740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d8fbcdd2-137b-4334-9a72-cd67e0a9e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:24.916001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:24.927107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 526/1032] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:46:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:24.933870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:24.946848 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.043835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 507/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:25.046107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a42-eaa9-4812-a130-d67ff0db9742 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.046401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a42-eaa9-4812-a130-d67ff0db9742 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.046675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a42-eaa9-4812-a130-d67ff0db9742 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.048251 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 508/1034] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:25.055843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.056248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.056404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.061602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9dbb-2bc2-47e3-9932-f8ca055ee9b5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.078984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:25.080347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:25.116938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.117852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.118271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.118437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.135568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.137836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.139596 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:25.161777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:25.162979 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:25.163946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:25.163946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:25.163946 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:25.170441 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 527/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:25.171984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.174964 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 509/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:25.275675 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.342428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.349125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecabe-5a62-47d1-8b0c-3d6db6090e34 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.420149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.420748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.421292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.421672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.422963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:25.423420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.427597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.448149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 528/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:25.455308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.477821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605bb25-a15d-4a6c-bf81-d9d625d78c8a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.516226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.516901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.517201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.517497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.518619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.520563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.522292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 510/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:25.523085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.582917 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.598722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a024-ccf2-497f-8d1c-e3bd98af2836 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.621083 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.643470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.644139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.644524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.644986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.653484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.654985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.662123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513f3aa-6484-411b-851f-33c08273a52a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:25.673363 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:25.674443 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:25.675492 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 529/1039] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:25.677654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.703977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.704622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.704899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.705170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] PATH_INFO: `/v3/services/image` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.705798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.708059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:25.724779 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:25.725912 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 25 00:46:25.726787 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:25.727595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 511/1040] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:25.728516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.804464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215902c-e397-40bb-9e41-63b71362e55f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.843915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.844245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3647a2-4c15-4613-89e3-92f2b944d25d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:25.844539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.844816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.845090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.845795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.847421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.853370 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.877176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 530/1041] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:46:25 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:25.878463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:25.910913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:25.911555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:25.911887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:25.912167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:25.912944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:25.913260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:25.914805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:25.934669 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:25.937586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 512/1042] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:25.946696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:26.059962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b033bc-702a-42b7-b81e-f67c9387a380 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.114168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1854c4-5cd0-4034-a338-6de5d3797342 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.117524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.118270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.118652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.118960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.119585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] RBAC: Adding query filter params (name=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:26.119935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.121519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.130018 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 531/1043] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:26.137835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:26.169236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.170101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.170585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.171062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.218189 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:26.274997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.276598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.305285 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:26.309785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0264-debe-43bc-9d78-4b1bf05f43ba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.356569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.357199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.357510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.357891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.358430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] RBAC: Adding query filter params (type=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:26.358771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.360119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.366205 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 532/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:26.371829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:26.427951 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 513/1045] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:46:26.434621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:26.521972 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:26.530917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c40a2-dfa1-4702-bdd4-c0616db3c70a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.568172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca537-d9d5-41e0-9ac3-d2e7fdec4373 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.572730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.573355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.573669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.573948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.574638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.576383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.609762 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 533/1046] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:46:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:46:26.619386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.620184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.620519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.620998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.636357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.638248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:26.656838 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:26.658179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:26.660071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:26.660071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:26.660071 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:26.660071 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 514/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:26.664973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:26.693962 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:26.815560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95fb3-8730-46d4-b330-4844f71f4c58 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:26.867378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:26.868019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:26.868315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:26.868568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:26.869242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:26.869617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:26.871072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:26.887254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 534/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:26.893809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:27.098893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386ac-794f-4310-8e60-99f0886b2720 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:27.120330 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:27.156443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:27.157229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:27.157498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:27.157770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:27.167666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:27.169163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:27.183520 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:27.184516 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:27.185560 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 515/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:27.194210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:27.296088 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:27.322786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b4a6-a74f-4894-9c81-36f268213374 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:27.363825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:27.364590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:27.364962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:27.365330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:27.366347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:27.366658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:27.368112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065207c9-5837-47bd-99f8-73ca88bc8fb5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:27.387359 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 535/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:27.390719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:27.532927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a48657-da1c-45f9-a9cf-c9621aa5f793 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:27.580752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:27.581564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:27.582306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:27.582679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:27.583590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] RBAC: Adding query filter params (role.id=e637553524924775aa37f7b2ba619fe9, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:27.583907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:27.585803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cc9e5-449d-41bf-8073-50912e4124f0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:27.601427 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 516/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:27 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=e637553524924775aa37f7b2ba619fe9 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:28.448600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499f4f-3c18-46a8-9122-4e3785115e0f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:28.449188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499f4f-3c18-46a8-9122-4e3785115e0f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:28.449188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499f4f-3c18-46a8-9122-4e3785115e0f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:28.450625 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 536/1052] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:28.457763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:28.457763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:28.457763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:28.478126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:28.479345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:28.513099 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:28.567930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 517/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:28.844077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499f4f-3c18-46a8-9122-4e3785115e0f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:28.972177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499f4f-3c18-46a8-9122-4e3785115e0f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.013145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.013835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.014116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.014392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.024614 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.034071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-03381839-6076-4890-bb18-a5072b87e194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:29.042811 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:29.045876 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:29.046745 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 537/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:29.052571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.065817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945b305-4591-4b54-b551-5865e65c50e2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.066578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945b305-4591-4b54-b551-5865e65c50e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.066873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945b305-4591-4b54-b551-5865e65c50e2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.068637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 538/1055] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:29.074953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.075291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.075500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.097936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:29.099227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:29.175018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb23a3-b94b-4f5f-8850-d39cdc81efc6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.187176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 539/1056] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:29.219352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.219965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.220246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.220518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.221191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:29.221548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.224099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:29.239046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 518/1057] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:29.240381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.356728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aada36-3ab6-48db-8c15-6e6125f7a249 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.390972 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.400631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.401457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.401873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.402298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] PATH_INFO: `/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.420854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] RBAC: Authorizing `identity:get_user(user_id=ec2381d15e6e4b5cb3fc98f036d11fd6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.422615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:29.429728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 540/1058] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:29.431303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.462193 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.467953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.548348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f95549-8883-4f7d-aad7-0744bab1bd10 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.585556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f7f4d-f14e-4442-9745-353f4207fbce None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.586949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.587567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.587849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.588782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.624765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.625346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.625677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.625949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.661282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.662932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:29.686950 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.694410 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.703998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.705504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:29.785494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 519/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:46:29.786555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.821607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 541/1060] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:29.830833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.892560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662007f3-4891-4c2a-9844-4320b2d1bdc6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.919501 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.919702 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:29.928779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.929428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.929704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.929972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.931069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.932492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d16b33-ba9a-41c1-9a86-c9aff8ebd1af None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:29.934210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 520/1061] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:29.935074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef796-8ded-4708-b44f-03997856fab7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:29.935402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e516-2187-4f98-bf9c-421110341a00 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.935683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e516-2187-4f98-bf9c-421110341a00 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.935951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e516-2187-4f98-bf9c-421110341a00 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.937137 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 521/1062] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:29.940090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923e516-2187-4f98-bf9c-421110341a00 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:29.975480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:29.976122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:29.976400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:29.976671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:29.986748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:29.988353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-83146e2f-631c-4513-92e3-b558fb61da97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:30.007153 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:30.008194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:30.009830 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:30.009830 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:30.009830 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:30.009830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 542/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:30.009830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.010198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.010278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.029131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:30.030357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:30.045788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923e516-2187-4f98-bf9c-421110341a00 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:30.083757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:30.084316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.084658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.085006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.085786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a, user.id=ec2381d15e6e4b5cb3fc98f036d11fd6) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:30.086093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:30.087535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:30.093617 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 522/1064] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:29 2022] GET /identity/v3/role_assignments?user.id=ec2381d15e6e4b5cb3fc98f036d11fd6&scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:30.094666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:30.129437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 543/1065] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:30.181632 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:30.229203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9021f-722c-4dd9-9d5d-4f1d61c871c5 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:30.267057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:30.267681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.267964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.268239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.269970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:30.269970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:30.271430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:30.285067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 523/1066] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:30.398546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:30.473411 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:30.509832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82500596-5870-4fe6-86aa-105115f6f27f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:30.548825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:30.549500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.549785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.550056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.561581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:30.567017 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:30.568255 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:30.569105 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 544/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:46:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:30.574412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:30.685819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834c15f-551f-4bc7-8341-2fac6f598508 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:30.705768 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:30.719830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:30.720439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.720721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.720995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.721690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:30.721993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:30.724125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:30.732184 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 524/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:46:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:30.738011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:30.838698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e87713-8d27-433d-91ba-a51444dab3d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:30.865132 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:30.873607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:30.874263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:30.874545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:30.874820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:30.885834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:30.887307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:30.902575 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:30.903566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:30.904502 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:30.904502 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:30.904502 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:30.904502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 545/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:30.909664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.012702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78ae-3018-44ed-8afc-51e82ca82fe2 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.046646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.047246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.047526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.047793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.048431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:31.048730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.050130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.062803 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 525/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:31.068353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.176764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8034-6c44-47b4-89c3-e08e45099a2b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.212134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.212791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.213076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.213355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.222594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.224270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:31.236978 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:31.238688 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:31.239629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 546/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:31.245957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.289976 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:31.346913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b30a7-f710-45f3-ac78-5f9963ec1817 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.382088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.382701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.382980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.383248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.383982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:31.384556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.386011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.405279 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 526/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:31.412106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.456597 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:31.518374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf79b-6044-4b9f-9e9a-3d241c2a5d6e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.552886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.553469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.553751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.554021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.564421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.565893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:31.580568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:31.581838 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:31.582755 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:31.582755 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:31.582755 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:31.585556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 547/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:31.587674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.684756 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:31.687961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc7c7-8561-4695-ab58-d649635aa2e6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.724932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.725650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.725933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.726206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.726847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:31.727181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.728733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.741052 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 527/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:31.746567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:31.839955 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:31.849815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353ec7-0142-4dce-8e39-d628d7a1d6c3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:31.885122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:31.885783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:31.886058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:31.886324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:31.892973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:31.894838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:31.906139 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:31.907092 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:31.907999 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 548/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:31.913945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:32.022107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5d37-3d79-417d-8644-5ff8e6ac75e0 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:32.056399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:32.057001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:32.057278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:32.057578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:32.058268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:32.058569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:32.059993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec82c6-fb2f-4e4b-9e48-8a0391995ac5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:32.073363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 528/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:32.079640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:32.193359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd3f84-ea00-4fd1-b766-b5899e805608 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:32.230106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:32.230792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:32.231093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:32.231363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/e637553524924775aa37f7b2ba619fe9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:32.233672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=664154bf7b8d4ec9b0be57b37687ecb3, role_id=e637553524924775aa37f7b2ba619fe9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:32.235144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20745980-6193-4be6-b1d4-7d4bbd49dadf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:32.250618 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 549/1077] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:46:32 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/664154bf7b8d4ec9b0be57b37687ecb3/roles/e637553524924775aa37f7b2ba619fe9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:46:32.343984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85947aee-0d30-40b8-bdaf-d11d2da50350 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:32.344267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85947aee-0d30-40b8-bdaf-d11d2da50350 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:32.344540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85947aee-0d30-40b8-bdaf-d11d2da50350 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:32.346174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 529/1078] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:32.351956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:32.352244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:32.352523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:32.371834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:32.373078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:32.382729 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:32.453974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 550/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:32.731855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85947aee-0d30-40b8-bdaf-d11d2da50350 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:32.754614 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:32.836676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85947aee-0d30-40b8-bdaf-d11d2da50350 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:32.870515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:32.871135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:32.871409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:32.871679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:32.882235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:32.887232 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:32.888410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:32.889450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 530/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:32.894468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:32.995273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd1bf0-6894-44bb-842b-2ddcf12f6f27 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:33.029107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:33.029746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:33.030031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:33.030329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:33.030996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:33.031300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:33.032665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:33.041283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 551/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:33.047267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:33.152404 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:33.172860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6168-ef7d-46eb-8b1a-bfcc50786b86 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:33.207624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:33.208404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:33.208685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:33.208960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] PATH_INFO: `/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:33.210159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] RBAC: Authorizing `identity:get_user(user_id=ec2381d15e6e4b5cb3fc98f036d11fd6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:33.211601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:33.213194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 531/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:33 2022] GET /identity/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:33.219016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:33.223545 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:33.327296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d722-406a-4563-9376-18f18b9bc30c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:33.364735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:33.365383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:33.365694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:33.365970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:33.367153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:33.368909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72c49-3f10-492d-9afd-996e1153e654 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:33.370673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 552/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:33 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:33.376847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:33.488610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e97c31-7212-4277-92a6-8e0cbc55d810 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:33.526146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:33.526821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:33.527101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:33.527372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a/users/ec2381d15e6e4b5cb3fc98f036d11fd6/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:33.529318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca8fcd331e4e4ee4be3f0df6f944485a, user_id=ec2381d15e6e4b5cb3fc98f036d11fd6, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:33.530824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b6ea-c5af-4beb-b2cc-28af93191e38 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:33.545172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 532/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:46:33 2022] PUT /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a/users/ec2381d15e6e4b5cb3fc98f036d11fd6/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:46:34.476338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a47a5-da3f-4c5b-b6f0-3eb39a77601c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:34.476858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a47a5-da3f-4c5b-b6f0-3eb39a77601c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:34.476858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a47a5-da3f-4c5b-b6f0-3eb39a77601c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:34.478248 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 553/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:34.483479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:34.483901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:34.484035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:34.502021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:34.503905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:34.505961 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:34.574613 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 533/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:34.848980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a47a5-da3f-4c5b-b6f0-3eb39a77601c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:34.920213 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:34.950982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a47a5-da3f-4c5b-b6f0-3eb39a77601c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:34.984191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:34.984822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:34.985139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:34.985381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:34.996604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:35.001421 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:35.002505 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:35.003404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 554/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 25 00:46:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:35.008817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.114508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34bfd0-0245-4432-9c00-cd4224f5dda3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.147883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.148494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.148775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.149047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.149761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:35.150059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:35.151428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:35.156564 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:35.165339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 534/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:35.166510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.267478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e2dc-c205-4d70-b519-f40c71f95aad None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.296682 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:35.302712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.303341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.303618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.303889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.314460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:35.316455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:35.330418 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:35.332266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:35.333265 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:35.333265 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:35.333265 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:35.333265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 555/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:35.337818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.442941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfe9ec-31f7-4b66-99e9-93d4c3ef7f35 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.476284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.476893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.477170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.477464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.478109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:35.478407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:35.479767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:35.492499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 535/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:35.498265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.603020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63725-be6e-4717-a691-1ed7db771694 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.638766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.639344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.639628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.639902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.649181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:35.650715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2bfd0ad7-2019-4df1-8bb4-039dab4de88f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:46:35.663256 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:35.664512 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 25 00:46:35.665742 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:35.669449 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 556/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:35.670454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.731604 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:35.761919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb0b5-210e-4f43-ac12-3a1453ab5598 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.762212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb0b5-210e-4f43-ac12-3a1453ab5598 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.762480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb0b5-210e-4f43-ac12-3a1453ab5598 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.763796 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 557/1092] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:35.768765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502e12-88cc-454c-91a2-49e5247854af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.769611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502e12-88cc-454c-91a2-49e5247854af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.770044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502e12-88cc-454c-91a2-49e5247854af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.775095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463108-e97a-476a-894e-8210b9091b0a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.788851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-84502e12-88cc-454c-91a2-49e5247854af None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:35.790091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84502e12-88cc-454c-91a2-49e5247854af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:35.810223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.810827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.811110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.811380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:35.812104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:35.812400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:35.813870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:35.832191 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 536/1093] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:35.833227 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:35.837891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:35.860594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 558/1094] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:35.939435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715accb-dfc6-428d-84c7-ef103680e4fc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:35.957901 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:35.975487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:35.976100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:35.976382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:35.976656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.044104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.045608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.139288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502e12-88cc-454c-91a2-49e5247854af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.153414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 537/1095] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:46:36.159439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.178554 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.250253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502e12-88cc-454c-91a2-49e5247854af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.267701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea15e-ae87-475d-bd00-77fe8955f86b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.287731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.288369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.288646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.288922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.299281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:36.304743 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:36.305925 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:36.306786 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:36.307458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.307458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.307614 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 559/1096] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:36.307692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.307692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.311847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.319034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.320496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:46:36.335475 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:36.336476 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:46:36.337370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:46:36.337370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:46:36.337370 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:36.337370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 538/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:36.342341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.346682 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.422298 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.425822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a9d82-b108-43f2-81bf-eeb1559ea01e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.455481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d537d-7b88-4ed2-acc5-bcb3fad26616 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.460445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.461049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.461323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.461620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.462285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:36.462582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.463949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.472086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 560/1098] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:36.478214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.490646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.491267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.491551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.491829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.492480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:36.492785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.494249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.507466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 539/1099] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:36.513309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.577881 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.584078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e8aa3-6ebb-4d67-bb07-5ee0b2acbeaf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.614270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb2051-7c87-4290-a0f4-1e1b63090afd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.618738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.619377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.619660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.619938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] PATH_INFO: `/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.621073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] RBAC: Authorizing `identity:get_user(user_id=ec2381d15e6e4b5cb3fc98f036d11fd6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.622564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.624146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 561/1100] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/users/ec2381d15e6e4b5cb3fc98f036d11fd6 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:36.629979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.646785 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.653142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.653804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.654083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.654361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.661975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.663433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:46:36.674755 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:36.675973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:46:36.677073 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:46:36.677626 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 540/1101] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:46:36.681751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.734801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebffdd0-aabe-42c6-8ebd-0820b17e9d10 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.771626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.771626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.771626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.771626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.787728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf348fa-6eb0-42ef-9532-a109e51c02df None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.802769 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.823458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.824082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.824360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.824635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.825334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:36.825670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.827112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.839236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 541/1102] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:36.842949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.844399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.845187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.898706 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:36.953469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e6a15-8f2e-4c92-a230-66071fcc0d77 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:36.955414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 562/1103] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:46:36.962762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:36.989003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:36.989625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:36.989907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:36.990178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:36.990903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] RBAC: Adding query filter params (role.id=e637553524924775aa37f7b2ba619fe9, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=664154bf7b8d4ec9b0be57b37687ecb3) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:36.991213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:36.992644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:36.998338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 542/1104] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/role_assignments?user.id=664154bf7b8d4ec9b0be57b37687ecb3&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=e637553524924775aa37f7b2ba619fe9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:37.028925 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:37.072201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8055bb-5f02-4a22-9024-d1306cd62d57 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:37.110605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:37.111254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:37.111538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:37.111815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:37.113791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:37.115397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bd595-0476-4b8b-899a-b7b3c0b0b091 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:37.117130 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 563/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:36 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:37.123776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:37.235103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc57e-5593-435f-8f60-2411a1a78242 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:37.249997 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:37.273075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:37.273737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:37.274027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:37.274301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:37.275056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a, user.id=ec2381d15e6e4b5cb3fc98f036d11fd6) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:37.275366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:37.277138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f845-c1ec-4e2b-9bfa-be772e2e8e80 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:37.289304 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 543/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:37 2022] GET /identity/v3/role_assignments?user.id=ec2381d15e6e4b5cb3fc98f036d11fd6&scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:39.573792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576477d7-9b30-404e-b2f3-9dffe2d79021 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:39.574319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576477d7-9b30-404e-b2f3-9dffe2d79021 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:39.574484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576477d7-9b30-404e-b2f3-9dffe2d79021 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:39.576637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 564/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:39.583039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:39.583466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:39.583585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:39.602962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:39.604216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:39.675869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 544/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:39.950764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576477d7-9b30-404e-b2f3-9dffe2d79021 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:40.061140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576477d7-9b30-404e-b2f3-9dffe2d79021 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:40.093727 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:40.099686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:40.100359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:40.100639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:40.100982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:40.102275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:40.103727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfe650-2b74-471b-a783-d54cb0323a8a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:40.105318 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 565/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:40.111287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:40.220304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92167b-810d-41fd-a8c2-241de666e35a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:40.230498 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:40.257629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:40.258276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:40.258515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:40.258783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:40.259683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:40.261133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb8096-e401-4f59-803b-9e35b6165b0a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:40.282574 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 545/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:46:40 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:42.529380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833044-c2c5-4970-81e6-912182f0a45c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:42.529958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833044-c2c5-4970-81e6-912182f0a45c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:42.529958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833044-c2c5-4970-81e6-912182f0a45c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:42.531274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 566/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:42.536856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:42.537303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:42.537394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:42.556268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:42.557500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:42.624172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 546/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:42.912687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58833044-c2c5-4970-81e6-912182f0a45c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:43.020013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58833044-c2c5-4970-81e6-912182f0a45c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:43.056391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:43.057031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:43.057313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:43.057617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] PATH_INFO: `/v3/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:43.059027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] RBAC: Authorizing `identity:get_role(role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:43.060411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:43.061796 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 567/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:42 2022] GET /identity/v3/roles/43b01aadcec14574861255a746ef1a34 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:43.070878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:43.176795 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:43.184299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e80c5-5967-4975-9a77-55fd89de18e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:43.220204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:43.220835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:43.221110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:43.221375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] PATH_INFO: `/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:43.235093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c20dadbb0c42bca007e61c1d0c1c92)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:43.236545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:43.239183 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 547/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:43 2022] GET /identity/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:46:43.245012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:43.313380 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:43.349094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717ea9b-f52e-4871-8359-f3c560dc4206 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:43.392839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:43.393487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:43.393770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:43.394042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:43.470225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:43.471597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:43.540167 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:43.577176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 568/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:43.583882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:43.683904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb63f-41b2-4dc0-81c7-80978d8a83b1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:43.717636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fccf57-6659-4708-a985-d87202033240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:43.718264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fccf57-6659-4708-a985-d87202033240 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:43.718544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fccf57-6659-4708-a985-d87202033240 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:43.718816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fccf57-6659-4708-a985-d87202033240 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:43.719926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fccf57-6659-4708-a985-d87202033240 None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:43.721450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fccf57-6659-4708-a985-d87202033240 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:43.723776 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 548/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:43 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:43.730070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:43.833126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4b985-e3e7-4fd4-85ba-990174136bfb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:43.873907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:43.874518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:43.874799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:43.875071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:43.875803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a, user.id=f6c20dadbb0c42bca007e61c1d0c1c92) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:43.876110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:43.877586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6138a6-3d34-47a8-b9a6-e2e1f04c9a33 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:43.884132 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 569/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:43 2022] GET /identity/v3/role_assignments?user.id=f6c20dadbb0c42bca007e61c1d0c1c92&scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a&role.id=43b01aadcec14574861255a746ef1a34 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:46.057022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9fbeb-4478-4505-ba67-caec076f6bea None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:46.057685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9fbeb-4478-4505-ba67-caec076f6bea None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:46.057685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9fbeb-4478-4505-ba67-caec076f6bea None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:46.058967 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 549/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:46:46.064525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:46.064965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:46.065073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:46.085554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:46.086766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:46.114764 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:46.158419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 570/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:46.436193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9fbeb-4478-4505-ba67-caec076f6bea None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:46.458518 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:46.545321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9fbeb-4478-4505-ba67-caec076f6bea None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:46.579349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:46.579971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:46.580255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:46.580527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] PATH_INFO: `/v3/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:46.582538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] RBAC: Authorizing `identity:get_role(role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:46.583906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:46.585240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 550/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:46 2022] GET /identity/v3/roles/43b01aadcec14574861255a746ef1a34 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:46.591379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:46.689670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f4c7-75ae-418e-8f55-03d81b3bc7df None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:46.723874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:46.724508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:46.724788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:46.725059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] PATH_INFO: `/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:46.726218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c20dadbb0c42bca007e61c1d0c1c92)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:46.727645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:46.729254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 571/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:46 2022] GET /identity/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:46.735185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:46.826944 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:46.840875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f83f-443a-487b-8c7c-664968b0fce3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:46.876767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:46.877487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:46.877818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:46.878165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:46.879944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:46.881423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed868c-552e-46f9-ac3d-98c4d3c93341 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:46.883103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 551/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:46 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:46.889521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:46.922176 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:46.995564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea714d3-64a1-471e-9750-19f630e719d0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:47.029549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:47.030200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:47.030480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:47.030752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a/users/f6c20dadbb0c42bca007e61c1d0c1c92/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:47.032866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca8fcd331e4e4ee4be3f0df6f944485a, user_id=f6c20dadbb0c42bca007e61c1d0c1c92, role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:47.034969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a65de-0468-4c19-a691-b69cb4330005 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:47.047380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 572/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:46:46 2022] PUT /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a/users/f6c20dadbb0c42bca007e61c1d0c1c92/roles/43b01aadcec14574861255a746ef1a34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:46:49.185072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c612f-8c77-444e-865b-fa077958b9d5 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:49.185744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c612f-8c77-444e-865b-fa077958b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:49.185744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c612f-8c77-444e-865b-fa077958b9d5 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:49.186992 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 552/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:49.192591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:49.193153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:49.193153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:49.211566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:49.212748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:49.277844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 573/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:49.545319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c612f-8c77-444e-865b-fa077958b9d5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:49.646765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c612f-8c77-444e-865b-fa077958b9d5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:49.679653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:49.680282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:49.680566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:49.680840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] PATH_INFO: `/v3/roles/43b01aadcec14574861255a746ef1a34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:49.682258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] RBAC: Authorizing `identity:get_role(role_id=43b01aadcec14574861255a746ef1a34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:49.683633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:49.684976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 553/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:49 2022] GET /identity/v3/roles/43b01aadcec14574861255a746ef1a34 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:49.691409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:49.712830 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:49.790053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35c7d3-dbb3-4ed1-9df0-0fe89dacbb0e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:49.823182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:49.823739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:49.824015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:49.824285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] PATH_INFO: `/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:49.825392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c20dadbb0c42bca007e61c1d0c1c92)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:49.826841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:49.828395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 574/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:49 2022] GET /identity/v3/users/f6c20dadbb0c42bca007e61c1d0c1c92 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:49.834615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:49.863182 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:49.942841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372b596-445e-4b5f-8b2a-16af21ed7095 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:49.977600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:49.978199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:49.978480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:49.978754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:50.043498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:50.044932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:50.067933 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:50.141330 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 554/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:50.147881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:50.234055 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:50.246010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb6b78-c483-4e33-8ea4-a314f5119bd1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:50.280549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:50.281223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:50.281596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:50.281910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] PATH_INFO: `/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:50.283049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] RBAC: Authorizing `identity:get_project(project_id=ca8fcd331e4e4ee4be3f0df6f944485a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:50.284512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9633-ebc8-46e7-8cf4-4ae536694edb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:50.286170 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 575/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:50 2022] GET /identity/v3/projects/ca8fcd331e4e4ee4be3f0df6f944485a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:50.292347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:50.389322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b527d8-ddf6-4dce-a093-c37f68710719 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:50.413273 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:50.424734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:50.425350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:50.425666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:50.425942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:50.426714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] RBAC: Adding query filter params (role.id=43b01aadcec14574861255a746ef1a34, scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a, user.id=f6c20dadbb0c42bca007e61c1d0c1c92) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:50.427028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:50.428478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e94e11-3d12-4e16-ade9-65eaaf4c4844 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:50.434784 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 555/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:50 2022] GET /identity/v3/role_assignments?user.id=f6c20dadbb0c42bca007e61c1d0c1c92&scope.project.id=ca8fcd331e4e4ee4be3f0df6f944485a&role.id=43b01aadcec14574861255a746ef1a34 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:52.659128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b8a-3541-4ea8-99d3-30a1b81ef52e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:52.659658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b8a-3541-4ea8-99d3-30a1b81ef52e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:52.659754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b8a-3541-4ea8-99d3-30a1b81ef52e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:52.661110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 576/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:52.666668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:52.667113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:52.667216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:52.685688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:52.686898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:52.756673 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 556/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:53.031116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1b8a-3541-4ea8-99d3-30a1b81ef52e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:53.140600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1b8a-3541-4ea8-99d3-30a1b81ef52e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:53.174234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:53.174899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:53.175703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:53.176084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:53.177221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:53.178694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20050306-15ec-40be-b2ce-658f9746a980 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:53.180267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 577/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:53.186190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:53.286319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddb1fd-5205-4944-81b7-80c2004c8d9b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:53.303100 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:53.320461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:53.321067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:53.321340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:53.321639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:53.322284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:53.323713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8448e7-f6ea-4f48-916f-c09b2619389b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:53.350755 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 557/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:46:53 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:55.587806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a493-af3d-41e6-9116-531ac22afd4e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:55.588363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a493-af3d-41e6-9116-531ac22afd4e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:55.588363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a493-af3d-41e6-9116-531ac22afd4e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:55.589749 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 578/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:55.595268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:55.595705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:55.595803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:55.614042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:55.615250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:55.683405 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 558/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:46:55.957052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a493-af3d-41e6-9116-531ac22afd4e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:55.982294 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:56.057247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a493-af3d-41e6-9116-531ac22afd4e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:56.090523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:56.091144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:56.091422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:56.091694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:56.092793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:56.094264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7812740-eb17-453e-adf8-50088e7af8ed None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:56.095808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 579/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:56.101829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:56.196533 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:56.199488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46977790-c4b1-4c73-84c2-a5f847a670e4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:56.234484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:56.235020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:56.235301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:56.235571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:56.236212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:56.237706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e9b5-f8ba-4eae-838d-4811bd99a2cd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:56.259387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 559/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:46:56 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:46:58.492660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01cd31-fcae-423e-9f53-5113e715a938 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:58.493191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01cd31-fcae-423e-9f53-5113e715a938 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:58.493191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01cd31-fcae-423e-9f53-5113e715a938 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:58.494544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 580/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:46:58.499967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:58.500420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:58.500522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:58.520793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:46:58.522052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:46:58.590382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 560/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:46:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:46:58.867827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01cd31-fcae-423e-9f53-5113e715a938 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:58.963811 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:58.974298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01cd31-fcae-423e-9f53-5113e715a938 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.008817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.009474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.010016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.010290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.021249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:46:59.026094 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:46:59.027077 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:46:59.028032 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 581/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:46:59.033358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:59.118650 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:59.135445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1a25-6cbd-4ef8-ae55-c32805adb004 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.170260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.170880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.171160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.171429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.172100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:59.172399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:59.173808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:59.182285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 561/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:59.188375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:59.290314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78af93d-4735-4918-94a1-b62f1cee309f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.326649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.327290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.327572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.327846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] PATH_INFO: `/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.341819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] RBAC: Authorizing `identity:get_user(user_id=7cf49e5f3d2d46ddb2ae901341c55d49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:59.343300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:59.344924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 582/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:46:59 2022] GET /identity/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:59.350818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:59.452286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca1d0-5582-4909-adcd-aee6d60a4836 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.485702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.486301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.486580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.486851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.504122 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:59.558201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:59.559666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:59.667038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 562/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:46:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:46:59.673031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:59.685550 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:59.789107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4b14-fd03-4065-be25-655c8d6a3f0a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.822816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.823435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.823714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.823986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] PATH_INFO: `/v3/projects/e2f973550db44a1dadac3014aba78d3c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.825085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] RBAC: Authorizing `identity:get_project(project_id=e2f973550db44a1dadac3014aba78d3c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:59.826558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b1db-10cd-4fed-86ba-024a273c6581 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:59.828158 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 583/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:46:59 2022] GET /identity/v3/projects/e2f973550db44a1dadac3014aba78d3c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:46:59.834596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:46:59.882747 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:46:59.934835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526c49-21d8-469d-bdcc-2ebb0591ffc3 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:46:59.969753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:46:59.970353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:46:59.970633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:46:59.970901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:46:59.972115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=e2f973550db44a1dadac3014aba78d3c, user.id=7cf49e5f3d2d46ddb2ae901341c55d49) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:46:59.972418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:46:59.974143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20d19c-1cdf-47b4-9378-9782cf60439f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:46:59.979426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 563/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:46:59 2022] GET /identity/v3/role_assignments?user.id=7cf49e5f3d2d46ddb2ae901341c55d49&scope.project.id=e2f973550db44a1dadac3014aba78d3c&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:02.163826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a10c-2fd7-42f7-bf17-beb4512c7586 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:02.164370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a10c-2fd7-42f7-bf17-beb4512c7586 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:02.164370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a10c-2fd7-42f7-bf17-beb4512c7586 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:02.165735 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 584/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:02.170973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:02.171388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:02.171519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:02.190080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:02.194268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:02.260652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 564/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:02.532026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a10c-2fd7-42f7-bf17-beb4512c7586 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:02.611809 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:02.634561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a10c-2fd7-42f7-bf17-beb4512c7586 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:02.668469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:02.669097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:02.669371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:02.669671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:02.680744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:47:02.685537 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:02.686708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:47:02.687657 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 585/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:47:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:47:02.693716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:02.736958 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:02.794429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168ac4-0eb5-4281-9c09-6c9fd339f388 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:02.828229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:02.828831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:02.829108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:02.829375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:02.830068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:02.830366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:02.832628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:02.840716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 565/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:47:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:02.846647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:02.946214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3e74-9abc-4b52-888e-de62cb5fe11b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:02.979402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:02.980022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:02.980303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:02.980577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] PATH_INFO: `/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:02.981732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf49e5f3d2d46ddb2ae901341c55d49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:02.983175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:02.984744 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 586/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:47:02 2022] GET /identity/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:02.991416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:03.089656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf67b70-4086-4765-aaec-d378a6feb4cc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:03.092256 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:03.127606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:03.128782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:03.129075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:03.129470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] PATH_INFO: `/v3/projects/e2f973550db44a1dadac3014aba78d3c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:03.130705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] RBAC: Authorizing `identity:get_project(project_id=e2f973550db44a1dadac3014aba78d3c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:03.132205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c38342-8ae7-49b4-b6a1-7bc599d077b9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:03.133949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 566/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:47:02 2022] GET /identity/v3/projects/e2f973550db44a1dadac3014aba78d3c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:03.140621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:03.150636 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:03.246546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836448b-6719-400f-9a3d-8800852ef725 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:03.279909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:03.280566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:03.280849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:03.281124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] PATH_INFO: `/v3/projects/e2f973550db44a1dadac3014aba78d3c/users/7cf49e5f3d2d46ddb2ae901341c55d49/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:03.283063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] RBAC: Authorizing `identity:create_grant(project_id=e2f973550db44a1dadac3014aba78d3c, user_id=7cf49e5f3d2d46ddb2ae901341c55d49, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:03.284663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ce76-b4d4-4300-b1b1-0d113bff94be None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:03.297776 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 587/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:47:03 2022] PUT /identity/v3/projects/e2f973550db44a1dadac3014aba78d3c/users/7cf49e5f3d2d46ddb2ae901341c55d49/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:47:05.483018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11628d-76cb-4384-b085-39df0b19dd8f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:05.483605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11628d-76cb-4384-b085-39df0b19dd8f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:05.483605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11628d-76cb-4384-b085-39df0b19dd8f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:05.484926 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 567/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:05.491584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:05.492092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:05.492214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:05.517579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:05.519952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:05.617052 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:05.630847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 588/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:05.905719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11628d-76cb-4384-b085-39df0b19dd8f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.010108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11628d-76cb-4384-b085-39df0b19dd8f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:06.050601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:06.051236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.051512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.051779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.062299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:47:06.067269 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:06.068694 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:47:06.069814 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 568/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:47:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:47:06.074671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.183352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c7fe-18a7-43cf-ac9f-ee6676750d1d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:06.219384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:06.219994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.220269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.220539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.221232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:06.221596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:06.222968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:06.231315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 589/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:06.238345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.271164 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:06.351351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00778e-5f98-46cb-8054-e4bba417031a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:06.389153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:06.389787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.390067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.390334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] PATH_INFO: `/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.391477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf49e5f3d2d46ddb2ae901341c55d49)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:06.392907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:06.395592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 569/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:47:06 2022] GET /identity/v3/users/7cf49e5f3d2d46ddb2ae901341c55d49 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:06.402126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.466021 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:06.513433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa401-e455-4735-871c-3741e69446a0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:06.553204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:06.553843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.554122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.554393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.623949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:06.625437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:06.684217 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:06.728184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 590/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:47:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:47:06.734732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.832423 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:06.835540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f822a-9778-44ac-9eb8-8b68b2ed6459 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:06.869972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:06.870593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:06.870873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:06.871147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] PATH_INFO: `/v3/projects/e2f973550db44a1dadac3014aba78d3c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:06.872249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] RBAC: Authorizing `identity:get_project(project_id=e2f973550db44a1dadac3014aba78d3c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:06.873707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff367266-c09a-498d-a1c4-680fd2fac907 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:06.875332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 570/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:47:06 2022] GET /identity/v3/projects/e2f973550db44a1dadac3014aba78d3c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:06.881630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:06.982754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbfb01-034d-4916-b060-d65da19a042a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:07.020304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:07.020922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:07.021205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:07.021515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:07.022258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=e2f973550db44a1dadac3014aba78d3c, user.id=7cf49e5f3d2d46ddb2ae901341c55d49) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:07.022565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:07.024010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1025-758a-4b37-a87f-3189c4e33cf7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:07.030181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 591/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:47:06 2022] GET /identity/v3/role_assignments?user.id=7cf49e5f3d2d46ddb2ae901341c55d49&scope.project.id=e2f973550db44a1dadac3014aba78d3c&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:09.255764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff811-7d75-4b59-a426-95a074399a38 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:09.256334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff811-7d75-4b59-a426-95a074399a38 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:09.256334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff811-7d75-4b59-a426-95a074399a38 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:09.257685 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 571/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:09.263610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:09.264075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:09.264161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:09.286684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:09.288402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:09.310274 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:09.362822 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 592/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:09.633777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff811-7d75-4b59-a426-95a074399a38 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:09.735191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff811-7d75-4b59-a426-95a074399a38 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:09.770261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:09.770865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:09.771143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:09.771418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:09.805745 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:09.839484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:09.840948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:09.939819 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 572/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:47:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:47:09.946467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:10.046592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a9fd-4cfc-45c3-9885-46b11d7000fb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:10.081105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:10.082105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:10.082361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:10.082630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:10.089343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:10.090817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5bf05551-eaac-4444-944a-fe65290d35aa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:10.103708 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:10.104932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:47:10.105837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 593/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:47:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:47:10.114451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:10.180022 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:10.213268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873e3c-b30e-4e9b-9ffc-0b4d6156320d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:10.247320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:10.247923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:10.248204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:10.248476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:10.249114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:10.249470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:10.250846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363fea7-f09c-4dc4-8086-d8a71fbf0fb7 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:10.258390 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 573/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 25 00:47:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:12.432428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382d1-4524-46d6-abb2-435ae6ec33e0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:12.432954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382d1-4524-46d6-abb2-435ae6ec33e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:12.432954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382d1-4524-46d6-abb2-435ae6ec33e0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:12.434329 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 594/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:47:12.439830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d61f5-1759-463f-ae9f-6a4113262fba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:12.440820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d61f5-1759-463f-ae9f-6a4113262fba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:12.441062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d61f5-1759-463f-ae9f-6a4113262fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:12.459931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6a8d61f5-1759-463f-ae9f-6a4113262fba None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:12.461127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a8d61f5-1759-463f-ae9f-6a4113262fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:12.535860 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 574/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:12.803029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992382d1-4524-46d6-abb2-435ae6ec33e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:12.818299 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:12.905086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992382d1-4524-46d6-abb2-435ae6ec33e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:12.939782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:12.940424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:12.940702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:12.940961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:12.941677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:12.943058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c7d06-c511-492b-99f5-24e9b5091770 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:12.960188 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 595/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sun Sep 25 00:47:12 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:47:15.211453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1486a-9791-4737-bf43-f179c060db1e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:15.212046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1486a-9791-4737-bf43-f179c060db1e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:15.212411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1486a-9791-4737-bf43-f179c060db1e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:15.214999 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 575/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:15.222088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:15.222675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:15.222675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:15.242348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:15.243628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:15.319839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 596/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:15.590811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1486a-9791-4737-bf43-f179c060db1e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:15.662453 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:15.705382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1486a-9791-4737-bf43-f179c060db1e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:15.743987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:15.744619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:15.744894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:15.745164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] PATH_INFO: `/v3/domains/7c962d9909aa4dad8219e563af4e37c5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:15.756740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c962d9909aa4dad8219e563af4e37c5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:15.758227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0617609-b27d-4c13-ad09-f91cddfd6dad None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:15.760174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 576/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 25 00:47:15 2022] GET /identity/v3/domains/7c962d9909aa4dad8219e563af4e37c5 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:47:15.766357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:15.768785 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:15.876546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5274ced-5a89-4c06-aa6d-37f01001bee5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:15.915608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:15.916283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:15.916607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:15.916922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:15.917661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:15.919207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e11aa-04b3-418b-8c3d-6228292c40f4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:15.950505 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 597/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:47:15 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 00:47:18.238823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d925d29-1916-4d33-8336-b82938cb6be8 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.239476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d925d29-1916-4d33-8336-b82938cb6be8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.239476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d925d29-1916-4d33-8336-b82938cb6be8 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.240700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 577/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:18.246247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.246696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.246790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.266235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:18.267426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:18.317944 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:18.345207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 598/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:18.620628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d925d29-1916-4d33-8336-b82938cb6be8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:18.748562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d925d29-1916-4d33-8336-b82938cb6be8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:18.777912 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:18.793067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:18.793806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.794129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.794460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] PATH_INFO: `/v3/domains/7c962d9909aa4dad8219e563af4e37c5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.795792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c962d9909aa4dad8219e563af4e37c5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:18.797303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0560d-deb3-4e86-ba8f-dc1469a62fb5 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:18.800409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 578/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 25 00:47:18 2022] GET /identity/v3/domains/7c962d9909aa4dad8219e563af4e37c5 => generated 267 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:47:18.806930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:18.946948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331141-3c34-4534-ae9c-a295a5316334 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:18.990277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:18.990902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:18.991181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:18.991451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:18.992120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:18.993624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a64c5-3301-493a-842e-0b633c7efd0b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:19.027033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 599/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:47:18 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:47:21.398523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb865-6a48-4152-86f8-b46077547ccf None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:21.399144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb865-6a48-4152-86f8-b46077547ccf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:21.399144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb865-6a48-4152-86f8-b46077547ccf None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:21.400428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 579/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:47:21.407694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:21.408264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:21.408492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:21.430727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:21.431942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:21.470812 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:21.506702 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 600/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:47:21.790354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb865-6a48-4152-86f8-b46077547ccf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:21.903149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb865-6a48-4152-86f8-b46077547ccf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:21.945081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:21.945747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:21.946028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:21.946299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:21.957721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:47:21.962652 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:21.963836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:47:21.964792 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 580/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:47:21.971214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:22.083433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedac8a-ea65-46ce-8491-f25e7bf84550 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:22.120251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:22.120870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:22.121150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:22.121450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:22.122130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:22.122435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:22.123831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:22.133742 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 601/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:22.140023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:22.196845 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:22.263069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a81-85f9-4cdb-ad7e-7cb7ff108046 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:22.300304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:22.300966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:22.301248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:22.301565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] PATH_INFO: `/v3/users/3b250c0799b24cb09f7ed019a04434fa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:22.318740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] RBAC: Authorizing `identity:get_user(user_id=3b250c0799b24cb09f7ed019a04434fa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:22.320255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:22.322102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 581/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:47:22 2022] GET /identity/v3/users/3b250c0799b24cb09f7ed019a04434fa => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:22.328620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:22.367556 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:22.450670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146d5c5-7bda-4d76-9418-30592a27ed66 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:22.488028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:22.488652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:22.488932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:22.489202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:22.564009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:22.566443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:22.603178 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:22.683451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 602/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:47:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 25 00:47:22.689556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:22.791127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef73-d332-4165-8934-b6571361221d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:22.801663 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:22.828681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:22.829302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:22.829678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:22.829950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] PATH_INFO: `/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:22.831751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] RBAC: Authorizing `identity:get_project(project_id=b53abcd6a83b4a78bc5b651cf80519f4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:22.833174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75a8af-20b2-42b7-8364-fec2fc534885 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:22.834845 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 582/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:47:22 2022] GET /identity/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:22.841045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:22.942712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0fc5b-e803-482f-aede-e9b0b3a2af4a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:22.971489 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:22.976769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:22.977382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:22.977690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:22.977965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:22.978698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=b53abcd6a83b4a78bc5b651cf80519f4, user.id=3b250c0799b24cb09f7ed019a04434fa) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:22.979006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:22.980451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23247-d6af-4138-a15a-f1a900fcf0ea None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:22.986219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 603/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:47:22 2022] GET /identity/v3/role_assignments?user.id=3b250c0799b24cb09f7ed019a04434fa&scope.project.id=b53abcd6a83b4a78bc5b651cf80519f4&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:25.172762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79512ad-a165-4f34-9da6-c94b38d9c63b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:25.173364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79512ad-a165-4f34-9da6-c94b38d9c63b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:25.173364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79512ad-a165-4f34-9da6-c94b38d9c63b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:25.175326 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 583/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:25.180702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:25.181156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:25.181258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:25.199575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:25.200775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:25.270402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 604/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:25.540089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79512ad-a165-4f34-9da6-c94b38d9c63b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:25.648410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79512ad-a165-4f34-9da6-c94b38d9c63b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:25.686365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:25.687009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:25.687288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:25.687559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:25.700093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:47:25.706640 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:25.708048 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:47:25.708897 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 584/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:47:25.714542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:25.826308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d89dc-9a84-4010-a870-f3492c0c6a94 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:25.855758 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:25.865839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:25.866464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:25.866744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:25.867017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:25.867686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:25.867981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:25.869359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:25.878352 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 605/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:25.884313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:25.920051 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:25.988137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d503-03b8-4508-9e33-2f7f271cf58a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:26.023107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:26.023737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:26.024016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:26.024287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] PATH_INFO: `/v3/users/3b250c0799b24cb09f7ed019a04434fa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:26.025450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] RBAC: Authorizing `identity:get_user(user_id=3b250c0799b24cb09f7ed019a04434fa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:26.026899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:26.028499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 585/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:47:25 2022] GET /identity/v3/users/3b250c0799b24cb09f7ed019a04434fa => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:26.034650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:26.136042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dbdc8-fc4b-483a-bfc6-6505603f27c3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:26.169377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b757987-a17a-4878-841c-084241a0585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:26.170028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b757987-a17a-4878-841c-084241a0585f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:26.170311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b757987-a17a-4878-841c-084241a0585f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:26.170586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b757987-a17a-4878-841c-084241a0585f None admin] PATH_INFO: `/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:26.171714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b757987-a17a-4878-841c-084241a0585f None admin] RBAC: Authorizing `identity:get_project(project_id=b53abcd6a83b4a78bc5b651cf80519f4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:26.173157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b757987-a17a-4878-841c-084241a0585f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:26.175399 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 606/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:47:26 2022] GET /identity/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:47:26.181437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:26.279739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c26f-bc46-469b-85d7-6ae1b5ce3782 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:26.282066 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:26.315987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:26.316639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:26.316921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:26.317196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] PATH_INFO: `/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4/users/3b250c0799b24cb09f7ed019a04434fa/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:26.319118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] RBAC: Authorizing `identity:create_grant(project_id=b53abcd6a83b4a78bc5b651cf80519f4, user_id=3b250c0799b24cb09f7ed019a04434fa, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:26.320556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859f8a-be2a-4137-a9f4-d3ef8861956a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:26.333571 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 586/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:47:26 2022] PUT /identity/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4/users/3b250c0799b24cb09f7ed019a04434fa/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:47:28.488570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f862b5-d0b4-4339-a498-e165ddb7f9c3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:28.489190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f862b5-d0b4-4339-a498-e165ddb7f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:28.489190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f862b5-d0b4-4339-a498-e165ddb7f9c3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:28.490483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 607/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:47:28.496076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:28.496499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:28.496622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:28.518818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:47:28.520017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:47:28.591581 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 587/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:47:28.865218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f862b5-d0b4-4339-a498-e165ddb7f9c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:28.922892 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:28.968108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f862b5-d0b4-4339-a498-e165ddb7f9c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.003432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.004054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.004333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.004606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.015092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:47:29.019945 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:47:29.021032 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:47:29.022147 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 608/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:47:29.027184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:29.120315 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:29.128807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba874-f92b-4982-9da4-d0d6c19be2ac None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.164892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.165528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.165807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.166080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.166771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:29.167071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:29.168473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:29.177458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 588/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:29.183600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:29.281645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac69911-5c31-41cf-abe5-6032051aee4a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.298696 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:29.317215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.317892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.318172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.318447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] PATH_INFO: `/v3/users/3b250c0799b24cb09f7ed019a04434fa` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.319588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] RBAC: Authorizing `identity:get_user(user_id=3b250c0799b24cb09f7ed019a04434fa)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:29.321035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:29.322689 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 609/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 25 00:47:29 2022] GET /identity/v3/users/3b250c0799b24cb09f7ed019a04434fa => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:29.328845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:29.436141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a84ae-8e4f-4429-8a10-843f0db7923d None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.470162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.470774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.471798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.472234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.498424 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:29.544522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:29.546038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:29.651818 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 589/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:47:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:47:29.658220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:29.760557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73abc6-7e64-4f6e-8d83-bef517e6143b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.802480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.803125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.803402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.803672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] PATH_INFO: `/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.804822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] RBAC: Authorizing `identity:get_project(project_id=b53abcd6a83b4a78bc5b651cf80519f4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:29.806300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b8f10-02c7-446d-ade1-a807794cc271 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:29.807980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 610/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 25 00:47:29 2022] GET /identity/v3/projects/b53abcd6a83b4a78bc5b651cf80519f4 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:29.814702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:47:29.876729 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:29.937218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893fa6a-0bf8-452f-842a-ffc93b1105a8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:47:29.972161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:47:29.972761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:47:29.973043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:47:29.973315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:47:29.974081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=b53abcd6a83b4a78bc5b651cf80519f4, user.id=3b250c0799b24cb09f7ed019a04434fa) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:47:29.974394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:47:29.975836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a15d9-d4c9-466c-9fec-c4ed8b0b8f39 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:47:29.981915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 590/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:47:29 2022] GET /identity/v3/role_assignments?user.id=3b250c0799b24cb09f7ed019a04434fa&scope.project.id=b53abcd6a83b4a78bc5b651cf80519f4&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:47:39.797133 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=74 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:47:39.979013 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=40 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:29.177191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be90560-f759-4099-8e5e-b1a5b3ce66b0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:29.177896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be90560-f759-4099-8e5e-b1a5b3ce66b0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:29.178456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be90560-f759-4099-8e5e-b1a5b3ce66b0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:29.181197 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 611/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:29.189541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:29.190079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:29.190079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:29.212343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:29.213995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:29.309586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 591/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:48:29.627793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be90560-f759-4099-8e5e-b1a5b3ce66b0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:29.817124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be90560-f759-4099-8e5e-b1a5b3ce66b0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:29.871791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:29.872514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:29.877490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:29.877490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:29.887628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:29.889480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:29.911913 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:29.913297 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:29.914478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:29.914478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:29.914478 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:29.914478 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 612/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:29.921925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:30.057647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4f22-ab54-4d3e-866d-1685d63977d9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:30.092673 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:30.101462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:30.102109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:30.102395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:30.102668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:30.103334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:30.103679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:30.105039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801ae0-f834-4cd5-b1c4-b0ffd5335dcb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:30.119052 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 592/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:30.125174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:30.190052 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:30.243650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10cba-ff39-492c-b3e8-fa642ce809e0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:30.287952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:30.288648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:30.288960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:30.289391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:30.290338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:30.292403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9dd31-f86c-4408-9d49-5f2a0f8dd7ab None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:30.323221 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 613/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 25 00:48:30 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:48:33.298257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952be5-1ff3-4fc1-b88c-954a5e6a79a7 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:33.299071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952be5-1ff3-4fc1-b88c-954a5e6a79a7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:33.299071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952be5-1ff3-4fc1-b88c-954a5e6a79a7 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:33.300460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 593/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:48:33.307533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478119-35b6-4310-ba98-242048efe433 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:33.308102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478119-35b6-4310-ba98-242048efe433 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:33.308102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478119-35b6-4310-ba98-242048efe433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:33.336738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d5478119-35b6-4310-ba98-242048efe433 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:33.338067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5478119-35b6-4310-ba98-242048efe433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:33.471145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 614/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:48:33.868262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952be5-1ff3-4fc1-b88c-954a5e6a79a7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:34.086124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952be5-1ff3-4fc1-b88c-954a5e6a79a7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:34.132931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:34.133545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.133786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.134018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.146635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:48:34.151930 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:34.153387 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:34.154503 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 594/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:48:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:34.167169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5478119-35b6-4310-ba98-242048efe433 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:34.266823 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:34.371103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5478119-35b6-4310-ba98-242048efe433 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:34.412581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:34.413252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.413585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.413853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.414539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:34.414841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:34.416489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:34.427309 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 615/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:48:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:34.433465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:34.497553 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:34.557562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00089d3a-ac11-4331-b312-daf5cceea1a1 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:34.605616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:34.606290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.606619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.606861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.624512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:34.626948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:34.645846 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:34.646939 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:34.648505 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:34.648505 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:34.648505 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:34.648505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 595/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:34.653928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:34.803144 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:34.806863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cb9b5-13b8-4a66-808f-478d2a2e929b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:34.848859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:34.849586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:34.849872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:34.850147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:34.851000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:34.851309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:34.853067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:34.869020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 616/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:34.878464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:35.011635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d243-8355-42ee-b86a-5f8248b98514 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:35.013676 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:35.059432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:35.060213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:35.060493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:35.060820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:35.070474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:35.072242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:48:35.087197 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:35.088784 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:35.090090 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 596/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:35.096204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:35.269773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1c5b-4707-4f7d-aeb4-34b390c17744 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:35.319133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:35.320086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:35.320414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:35.320722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:35.321725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:35.322234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:35.328104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:35.351498 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 617/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:48:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:35.360964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:35.522351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908f8f-89c9-4653-b438-8e49e4eff63e None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:35.564738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:35.565397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:35.565725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:35.565972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:35.624885 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:35.689206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:35.692588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:35.847099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 597/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:48:35.848433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:35.875312 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:36.005342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe69ff-d80f-4f72-9644-03e7a964fb9a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:36.064972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:36.065683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.065951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.066251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.080476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:36.082087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:36.100122 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:36.101368 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:36.102635 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:36.102635 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:36.102635 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:36.105968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 618/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:36.106927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:36.193030 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:36.254254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72baf9-27c5-48c8-adf5-d623273f6766 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:36.296613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:36.297223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.298080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.298351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.299006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:36.299300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:36.300778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:36.316249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 598/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:36.321815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:36.434627 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:36.492455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea84c-5658-4bbc-9bbb-b36253a6e9c4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:36.552661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:36.553322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.553623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.553899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.564771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:36.567482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:48:36.581396 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:36.582649 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:36.588993 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 619/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:36.589677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:36.732854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da74f8-2346-4f00-b26c-7bad91a63e5b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:36.777878 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:36.798086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:36.799114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:36.799605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:36.800048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:36.800985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:36.801496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:36.803174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def6e8d-6734-49eb-a306-01c897f1da30 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:36.819263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 599/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:36.830150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:36.966372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cef4c-f793-4980-9f64-a60cf539419f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:37.013626 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:37.021027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:37.021675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:37.021954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:37.022228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:37.023181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=d9805de18a574ac1bba25ba2a64ebae7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:37.023452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:37.024996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34b5c-9436-465a-8d23-2eae98ade153 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:37.033436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 620/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:48:36 2022] GET /identity/v3/role_assignments?user.id=d9805de18a574ac1bba25ba2a64ebae7&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:39.438043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2230b-ee48-4f2e-8e8b-d7d74413558c None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:39.438816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2230b-ee48-4f2e-8e8b-d7d74413558c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:39.438816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2230b-ee48-4f2e-8e8b-d7d74413558c None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:39.440200 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 600/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:39.447160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:39.447936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:39.448102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:39.471624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:39.472987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:39.579678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 621/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:48:39.884117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2230b-ee48-4f2e-8e8b-d7d74413558c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.020716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2230b-ee48-4f2e-8e8b-d7d74413558c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:40.066938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:40.068011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.068498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.069011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.086744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:48:40.092469 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:40.095202 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:40.096973 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 601/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:48:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:40.103122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.261633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16435b1-3447-4a85-bb28-4e8f318dcad0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:40.302601 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:40.320201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:40.321150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.321653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.322118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.323301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:40.323847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:40.326336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:40.338640 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 622/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:48:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:40.345379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.407823 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:40.504937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1afb-df18-4e26-8856-3bdc0de6d210 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:40.549539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:40.550187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.550470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.550738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.562227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:40.564376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:40.588732 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:40.590636 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:40.592027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:40.592027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:40.592027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:40.592027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 602/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:40.598867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.739125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ffd0-e2c5-4204-8eda-7d3fa225f060 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:40.792857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:40.793506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:40.793790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:40.794068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:40.794731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:40.795034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:40.796444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:40.812414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 623/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:40.819942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:40.961816 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:40.972228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d63d-e8b0-4a6e-9c3f-660659a425fb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:41.019383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:41.020179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.020583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.021034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.031973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:41.034232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:48:41.052143 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:41.062582 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:41.064812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 603/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:41.066192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:41.127979 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:41.199476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fded3-f8bb-4334-9c70-14ba818da7e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:41.238044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:41.238658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.238933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.239199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.240244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:41.240544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:41.242128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:41.280012 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 624/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:48:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:41.284451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:41.421529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed734b-5e0e-4c7e-a4ab-13abab8a80db None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:41.475570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:41.476619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.477104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.477619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.493482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:41.495116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:41.517461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:41.520263 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:41.521976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:41.521976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:41.521976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:41.521976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 604/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:41.526565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:41.667532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861791-64bc-4824-9840-79226c7ea553 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:41.671641 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:41.731078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:41.732138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.732676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.733137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.734382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:41.735548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:41.738104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:41.758831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 625/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:41.772885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:41.790880 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:41.922650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0f7ab-38c2-4098-93dd-c04ec7ece527 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:41.977320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:41.978313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:41.978695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:41.979162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:41.989517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:41.991442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:48:42.008157 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:42.009375 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:42.010464 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 605/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:48:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:42.017911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:42.145427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078432-aa31-417a-a96e-6d80d8777830 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:42.184983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:42.185590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:42.185935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:42.186217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:42.187006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:42.187268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:42.188745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb28abf-b457-49ee-88e3-b7c051dbadbf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:42.210446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 626/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:42.212446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:42.299798 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:42.346187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533485-4db4-42b9-876b-45d1e8e1743f None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:42.396539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:42.397264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:42.397595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:42.397875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/d9805de18a574ac1bba25ba2a64ebae7/roles/9ce0f22277aa4334a240bdfb529af9fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:42.419287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=d9805de18a574ac1bba25ba2a64ebae7, role_id=9ce0f22277aa4334a240bdfb529af9fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:42.420890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71466a9-044d-459c-931d-0b59f3873118 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:42.437060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 606/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:48:42 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/d9805de18a574ac1bba25ba2a64ebae7/roles/9ce0f22277aa4334a240bdfb529af9fc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:48:45.127030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188e22-6d60-48e1-a3fd-605c0f374ff5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.127726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188e22-6d60-48e1-a3fd-605c0f374ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.127828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188e22-6d60-48e1-a3fd-605c0f374ff5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.129142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 627/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:45.135408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.136470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.136470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.155673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:45.157617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:45.243414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 607/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 25 00:48:45.536616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188e22-6d60-48e1-a3fd-605c0f374ff5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:45.565533 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:45.685500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188e22-6d60-48e1-a3fd-605c0f374ff5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:45.729760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:45.730419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.730698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.730970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.743448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:48:45.749511 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:45.751657 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:45.752889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 628/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 25 00:48:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:45.758029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:45.826824 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:45.898225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d854-9e8f-4c03-a1e7-546ee121b221 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:45.941115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:45.941658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:45.941935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:45.942210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:45.942888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] RBAC: Adding query filter params (name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:45.943186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:45.944570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:45.953883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 608/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 25 00:48:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:45.960122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:46.080547 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:46.101750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9996-02e8-4195-ad1c-a23529e7f397 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:46.153061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:46.154357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:46.154948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:46.155398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:46.168925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:46.170652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:46.190304 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:46.191730 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:46.192887 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:46.192887 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:46.192887 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:46.192887 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 629/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:46.199672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:46.348147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde9aff-6644-4824-88e2-f8b7b9aa727a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:46.361710 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:46.402394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:46.403285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:46.403710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:46.404121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:46.405059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:46.405499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:46.408086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:46.423428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 609/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:46.430676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:46.579604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb97b5-8d0e-41a2-8dbf-372fb33ff534 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:46.622585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:46.623282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:46.623561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:46.623832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:46.627342 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:46.633813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:46.635704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:48:46.648400 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:46.649787 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:46.650817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 630/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:46.655733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:46.803767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fe27b-a091-455a-9c93-27799fc723a6 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:46.847993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:46.848517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:46.848795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:46.849069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:46.849840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:46.850144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:46.851583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:46.870475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 610/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:48:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:46.877147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:47.022021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4c8fb-30c7-4542-9e1c-dca35d1d1e4b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:47.074493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:47.075232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:47.075458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:47.075766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:47.156183 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:47.168168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:47.169909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:47.308004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 631/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:48:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:48:47.315237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:47.358861 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:47.488697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8667aee-4e67-4dc9-b3ad-7d386b15e6e8 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:47.539611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:47.540278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:47.540563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:47.540840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:47.554850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:47.557651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:47.587426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:47.588884 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:47.590353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:47.590353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:47.590353 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:47.590353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 611/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:47.598095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:47.748496 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:47.757337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387664c3-a99f-4177-a33d-f09475845a19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:47.809283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:47.810285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:47.810782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:47.811237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:47.812073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:47.812448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:47.814677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:47.830410 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 632/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:48:47.837881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:47.958160 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:47.987179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e9ecf-d2c6-4da7-8aa6-28a95389d62a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:48.035882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:48.036550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.036835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.037145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.046574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:48.048349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:48:48.064681 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:48.066586 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:48.067707 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 612/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:48.076518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:48.238861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92079-1648-443a-bbed-e32643e941d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:48.286425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:48.286963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.287290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.287580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.288603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:48.288950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:48.290785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4bf-159a-4405-adf0-c7bc6b759426 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:48.306067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 633/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:48.313438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:48.454775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128016f1-b065-49b3-8335-859f030f9a76 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:48.494833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:48.495599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:48.495893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:48.496153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:48.497088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] RBAC: Adding query filter params (role.id=9ce0f22277aa4334a240bdfb529af9fc, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=d9805de18a574ac1bba25ba2a64ebae7) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:48.497350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:48.498989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2ca8-84d6-4276-9c7a-02bfa553e9d9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:48.505791 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 613/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:48:48 2022] GET /identity/v3/role_assignments?user.id=d9805de18a574ac1bba25ba2a64ebae7&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=9ce0f22277aa4334a240bdfb529af9fc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:50.816788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cacc-acf8-428d-bfff-ab2f0d292cb6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:50.817709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cacc-acf8-428d-bfff-ab2f0d292cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:50.817709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cacc-acf8-428d-bfff-ab2f0d292cb6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:50.819684 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 634/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:48:50.826799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:50.827351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:50.827732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:50.835595 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:50.851659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:50.852892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:50.949656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 614/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:48:51.245733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516cacc-acf8-428d-bfff-ab2f0d292cb6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:51.267046 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:51.378073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516cacc-acf8-428d-bfff-ab2f0d292cb6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:51.432344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:51.432988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.433261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.433563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:51.445248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:48:51.450145 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:51.452111 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:51.454453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 635/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:51.458178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:51.600326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31b3f-d91f-4782-a6b9-36f42d69b8d2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:51.640775 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:51.647190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:51.648009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.648458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.648758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:51.649468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:51.649764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:51.651160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:51.660425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 615/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:48:51.666438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:51.774493 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:51.808833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15851-7173-4cca-a5ea-41ed0f22dace None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:51.856180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:51.856885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:51.857053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:51.857317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:51.869673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:51.871278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:51.887888 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:51.889738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:51.890898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:51.890898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:51.890898 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:51.894659 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 636/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:51.896115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:52.010543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8b94-532b-4a81-b6f4-dc79a99b239a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:52.049249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:52.049906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:52.050181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:52.050464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:52.051186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:52.051492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:52.052936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:52.066364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 616/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:52.072924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:52.197364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769f41a-86b0-43b3-8a43-4dba35d5eaac None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:52.231278 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:52.245548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:52.246230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:52.246597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:52.246876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:52.255414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:52.256880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:48:52.269963 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:52.271339 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:52.272420 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 637/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:52.283291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:52.350399 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:52.414096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edfeb8-66b9-47bc-97f7-67ff38a687cc None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:52.457304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:52.458323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:52.458830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:52.459301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:52.460634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:52.461174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:52.463754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:52.485635 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 617/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:48:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:52.492035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:52.626538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6bf9d-5fd4-4963-81ba-e1bc7cf88b12 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:52.667126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:52.667852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:52.668193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:52.668526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:52.739917 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:52.755122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:52.757379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:52.918353 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 638/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:48:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:48:52.924535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:53.062147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d038-333c-44be-aea3-fadb48355bc9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:53.084687 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:53.117231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:53.117954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:53.118376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:53.118572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:53.134975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:53.137752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:53.158653 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:53.159927 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:53.160982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:53.160982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:53.160982 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:53.160982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 618/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:53.166095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:53.281746 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:53.297276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1db36-80c4-4de5-80db-60d5236d1546 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:53.340227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:53.340760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:53.341038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:53.341309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:53.342021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:53.342313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:53.344319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:53.358484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 639/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:48:53.365366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:53.498472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc987f2e-64d1-4b99-9454-b7544a8c91ab None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:53.538772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:53.539424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:53.539700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:53.539968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:53.548646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:53.550245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:48:53.565780 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:53.566960 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:48:53.567880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 619/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:53.573805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:53.706910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113cfcd-e99f-48ae-b131-4ef9c9a607a6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:53.745841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:53.746463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:53.746747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:53.747018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:53.747810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:53.748121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:53.750087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b803-1484-46fd-be65-f60fd165547a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:53.767840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 640/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:48:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:53.775820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:53.823368 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:53.921224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaf15-d506-45bd-8821-51e504415d8a None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:53.964369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:53.965031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:53.965165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:53.965568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:53.966304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=d9805de18a574ac1bba25ba2a64ebae7) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:53.966609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:53.968097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f5492-4259-44fd-9763-4eba416ff6e8 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:53.975065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 620/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:48:53 2022] GET /identity/v3/role_assignments?user.id=d9805de18a574ac1bba25ba2a64ebae7&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:56.269345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10eba-080d-44b6-b55c-c556be92ef98 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:56.269953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10eba-080d-44b6-b55c-c556be92ef98 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:56.270070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10eba-080d-44b6-b55c-c556be92ef98 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:56.271430 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 641/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:48:56.277187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:56.277675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:56.277788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:56.297757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:48:56.298963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:48:56.374123 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 621/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:48:56.644433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10eba-080d-44b6-b55c-c556be92ef98 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:56.655362 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:56.753847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10eba-080d-44b6-b55c-c556be92ef98 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:56.807459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:56.808181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:56.808523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:56.808846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:56.821932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:48:56.826767 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:56.829013 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:56.829985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 642/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:56.834811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:56.861312 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:56.947837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeefd5-ae13-48f6-9573-77fdf78afe4c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:56.988272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:56.989204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:56.989542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:56.989869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:56.990941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:56.991280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:56.993793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:57.009636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 622/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:57.016040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:57.089066 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:57.125370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3fc09-9cf1-4594-9b76-4159162a41ef None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:57.178104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:57.178748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.179021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.179289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.190894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:57.192363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:57.208243 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:57.210004 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:57.211704 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:57.211704 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:57.211704 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:57.213588 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 643/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:57.215345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:57.305051 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:57.327443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f16c-5c3b-4384-aa57-2cf7464c99fd None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:57.363552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:57.364163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.364435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.364700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.365343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:57.365671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:57.367039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:57.382515 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 623/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:57.393041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:57.544528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88f5bb-f875-42eb-b8de-55f7e543bede None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:57.566623 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:57.583470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:57.584118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.584399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.584678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.593159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:57.594893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:48:57.607453 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:57.608716 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:48:57.610266 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:57.612957 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 644/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:48:57.619384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:57.753687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eec4b2-56eb-4520-97aa-e49e46a4f329 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:57.802404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:57.802937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.803213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.803478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.804213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:57.804512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:57.806126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:57.816543 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:57.826653 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 624/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:48:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:57.835161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:57.948342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3fec-33d7-40ae-9e85-643795022d9c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:57.983980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:57.985381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:57.985697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:57.985966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:57.997124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:57.998632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:48:58.014224 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:58.015413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:48:58.016796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:48:58.016796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:48:58.016796 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:58.016796 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 645/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:58.025255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:58.133236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d147-2df7-4c4f-907b-7d459032c953 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:58.170979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:58.171665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:58.172102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:58.172572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:58.173285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:58.173665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:58.175121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.187726 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 625/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:48:58.193870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:58.227655 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:58.304049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a276-0b28-4eb3-bf6d-9f93d943fb63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:58.340287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:58.340981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:58.341302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:58.341648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:58.349869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:58.351410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:48:58.363695 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:48:58.365312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:48:58.366389 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 646/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:48:58.372147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:58.437290 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:58.489061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd763b7-a80c-4cb3-89bc-d47b8c8d885b None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:58.527573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:58.528278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:58.528601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:58.528914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:58.529713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:48:58.530060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:58.531590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c121-f715-412a-9d9d-a2a5537914aa None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.544440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 626/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:48:58.550575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:48:58.655024 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:48:58.663985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959e6f-7c32-41ca-aee6-a8cb3b495929 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:48:58.698910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:48:58.699574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:48:58.699858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:48:58.700141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] PATH_INFO: `/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/d9805de18a574ac1bba25ba2a64ebae7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:48:58.702053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] RBAC: Authorizing `identity:create_grant(project_id=010a52b78fc842a58d4ab3351e03e76b, user_id=d9805de18a574ac1bba25ba2a64ebae7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:48:58.704110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ae762-c612-4e83-85b6-689414875cbc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:48:58.717535 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 647/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 25 00:48:58 2022] PUT /identity/v3/projects/010a52b78fc842a58d4ab3351e03e76b/users/d9805de18a574ac1bba25ba2a64ebae7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:49:00.962550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437cfa4-6cf5-45f1-a9ec-30a2730ce3cc None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:00.963140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437cfa4-6cf5-45f1-a9ec-30a2730ce3cc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:00.963140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437cfa4-6cf5-45f1-a9ec-30a2730ce3cc None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:00.964468 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 627/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:00.970718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:00.971262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:00.971355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:00.997290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:00.999042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:01.090480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 648/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:49:01.371805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437cfa4-6cf5-45f1-a9ec-30a2730ce3cc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:01.492365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437cfa4-6cf5-45f1-a9ec-30a2730ce3cc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:01.513701 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:01.533868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:01.534511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:01.534794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:01.535070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:01.545785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 25 00:49:01.551567 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:01.553479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:01.555115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 628/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 25 00:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:01.558818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:01.644406 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:01.671761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ed4d6-40b1-4746-8257-50a97eeb0453 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:01.711164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:01.711769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:01.712036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:01.712310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:01.712973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:01.713265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:01.714663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:01.726360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 649/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 25 00:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:49:01.732406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:01.882048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a3e19-7bec-4719-bf6f-644b1e831bb9 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:01.933663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:01.934207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:01.934490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:01.934765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:01.945638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:01.947105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:49:01.961844 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:01.963593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:49:01.964785 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:49:01.964785 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:49:01.964785 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:01.964785 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 629/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:49:01.972916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:02.081348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9b47-bb8f-4a64-bc3a-7951b750deba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:02.117232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:02.117871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:02.118147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:02.118412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:02.119052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:02.119349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:02.120716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:02.133118 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 650/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:49:02.140088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:02.181146 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:02.255040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af64f91-3b22-45ca-b176-bbba076976ae None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:02.294630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:02.295266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:02.295548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:02.295823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:02.304504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:02.305987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 00:49:02.317535 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:02.318680 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:02.319659 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 630/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:49:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:02.324637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:02.328515 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:02.436116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b419-1032-4816-8b13-b4b56756da6a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:02.475985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:02.476599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:02.476881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:02.477156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:02.477926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:02.478234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:02.479672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:02.498758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 651/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 25 00:49:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:02.508480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:02.641226 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:02.656212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000caa7a-dfe6-4755-b4ff-c51761ce5abb None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:02.707183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:02.707802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:02.708082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:02.708352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:02.783882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:02.785363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:02.882914 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:02.894715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 631/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 25 00:49:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 25 00:49:02.900815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:02.970363 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:03.018006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a1c3-ab17-4642-b923-05303ec23ad5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:03.053644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:03.054178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.054455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.054722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.066742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:03.068194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 00:49:03.084646 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:03.086282 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 25 00:49:03.088460 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 00:49:03.088460 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 25 00:49:03.088460 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:49:03.088460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 652/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:03.092803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:03.200866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33971ea-2303-4236-9d7c-0b2b3cad5706 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:03.240906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:03.241543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.241830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.242096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.242747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:03.243053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:03.244434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:03.258328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 632/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 25 00:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:03.264483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:03.381291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bba4-ee18-4bf1-bd33-0c66983024bf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:03.398201 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:03.422375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:03.423009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.423284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.423557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.430410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:03.431844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 25 00:49:03.443085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:03.444707 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 00:49:03.446429 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 653/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 25 00:49:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:03.452684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:03.510765 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:03.565120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00edef5-d4ac-410e-995d-a3349996f6cf None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:03.601499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:03.602122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.602412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.602686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.603395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:03.603700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:03.605151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808066-fcca-40e5-8c64-f554c2345d58 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:03.618928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 633/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 25 00:49:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:03.625237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:03.736112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bca06-0908-49d8-83aa-2a1471f79989 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:03.775010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:03.775619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:03.775900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:03.776171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:03.776898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] RBAC: Adding query filter params (role.id=ce0f72b1198f4b18845fae1c4d7f94af, scope.project.id=010a52b78fc842a58d4ab3351e03e76b, user.id=d9805de18a574ac1bba25ba2a64ebae7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:03.777203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:03.778675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23532d-f156-43b7-952b-4bb618e9417e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:03.785427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 654/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 25 00:49:03 2022] GET /identity/v3/role_assignments?user.id=d9805de18a574ac1bba25ba2a64ebae7&scope.project.id=010a52b78fc842a58d4ab3351e03e76b&role.id=ce0f72b1198f4b18845fae1c4d7f94af => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:06.022537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e938-0a01-4e23-8db0-a90ee109764b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.023457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e938-0a01-4e23-8db0-a90ee109764b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.023457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e938-0a01-4e23-8db0-a90ee109764b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.024641 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 634/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:49:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:06.033216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.033778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.034326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.058605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:06.059323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:06.091097 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:06.130484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 655/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:49:06.401091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e938-0a01-4e23-8db0-a90ee109764b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:06.518453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e938-0a01-4e23-8db0-a90ee109764b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:06.532144 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:06.559174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:06.559950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.560397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.560873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.561979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:06.565151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:06.576559 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:06.577993 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:06.579584 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 635/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:49:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:06.584638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:06.685674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e5dc5-decc-42ca-9971-c2f2122e4f5f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:06.720729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:06.721345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.721654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.721927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.722565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:06.722867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:06.724250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f290-2921-4464-ad58-a73b17a1cca0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:06.729681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 656/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 25 00:49:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:06.736900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:06.860198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e76f-63f6-445c-8d4c-c900cafd7090 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:06.895462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:06.896070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:06.896346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:06.896613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:06.897242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:06.897576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:06.898944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd70f-a550-4889-bda4-90eb4c5d24bc None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:06.903822 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 636/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 25 00:49:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:49:09.099285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897687-259d-413b-88c2-a9a96abdd66d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:09.099858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897687-259d-413b-88c2-a9a96abdd66d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:09.099858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897687-259d-413b-88c2-a9a96abdd66d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:09.101179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 657/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:09.107220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147938c-04c5-405d-89d5-83aaa8a23a03 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:09.107752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147938c-04c5-405d-89d5-83aaa8a23a03 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:09.107752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147938c-04c5-405d-89d5-83aaa8a23a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:09.127501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d147938c-04c5-405d-89d5-83aaa8a23a03 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:09.128722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d147938c-04c5-405d-89d5-83aaa8a23a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:09.161312 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:09.204344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 637/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:49:09.474306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897687-259d-413b-88c2-a9a96abdd66d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:09.506314 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:09.581542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897687-259d-413b-88c2-a9a96abdd66d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:09.615080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:09.615684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:09.615969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:09.616241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:09.616904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:09.618320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8f7e8-d5d7-42ce-b763-deba54d5310b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:09.633337 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 658/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 25 00:49:09 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:49:11.825103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffef15-bb41-454e-aa00-cbe0d37d73fe None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:11.825711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffef15-bb41-454e-aa00-cbe0d37d73fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:11.825711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffef15-bb41-454e-aa00-cbe0d37d73fe None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:11.827038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 638/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:11.832583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:11.833048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:11.833171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:11.852095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:11.853297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:11.929065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 659/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:49:12.198626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffef15-bb41-454e-aa00-cbe0d37d73fe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:12.303782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffef15-bb41-454e-aa00-cbe0d37d73fe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:12.339552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:12.340191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:12.340473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:12.340753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:12.341339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:12.342746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:12.352196 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:12.353594 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:12.354460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 639/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:49:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 25 00:49:12.360137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:12.379480 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:12.470377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e65d4-eb80-4b1f-8568-dc32ea298d97 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:12.507413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:12.508105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:12.508433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:12.508753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:12.509707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:12.510057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:12.511790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:12.517926 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 660/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 25 00:49:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:12.524344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:12.558716 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:12.630378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616987-e967-4b5a-b972-d827bda93e49 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:12.665848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:12.666455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:12.666739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:12.667010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:12.667722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] RBAC: Adding query filter params (interface=public, service_id=0cbd14aa0643402088da3bb7b14f9f68, region_id=RegionOne) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:12.668028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:12.669443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd88b8-5861-4323-8756-7ac826075422 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:12.675871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 640/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 25 00:49:12 2022] GET /identity/v3/endpoints?service_id=0cbd14aa0643402088da3bb7b14f9f68&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:12.681739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:12.764860 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:12.784451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa00d7-bb61-478c-affc-c8514084b4f8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:12.820101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:12.820713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:12.820985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:12.821254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:12.821894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:12.823261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616691d-cbc4-4477-898c-d2fec37682cd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:12.830360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 661/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 25 00:49:12 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:49:15.017650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc4112-0c63-4ef5-9ed6-6c2ed56fd52f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:15.018213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc4112-0c63-4ef5-9ed6-6c2ed56fd52f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:15.018213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc4112-0c63-4ef5-9ed6-6c2ed56fd52f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:15.019522 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 641/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:49:15.024868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:15.025267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:15.025424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:15.044143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:49:15.045327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:49:15.112454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 662/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:49:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 00:49:15.380173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc4112-0c63-4ef5-9ed6-6c2ed56fd52f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:15.476918 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:15.484262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc4112-0c63-4ef5-9ed6-6c2ed56fd52f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:15.519388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:15.520021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:15.520303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:15.520575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:15.521162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:15.522573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 00:49:15.533502 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 00:49:15.534710 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 00:49:15.535972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 642/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 25 00:49:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 00:49:15.540696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:15.617664 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:15.641086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a906d7-2613-4f2d-ae44-f12f313fdb6e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:15.674833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:15.675438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:15.675713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:15.675981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:15.676603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:49:15.676899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:15.678285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32754f-d414-46ee-a41b-82e44a181d77 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:15.683398 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 663/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 25 00:49:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:49:15.689966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:49:15.788634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e696b3-3f38-4d73-8ea8-c09a57a89f91 None admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:49:15.821065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:49:15.821756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:49:15.822033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:49:15.822299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:49:15.822953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:49:15.824315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d212a-f917-421e-8814-45f284d9f792 None admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:49:15.844913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 643/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:49:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:49:25.680421 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=30 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:49:25.840338 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:22.814467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e89f-c59c-4519-a728-d94643173879 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:22.815040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e89f-c59c-4519-a728-d94643173879 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:22.815314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e89f-c59c-4519-a728-d94643173879 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:22.818844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 664/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:22.824825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089e97-3cd6-45fb-8d85-57e38275b58b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:22.825988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089e97-3cd6-45fb-8d85-57e38275b58b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:22.827223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00089e97-3cd6-45fb-8d85-57e38275b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:22.915602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-00089e97-3cd6-45fb-8d85-57e38275b58b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:22.917037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-00089e97-3cd6-45fb-8d85-57e38275b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:23.054032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 644/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:23.371755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:23.372427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:23.373439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:23.375322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 665/1309] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 25 00:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:23.383015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1440fb-5211-4361-8bad-2c3fbecf7943 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:23.383323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1440fb-5211-4361-8bad-2c3fbecf7943 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:23.386732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1440fb-5211-4361-8bad-2c3fbecf7943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:23.485306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0b1440fb-5211-4361-8bad-2c3fbecf7943 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:23.486455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b1440fb-5211-4361-8bad-2c3fbecf7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:23.517560 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:23.596513 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 645/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 25 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:23.608068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:23.610112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:23.775736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6d11-a3a8-44af-b290-5306b559b7cb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:23.865316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:23.866198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:23.866290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:23.866611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:23.868133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:23.933270 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:23.998007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:23.999630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dcef1-2fd8-44bc-9ae0-6c03b3e3c4b0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:24.020671 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 666/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:26.581323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:26.581913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:26.581913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:26.583312 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 646/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:26.588726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5610-5bf4-4f15-aee2-647d7f7022fa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:26.589213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5610-5bf4-4f15-aee2-647d7f7022fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:26.589369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5610-5bf4-4f15-aee2-647d7f7022fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:26.675872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f65e5610-5bf4-4f15-aee2-647d7f7022fa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:26.676997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f65e5610-5bf4-4f15-aee2-647d7f7022fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:26.787015 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 667/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:27.075752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:27.078390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:27.196121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768718b4-c9a4-4900-a000-cc784eff1ab4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:27.276360 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:27.279300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:27.280265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:27.280890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:27.281181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:27.283061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:27.398527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:27.399997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecee91-67ae-4abf-a670-4535871a561c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:27.421524 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 647/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:29.935303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfddda-1456-4abe-8aec-8fc6f6af1362 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:29.935303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfddda-1456-4abe-8aec-8fc6f6af1362 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:29.935303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfddda-1456-4abe-8aec-8fc6f6af1362 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:29.935924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 668/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:50:29.941976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367fc4-2e0d-4909-93de-7276c539a527 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:29.942765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367fc4-2e0d-4909-93de-7276c539a527 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:29.942765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367fc4-2e0d-4909-93de-7276c539a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:30.012051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a8367fc4-2e0d-4909-93de-7276c539a527 None None] MFA Rules not processed for user `cc8242e9627f4b96adbf4f8c9dcee7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:30.013587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a8367fc4-2e0d-4909-93de-7276c539a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:30.067435 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:30.115411 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 648/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:30.416501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:30.416784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:30.417058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:30.418477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 669/1317] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 25 00:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:30.425685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784935-852b-4975-a3ab-52f9334a42e0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:30.425971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784935-852b-4975-a3ab-52f9334a42e0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:30.426244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784935-852b-4975-a3ab-52f9334a42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:30.513338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f0784935-852b-4975-a3ab-52f9334a42e0 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:30.515349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f0784935-852b-4975-a3ab-52f9334a42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:30.594246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 649/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 25 00:50:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:30.603511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:30.605042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:30.615066 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:30.711678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767be73-677f-4d72-bef6-b20ebdf52cb7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:30.787747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:30.788359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:30.788638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:30.788911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:30.790577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:30.855686 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:30.904961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:30.906444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825d4f3-dcdb-4e41-8891-4e0849dda5a8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:30.924357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 670/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:34.065589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:34.066154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:34.066154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:34.067498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 650/1320] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:34.072926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ed1a3-36f3-4776-b3e5-21d04e3d7daf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:34.073347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ed1a3-36f3-4776-b3e5-21d04e3d7daf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:34.073534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ed1a3-36f3-4776-b3e5-21d04e3d7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:34.142636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d9ed1a3-36f3-4776-b3e5-21d04e3d7daf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:34.143877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d9ed1a3-36f3-4776-b3e5-21d04e3d7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:34.243576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 671/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:34.528896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:34.530524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:34.582788 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:34.637955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bcdf2-89ca-44ca-9ba8-eb12f364516e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:34.712883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:34.713522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:34.713805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:34.714081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:34.715669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:34.813005 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:34.826909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:34.828528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7362957-a421-4535-aa86-de33f2dfb8cc service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:34.847332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 651/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:37.743984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:37.744449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:37.745074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:37.746220 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 672/1323] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:37.753050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a7fc0-1aa6-4814-be2e-2d97de74bdc3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:37.753597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a7fc0-1aa6-4814-be2e-2d97de74bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:37.753682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a7fc0-1aa6-4814-be2e-2d97de74bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:37.820560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-619a7fc0-1aa6-4814-be2e-2d97de74bdc3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:37.821801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-619a7fc0-1aa6-4814-be2e-2d97de74bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:37.932402 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 652/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:50:38.214394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:38.215963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:38.236409 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:38.324661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd2502-cf4f-4641-a91d-052b591ea947 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:38.404410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:38.405086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:38.405624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:38.405913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:38.407638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:38.484112 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:38.523995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:38.525491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8f58c-e46e-44f4-931d-db04a2392b55 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:38.545265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 673/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:40.849569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:40.850110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:40.850110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:40.851449 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 653/1326] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:40.857573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05291d2-9a87-4b0a-aa86-302f595509e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:40.858125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05291d2-9a87-4b0a-aa86-302f595509e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:40.858309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05291d2-9a87-4b0a-aa86-302f595509e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:40.925843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c05291d2-9a87-4b0a-aa86-302f595509e7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:40.927083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c05291d2-9a87-4b0a-aa86-302f595509e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:41.037565 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 674/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:41.316792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:41.318356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:41.380779 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:41.430184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82965-26b9-4915-ba78-3db6afab6280 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:41.510783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:41.511392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:41.511664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:41.511927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:41.514012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:41.644784 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:41.649764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:41.652558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0564e1-2647-4ddb-ba3f-11b1640b8037 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:41.687136 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 654/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:43.973484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:43.973953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:43.974058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:43.975358 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 675/1329] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:43.980917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e2bd-073a-4e56-aa73-92fce9672885 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:43.981494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e2bd-073a-4e56-aa73-92fce9672885 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:43.981494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e2bd-073a-4e56-aa73-92fce9672885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:44.068113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9847e2bd-073a-4e56-aa73-92fce9672885 None None] MFA Rules not processed for user `cc8242e9627f4b96adbf4f8c9dcee7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:44.069340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9847e2bd-073a-4e56-aa73-92fce9672885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:44.187118 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 655/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:50:44.473732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:44.475303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:44.509541 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:44.590160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e41d99-fca4-4d8d-9a1f-d1e3052d2a13 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:44.667932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:44.668458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:44.668737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:44.669007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:44.671222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:44.753867 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:44.788716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:44.790218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6111c-f871-4724-b9a4-532107b82613 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:44.809708 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 676/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:47.286369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:47.286912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:47.286912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:47.288259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 656/1332] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:47.293699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6be6-66c3-4b99-8c80-91f33b2d94b8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:47.294152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6be6-66c3-4b99-8c80-91f33b2d94b8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:47.294152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6be6-66c3-4b99-8c80-91f33b2d94b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:47.359829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-420f6be6-66c3-4b99-8c80-91f33b2d94b8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:47.361325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-420f6be6-66c3-4b99-8c80-91f33b2d94b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:47.461093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 677/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:50:47.753977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:47.755572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:47.825858 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:47.860410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131070-7bcb-43bd-b960-e49856b78486 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:47.937559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:47.938170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:47.938452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:47.938724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:47.940343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:48.054401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:48.055931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983c9c-e05e-42fc-ac1e-c0e5afb64345 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:48.067845 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:48.077549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 657/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:50.397539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900577c-c342-456d-b86a-08696729ce06 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:50.398218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900577c-c342-456d-b86a-08696729ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:50.398218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900577c-c342-456d-b86a-08696729ce06 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:50.399426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 678/1335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:50.405742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08178-2c70-4325-897c-df7c23506112 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:50.406237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08178-2c70-4325-897c-df7c23506112 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:50.406327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08178-2c70-4325-897c-df7c23506112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:50.494086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4cf08178-2c70-4325-897c-df7c23506112 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:50.498082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4cf08178-2c70-4325-897c-df7c23506112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:50.614674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 658/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:50.908087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900577c-c342-456d-b86a-08696729ce06 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:50.909706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a900577c-c342-456d-b86a-08696729ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:50.959246 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:51.026230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900577c-c342-456d-b86a-08696729ce06 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:51.103505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:51.104123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:51.104402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:51.104671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:51.106376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:51.199453 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:51.228552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:51.230061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6f2e-7ea5-43ee-a0da-282ef0df2dc0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:51.251845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 679/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:54.019133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:54.019680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:54.019680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:54.021025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 659/1338] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:54.026419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b0aa-aebd-4fbe-a7cb-c37b481dbb9f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:54.026884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b0aa-aebd-4fbe-a7cb-c37b481dbb9f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:54.026979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b0aa-aebd-4fbe-a7cb-c37b481dbb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:54.096165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fdd3b0aa-aebd-4fbe-a7cb-c37b481dbb9f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:54.097544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdd3b0aa-aebd-4fbe-a7cb-c37b481dbb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:54.198848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 680/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:54.502705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:54.504260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:54.588313 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:54.638855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df768e-bf9f-44f4-80ea-97a617f3e30f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:54.727635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:54.728243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:54.728518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:54.728786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:54.730424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:54.848561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:54.850049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5c57-4a9a-4c97-b061-e342fa4a4882 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:54.868812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 660/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:50:59.170923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:59.171399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:59.171489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:59.173228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 681/1341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:50:59.179170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083564-8c6f-42a4-8048-f7d115b72f19 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:59.179551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083564-8c6f-42a4-8048-f7d115b72f19 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:59.179735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083564-8c6f-42a4-8048-f7d115b72f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:59.185312 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:59.250676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8b083564-8c6f-42a4-8048-f7d115b72f19 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:50:59.252114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8b083564-8c6f-42a4-8048-f7d115b72f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:59.362482 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 661/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:50:59.656957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:50:59.658543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:59.710501 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:59.771173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624ae1-a243-4dca-a262-edb9fee08b77 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:50:59.853966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:50:59.854637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:50:59.855030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:50:59.855184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:50:59.857438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:50:59.954569 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:50:59.971505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:50:59.972945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e66d-e363-4f7e-9af4-8f9a4c571987 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:50:59.991152 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 682/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:02.893039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:02.893577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:02.893577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:02.894928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 662/1344] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:02.900199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6c54-bf90-49a8-a644-3a59a1a4bc94 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:02.900637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6c54-bf90-49a8-a644-3a59a1a4bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:02.900742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a6c54-bf90-49a8-a644-3a59a1a4bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:02.970157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fc4a6c54-bf90-49a8-a644-3a59a1a4bc94 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:02.971389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc4a6c54-bf90-49a8-a644-3a59a1a4bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:03.070976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 683/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:03.355931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:03.358232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:03.454344 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:03.472305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8e25-5b63-416b-8a60-d6f510c2fb90 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:03.556908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:03.557557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:03.557842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:03.558117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:03.560394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:03.679985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:03.681319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e82b-dd20-4177-950d-cdd8ee6eda0b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:03.701210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 663/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:08.089684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:08.090416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:08.090416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:08.094196 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 684/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:08.100912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704982d9-5a6a-4d4c-bd84-69d9524f35bb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:08.102988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704982d9-5a6a-4d4c-bd84-69d9524f35bb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:08.103749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704982d9-5a6a-4d4c-bd84-69d9524f35bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:08.141124 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:08.213361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-704982d9-5a6a-4d4c-bd84-69d9524f35bb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:08.214613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-704982d9-5a6a-4d4c-bd84-69d9524f35bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:08.342759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 664/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:08.633221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:08.634809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:08.695622 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:08.743432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc79b6-f61c-41a3-b3e3-5321e4547807 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:08.822214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:08.822825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:08.823130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:08.823398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:08.825126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:08.936201 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:08.941033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:08.942763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba234b66-0fd8-442d-9c91-2eb387e06da8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:08.962585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 685/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:13.987559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169eee-7197-4697-9516-b9eec4678b55 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:13.987559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169eee-7197-4697-9516-b9eec4678b55 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:13.987559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169eee-7197-4697-9516-b9eec4678b55 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:13.988598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 665/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:14.000381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842879a-fdc0-4648-b747-abbec9803899 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:14.001264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842879a-fdc0-4648-b747-abbec9803899 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:14.001523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842879a-fdc0-4648-b747-abbec9803899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:14.150409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9842879a-fdc0-4648-b747-abbec9803899 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:14.151661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9842879a-fdc0-4648-b747-abbec9803899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:14.291694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 686/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 00:51:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:18.340267 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=59 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:18.611076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0dc4-7b76-4872-a7bf-eb12ae1c9c2a None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:18.611462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0dc4-7b76-4872-a7bf-eb12ae1c9c2a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:18.611695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0dc4-7b76-4872-a7bf-eb12ae1c9c2a None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:18.613143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 666/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:51:18.618289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b835f-c294-420d-8b29-a05ea85acf44 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:18.619157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b835f-c294-420d-8b29-a05ea85acf44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:18.619641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b835f-c294-420d-8b29-a05ea85acf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:18.681332 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:18.711872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e92b835f-c294-420d-8b29-a05ea85acf44 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:18.713585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e92b835f-c294-420d-8b29-a05ea85acf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:18.835691 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 687/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:20.304054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099f8f-d0c4-49cc-8f2e-e1e4e628fca8 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:20.304584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099f8f-d0c4-49cc-8f2e-e1e4e628fca8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:20.304584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099f8f-d0c4-49cc-8f2e-e1e4e628fca8 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:20.305975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 667/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 00:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:20.311944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4655e-adfc-4c03-ab15-73d7108a6024 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:20.312449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4655e-adfc-4c03-ab15-73d7108a6024 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:20.312615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4655e-adfc-4c03-ab15-73d7108a6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:20.396972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b5c4655e-adfc-4c03-ab15-73d7108a6024 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:20.398543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b5c4655e-adfc-4c03-ab15-73d7108a6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:20.447978 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:20.521323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 688/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 00:51:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:24.292255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79515f-727f-4e9f-9728-b90d2933eb6a None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:24.293912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79515f-727f-4e9f-9728-b90d2933eb6a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:24.294375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79515f-727f-4e9f-9728-b90d2933eb6a None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:24.300170 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 668/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:24.302486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c04-488c-4c8c-ab9a-8e65d1ba47ca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:24.303274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c04-488c-4c8c-ab9a-8e65d1ba47ca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:24.303726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c04-488c-4c8c-ab9a-8e65d1ba47ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:24.411576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b74a0c04-488c-4c8c-ab9a-8e65d1ba47ca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:24.413078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b74a0c04-488c-4c8c-ab9a-8e65d1ba47ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:24.528088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 689/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:24.842566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:24.843127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:24.843395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:24.844897 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 669/1358] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 00:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:24.854891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d74af-2dea-441f-af4f-9df4bc43fe07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:24.855332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d74af-2dea-441f-af4f-9df4bc43fe07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:24.856254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d74af-2dea-441f-af4f-9df4bc43fe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:24.892186 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:24.970284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-912d74af-2dea-441f-af4f-9df4bc43fe07 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:24.971684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-912d74af-2dea-441f-af4f-9df4bc43fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:25.135281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 690/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:25.144100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:25.145656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:25.325183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15cfa-0f15-455d-a03d-4e3435d03611 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:25.423186 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:25.476741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:25.477344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:25.477648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:25.477917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:25.479577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:25.613112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:25.615244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91904699-8379-497a-94d5-723193a57bd0 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:25.641270 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 670/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:28.077693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:28.077693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:28.079628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:28.085093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da455c-8ab1-44d3-b631-d57c8de9b25e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:28.085786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da455c-8ab1-44d3-b631-d57c8de9b25e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:28.085786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da455c-8ab1-44d3-b631-d57c8de9b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:28.091185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 691/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:28.174206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e0da455c-8ab1-44d3-b631-d57c8de9b25e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:28.175426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0da455c-8ab1-44d3-b631-d57c8de9b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:28.220451 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:28.291345 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 671/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:28.590226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:28.591762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:28.664847 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:28.779702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389c20-6550-4ebc-bc86-94db84d90a0d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:28.934295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:28.934881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:28.935157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:28.935421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:28.937037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:28.961160 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:29.040375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:29.042030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c060-cf33-4aec-9bc6-d39f8d032689 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:29.062667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 692/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:31.631290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafa302-ae12-46cd-988e-c03be178ba7e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:31.631831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafa302-ae12-46cd-988e-c03be178ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:31.631831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafa302-ae12-46cd-988e-c03be178ba7e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:31.633167 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 672/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:31.639941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded454f-c112-4e3c-9ee4-13b39e03df13 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:31.640398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded454f-c112-4e3c-9ee4-13b39e03df13 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:31.640586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded454f-c112-4e3c-9ee4-13b39e03df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:31.729166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ded454f-c112-4e3c-9ee4-13b39e03df13 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:31.730538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ded454f-c112-4e3c-9ee4-13b39e03df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:31.896663 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:31.897168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 693/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:32.189895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:32.190468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:32.190849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:32.192320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 673/1366] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 00:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:32.197641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5164b5-912f-4126-9073-fb6c3cf10ab8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:32.198057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5164b5-912f-4126-9073-fb6c3cf10ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:32.198435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5164b5-912f-4126-9073-fb6c3cf10ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:32.309726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f5164b5-912f-4126-9073-fb6c3cf10ab8 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:32.311111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f5164b5-912f-4126-9073-fb6c3cf10ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:32.485621 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 694/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 00:51:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:32.493910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:32.495781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:32.748546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fec8a1-8b88-400a-89f4-bce178bf9a69 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:32.778023 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:32.908921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:32.908921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:32.908921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:32.908921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:32.912093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:33.037319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:33.039206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162362-c89e-46bf-930e-4eac4ad802d0 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:33.080407 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 674/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:35.690521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:35.691075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:35.691075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:35.693271 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 695/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:35.698886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819bef-8407-444f-9e2e-b29fd1dcfbc3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:35.699377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819bef-8407-444f-9e2e-b29fd1dcfbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:35.699460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819bef-8407-444f-9e2e-b29fd1dcfbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:35.736111 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:35.780845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a2819bef-8407-444f-9e2e-b29fd1dcfbc3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:35.782023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2819bef-8407-444f-9e2e-b29fd1dcfbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:35.906075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 675/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:36.209318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:36.210850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:36.310736 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:36.495746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326183f-f706-4bfe-82fb-7e1417f1ca1f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:36.655417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:36.656159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:36.656508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:36.656857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:36.658573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:36.671084 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:36.716716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d8ec-10cd-46e2-9a28-1c7d69d29ac2 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:36.717679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d8ec-10cd-46e2-9a28-1c7d69d29ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:36.718121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d8ec-10cd-46e2-9a28-1c7d69d29ac2 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:36.719486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 676/1371] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:36.724771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0262e-90ac-4ddd-8594-6e7444043fca None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:36.725065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0262e-90ac-4ddd-8594-6e7444043fca None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:36.725355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0262e-90ac-4ddd-8594-6e7444043fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:36.763500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:36.765555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa673-7416-42ad-8070-0b1ed72cd563 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:36.786308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 696/1372] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:36.803821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bdb0262e-90ac-4ddd-8594-6e7444043fca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:36.805047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bdb0262e-90ac-4ddd-8594-6e7444043fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:36.878953 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:36.938264 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 677/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:37.280809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:37.280809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:37.280809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:37.281258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 697/1374] 10.222.0.16 () {54 vars in 963 bytes} [Sun Sep 25 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:37.286590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d1aa-435c-4866-b1a8-9db8f4794ff4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:37.286874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d1aa-435c-4866-b1a8-9db8f4794ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:37.287145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d1aa-435c-4866-b1a8-9db8f4794ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:37.375696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eed8d1aa-435c-4866-b1a8-9db8f4794ff4 None None] MFA Rules not processed for user `fe9dafd81a8947f79616064549817153`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:37.376833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eed8d1aa-435c-4866-b1a8-9db8f4794ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:37.471776 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 678/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 25 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:37.478377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:37.480063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:37.600553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e810688-9869-4331-aa6e-4b09394ed821 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:37.641224 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:37.684862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:37.685498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:37.685780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:37.686051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:37.687656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:37.809813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:37.811273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75087d-6751-4b20-bc1e-56c3df1dbebf service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:37.831337 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 698/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:39.068964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:39.069694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:39.069694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:39.070910 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 679/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:39.076943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843ed4-cdf7-485d-8954-33dff9943bca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:39.077602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843ed4-cdf7-485d-8954-33dff9943bca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:39.077602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6843ed4-cdf7-485d-8954-33dff9943bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:39.150650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6843ed4-cdf7-485d-8954-33dff9943bca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:39.152436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6843ed4-cdf7-485d-8954-33dff9943bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:39.168747 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:39.266524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 699/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:39.563405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:39.564943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:39.626698 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:39.753601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6aa114-878d-4a2f-88c6-c30bf21daf75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:39.905464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:39.905464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:39.905464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:39.905959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:39.907596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:39.922160 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:40.021392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:40.023202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348465d4-3f25-430c-8328-1f43a56ce0a5 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:40.046724 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 680/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:42.431974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:42.433490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:42.434216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:42.436958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 700/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:42.442330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ce55-d291-4d80-a7f1-6447f6fcda5e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:42.442987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ce55-d291-4d80-a7f1-6447f6fcda5e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:42.442987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ce55-d291-4d80-a7f1-6447f6fcda5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:42.523470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7f17ce55-d291-4d80-a7f1-6447f6fcda5e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:42.524713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7f17ce55-d291-4d80-a7f1-6447f6fcda5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:42.645964 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:42.664004 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 681/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:42.971261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:42.973025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:43.162541 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:43.166777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864b2ec-90bf-405d-92d8-10272a5da2b3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:43.305868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:43.306493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:43.306774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:43.307046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:43.309551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:43.425102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:43.426948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b86e6e-077f-44d5-b59f-b324832e4488 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:43.449500 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 701/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:45.833121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:45.833735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:45.833735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:45.841777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310cd9-97ab-44ef-bbbb-5e78b7429c30 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:45.842372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310cd9-97ab-44ef-bbbb-5e78b7429c30 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:45.842372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310cd9-97ab-44ef-bbbb-5e78b7429c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:45.846808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 682/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:45.848264 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:45.937139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-00310cd9-97ab-44ef-bbbb-5e78b7429c30 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:45.938741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-00310cd9-97ab-44ef-bbbb-5e78b7429c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:46.085085 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 702/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:51:46.395114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:46.397198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:46.581039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f637c-6fcf-4d5c-a703-43e919c4bca4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:46.666491 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:46.728447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:46.729253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:46.730329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:46.730667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:46.732896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:46.839738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:46.841387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ca1e1-32c5-44ee-aa61-6321bbdaf860 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:46.865356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 683/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:49.230904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:49.231504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:49.231504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:49.232847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 703/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:49.239088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e046e7-13a5-4f47-a835-d14bb8b3e66d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:49.239571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e046e7-13a5-4f47-a835-d14bb8b3e66d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:49.239869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e046e7-13a5-4f47-a835-d14bb8b3e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:49.325838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-88e046e7-13a5-4f47-a835-d14bb8b3e66d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:49.328314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88e046e7-13a5-4f47-a835-d14bb8b3e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:49.368062 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:49.455873 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 684/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:49.751606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:49.753155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:49.850866 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:49.930582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2254-462a-4fcc-b4ee-18f15e98216c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:50.083794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:50.084965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:50.085431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:50.085994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:50.089838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:50.173545 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:50.248078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:50.249772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cc8a-081b-48aa-b873-160aa0e907d2 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:50.269333 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 704/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:52.617929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:52.618554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:52.618554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:52.619864 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 685/1389] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:52.625272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505ba3-6f74-4a89-afca-fae6a68409a1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:52.625788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505ba3-6f74-4a89-afca-fae6a68409a1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:52.625897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505ba3-6f74-4a89-afca-fae6a68409a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:52.698602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e3505ba3-6f74-4a89-afca-fae6a68409a1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:52.699836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e3505ba3-6f74-4a89-afca-fae6a68409a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:52.808297 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 705/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:53.100914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:53.103381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:53.260044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bae043-fe00-459a-b79d-81054cd91329 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:53.270643 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:53.383780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:53.384305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:53.384596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:53.384856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:53.387628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:53.499393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:53.501122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f81ee8-f756-4a84-934e-58e0fc196697 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:53.522035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 686/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:51:54.038369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f53e1-cc34-4225-b858-73ca5d5b1aae None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:54.039087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f53e1-cc34-4225-b858-73ca5d5b1aae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:54.039087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f53e1-cc34-4225-b858-73ca5d5b1aae None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:54.040694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 706/1392] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:51:54.047478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf2d4d-ef2d-420d-a807-f46c416fbeba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:54.048016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf2d4d-ef2d-420d-a807-f46c416fbeba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:54.048147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf2d4d-ef2d-420d-a807-f46c416fbeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:54.064672 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:54.122998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e1cf2d4d-ef2d-420d-a807-f46c416fbeba None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:54.124228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1cf2d4d-ef2d-420d-a807-f46c416fbeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:54.242415 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 687/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:54.559017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:54.559390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:54.559772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:54.561269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 707/1394] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 25 00:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:54.567019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496eb47-48f8-4fbc-9054-23de36e1b8fb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:54.567308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496eb47-48f8-4fbc-9054-23de36e1b8fb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:54.567587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496eb47-48f8-4fbc-9054-23de36e1b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:54.647947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0496eb47-48f8-4fbc-9054-23de36e1b8fb None None] MFA Rules not processed for user `8565cc85e8a149ac8761b7f687ff7552`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:54.649210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0496eb47-48f8-4fbc-9054-23de36e1b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:54.689294 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:54.735550 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 688/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 25 00:51:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:54.743756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:54.745566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:54.772626 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:54.864105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4dad9-78eb-414f-863b-ff238a8f7ca3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:54.942746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:54.943363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:54.943645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:54.943918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:54.945589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:55.023570 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:55.061732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:55.063194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7709ab-136e-4312-8191-01c27ebc83e7 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:55.081525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 708/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:51:55.799167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07422-a3ba-4552-8223-4661cba9f4bb None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:55.799733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07422-a3ba-4552-8223-4661cba9f4bb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:55.799733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07422-a3ba-4552-8223-4661cba9f4bb None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:55.801197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 689/1397] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:55.807253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720a98-b3f9-4de4-b189-9be33d6963d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:55.808023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720a98-b3f9-4de4-b189-9be33d6963d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:55.808300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720a98-b3f9-4de4-b189-9be33d6963d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:55.879467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9768a3-a0bf-4707-a37f-05d1c6bc709b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:55.880227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9768a3-a0bf-4707-a37f-05d1c6bc709b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:55.880506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9768a3-a0bf-4707-a37f-05d1c6bc709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:55.888320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-75720a98-b3f9-4de4-b189-9be33d6963d2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:55.889596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-75720a98-b3f9-4de4-b189-9be33d6963d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:55.960257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5d9768a3-a0bf-4707-a37f-05d1c6bc709b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:55.961788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d9768a3-a0bf-4707-a37f-05d1c6bc709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:56.003697 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 709/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:56.055946 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 690/1399] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:56.101530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:56.102145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:56.102145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:56.103442 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 710/1400] 10.222.0.16 () {54 vars in 943 bytes} [Sun Sep 25 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:56.110648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:56.110932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:56.111205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:56.175328 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:56.196711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] MFA Rules not processed for user `46f1c1451849424fa2b09e7ea786a539`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:56.198802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:56.297979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:56.299547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:56.313356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 691/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 25 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:56.323447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:56.333605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c560d9b-e3dd-4ee6-85d3-10f7a865ccf8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:56.336211 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:56.455264 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:56.461394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:56.461699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ac206-acae-49c7-9ecd-6f531a66837e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:56.462060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:56.462344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:56.462617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:56.464572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:56.558708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:56.560372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9850478-7d27-4472-bb54-d0660a6d3721 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:56.570895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 692/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 00:51:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 00:51:56.577266 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:56.590054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:56.590687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:56.590974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:56.591256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:56.592921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:56.726120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:51:56.729273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac43c-9a6c-482a-8687-1acf66780b25 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:51:56.753096 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 711/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:51:59.124319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:59.125345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:59.125345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:59.126289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 693/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:51:59.131806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872583-b3a8-4570-92bc-a25d202c0c2c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:59.132253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872583-b3a8-4570-92bc-a25d202c0c2c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:59.132351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872583-b3a8-4570-92bc-a25d202c0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:59.211962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c872583-b3a8-4570-92bc-a25d202c0c2c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:51:59.214256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c872583-b3a8-4570-92bc-a25d202c0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:59.299154 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:59.342524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 712/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:51:59.654555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:51:59.656133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:51:59.824557 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:59.834821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321736-db78-43c1-82f7-e6484d10fb74 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:51:59.978175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:51:59.978993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:51:59.979807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:51:59.979807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:51:59.981317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:00.090599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:00.092556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ac7ac-b33d-46b5-9552-5e913f023a2b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:00.105176 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:00.114906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 694/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:02.442696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:02.443265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:02.443265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:02.444600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 713/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:02.451355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2218-308e-403c-9853-a9f5db67501b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:02.452254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2218-308e-403c-9853-a9f5db67501b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:02.452533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2218-308e-403c-9853-a9f5db67501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:02.535828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-feff2218-308e-403c-9853-a9f5db67501b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:02.537096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-feff2218-308e-403c-9853-a9f5db67501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:02.665586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 695/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:02.971753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:02.973266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:03.151096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ce32-2162-4364-b6f8-2b27d109d202 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:03.212199 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:03.295747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:03.296480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:03.296824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:03.297101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:03.298782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:03.415117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:03.417240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a159af-3999-4c5f-b4eb-2db1cb68e158 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:03.439559 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 714/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:12.663880 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=67 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:13.437050 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=76 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:20.037607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392f2f-6e03-4640-83d8-5c5de87e5f61 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:20.038168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392f2f-6e03-4640-83d8-5c5de87e5f61 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:20.038168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392f2f-6e03-4640-83d8-5c5de87e5f61 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:20.039491 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 696/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 25 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:20.044839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb4c3-9c96-4d5b-91dc-0aadec4a0d5b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:20.045296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb4c3-9c96-4d5b-91dc-0aadec4a0d5b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:20.045498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb4c3-9c96-4d5b-91dc-0aadec4a0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:20.125245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-980bb4c3-9c96-4d5b-91dc-0aadec4a0d5b None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:20.126502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-980bb4c3-9c96-4d5b-91dc-0aadec4a0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:20.237159 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 715/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 25 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:20.252788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57029cd-ab71-4eb8-966a-546e45b1e635 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:20.252989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57029cd-ab71-4eb8-966a-546e45b1e635 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:20.253266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57029cd-ab71-4eb8-966a-546e45b1e635 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:20.254621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 697/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 25 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:20.259487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470208-a751-4345-b202-0c365bd104df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:20.259781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470208-a751-4345-b202-0c365bd104df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:20.260057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a470208-a751-4345-b202-0c365bd104df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:20.337093 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:20.340359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9a470208-a751-4345-b202-0c365bd104df None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:20.341904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a470208-a751-4345-b202-0c365bd104df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:20.466301 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 716/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 25 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:23.138440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:23.138975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:23.138975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:23.140243 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:23.145556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070140f3-00d6-4cf3-8ad9-f7bbd705444a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:23.145967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070140f3-00d6-4cf3-8ad9-f7bbd705444a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:23.146114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070140f3-00d6-4cf3-8ad9-f7bbd705444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:23.212470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-070140f3-00d6-4cf3-8ad9-f7bbd705444a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:23.214047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-070140f3-00d6-4cf3-8ad9-f7bbd705444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:23.269178 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:23.311873 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:52:23.605196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:23.606751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:23.754071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fa1e0-d28a-48b0-9486-7b8d4265a2bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:23.828151 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:23.870535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:23.871142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:23.871420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:23.871702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:23.873297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:23.965374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:23.967022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa463a65-be1c-459a-a9ef-7b7d7e6d0f92 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:23.985686 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 699/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:25.142217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:25.142810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:25.142810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:25.144109 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:25.150800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb979-2e7b-4a34-a497-1cce0bc5419c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:25.151248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb979-2e7b-4a34-a497-1cce0bc5419c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:25.151345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb979-2e7b-4a34-a497-1cce0bc5419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:25.226918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bcadb979-2e7b-4a34-a497-1cce0bc5419c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:25.228886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bcadb979-2e7b-4a34-a497-1cce0bc5419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:25.256112 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:25.327163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:25.488501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:25.490081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:25.643420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cddd6a-3932-4863-a136-9dc0c53a5c5a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:25.685056 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:25.765364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:25.765920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:25.766200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:25.766470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:25.768179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:25.864238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:25.865897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b98965-d519-47f9-9c36-4207dca421e9 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:25.886411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 719/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:27.092912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:27.093603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:27.093603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:27.094903 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:27.103734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba148bc-9b14-4ec5-afaa-05379aaf2b3a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:27.103734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba148bc-9b14-4ec5-afaa-05379aaf2b3a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:27.103734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba148bc-9b14-4ec5-afaa-05379aaf2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:27.166242 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:27.190483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eba148bc-9b14-4ec5-afaa-05379aaf2b3a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:27.191701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eba148bc-9b14-4ec5-afaa-05379aaf2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:27.302259 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:52:27.466963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:27.468504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:27.628557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dc5b-ece2-435f-97b5-e73f94186d65 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:27.641664 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:27.744889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:27.745528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:27.745792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:27.746060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:27.747661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:27.839296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:27.840908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e215-f6f3-412d-90ef-e6363aeb6295 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:27.859541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 702/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:52:29.017224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:29.017857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:29.017857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:29.019126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:29.026261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fee9e-4e6d-49a6-8994-a0eedf98eb33 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:29.026733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fee9e-4e6d-49a6-8994-a0eedf98eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:29.026851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fee9e-4e6d-49a6-8994-a0eedf98eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:29.046758 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:29.104651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-417fee9e-4e6d-49a6-8994-a0eedf98eb33 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:29.105892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-417fee9e-4e6d-49a6-8994-a0eedf98eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:29.201817 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:29.353762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:29.355221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:29.468276 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:29.504324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ca77-6660-4709-a07d-da83ccec3735 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:29.622705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:29.623240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:29.623522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:29.623794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:29.625417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:29.704475 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:29.718300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:29.719894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af6a4-c422-454b-95f4-d1eef05fc7c0 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:29.738588 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 722/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:30.878447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:30.879036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:30.879036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:30.880451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:30.886877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20d63-3621-484c-92db-243c2f72b5bd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:30.887608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20d63-3621-484c-92db-243c2f72b5bd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:30.887707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e20d63-3621-484c-92db-243c2f72b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:30.965754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-32e20d63-3621-484c-92db-243c2f72b5bd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:30.966957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32e20d63-3621-484c-92db-243c2f72b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:31.063913 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:31.217617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:31.219152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:31.304672 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:31.369372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffd4ae-a212-4455-a405-8dd4378dca53 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:31.491303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:31.491810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:31.492088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:31.492356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:31.494666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:31.543392 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:31.585692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:31.587339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad747-9d11-41fe-b3be-5ca957099d8d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:31.605917 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 705/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:32.666857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:32.667373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:32.667373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:32.668669 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:32.675158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05ca0-d13c-4da6-b770-97e71a15adc3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:32.675642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05ca0-d13c-4da6-b770-97e71a15adc3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:32.675743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f05ca0-d13c-4da6-b770-97e71a15adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:32.751922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68f05ca0-d13c-4da6-b770-97e71a15adc3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:32.753143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68f05ca0-d13c-4da6-b770-97e71a15adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:32.850296 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:33.001914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:33.003396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:33.053090 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.150096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1ff34-44e8-43c1-89d5-d29241a1e793 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:33.261308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:33.261870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:33.262407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:33.262691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:33.264302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:33.271310 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.355296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:33.356893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b089b-7f1a-4399-976a-841e709e09df service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:33.375608 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 725/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:34.454770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:34.455315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:34.455315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:34.456653 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:34.463549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3862bf-c7f3-4ca2-8f7d-b2673f57a561 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:34.464015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3862bf-c7f3-4ca2-8f7d-b2673f57a561 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:34.464114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3862bf-c7f3-4ca2-8f7d-b2673f57a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:34.542521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ee3862bf-c7f3-4ca2-8f7d-b2673f57a561 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:34.543741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee3862bf-c7f3-4ca2-8f7d-b2673f57a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:34.614147 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:34.644126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:52:34.797168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:34.798738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:34.816129 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:34.959624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf7be-84cf-4984-aecc-32eed3fc6396 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:35.050300 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:35.076692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:35.077327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:35.077639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:35.077917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:35.079527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:35.167944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:35.169515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee02d-fbe9-47cd-97c7-c2d7befd68f2 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:35.187885 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 708/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:36.256498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:36.257055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:36.257055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:36.258630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:36.265312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da9b9-ff3f-4449-aa4f-ff127352910f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:36.265853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da9b9-ff3f-4449-aa4f-ff127352910f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:36.269860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da9b9-ff3f-4449-aa4f-ff127352910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:36.349325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-962da9b9-ff3f-4449-aa4f-ff127352910f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:36.350570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-962da9b9-ff3f-4449-aa4f-ff127352910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:36.393288 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:36.449250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:36.604783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:36.606345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:36.758981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8493a2-8650-4bd7-904a-a0191cb91888 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:36.813176 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:36.872277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:36.872803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:36.873082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:36.873354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:36.874997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:36.975248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:36.976852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e4fc3-34e5-4447-80c1-fb152fd278d7 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:36.996190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 728/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:38.051051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:38.051543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:38.051654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:38.052932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:38.060006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9bf5-e3c5-4f44-9bce-9fccdcb63d19 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:38.061753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9bf5-e3c5-4f44-9bce-9fccdcb63d19 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:38.061753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9bf5-e3c5-4f44-9bce-9fccdcb63d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:38.139282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-39ef9bf5-e3c5-4f44-9bce-9fccdcb63d19 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:38.140502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39ef9bf5-e3c5-4f44-9bce-9fccdcb63d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:38.142548 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:38.238215 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:38.393443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:38.394980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:38.542303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58e08d-a560-4618-a639-1168dd64bcdb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:38.571748 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:38.657092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:38.657628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:38.657903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:38.658168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:38.659762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:38.749362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:38.750998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051319af-209a-44d4-8a59-f49f7686967b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:38.769388 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 711/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:40.864347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:40.864981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:40.864981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:40.866313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:40.871789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36adbc-d72b-4ca3-9979-7c86c2895336 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:40.872239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36adbc-d72b-4ca3-9979-7c86c2895336 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:40.872343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36adbc-d72b-4ca3-9979-7c86c2895336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:40.914531 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:40.940493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fa36adbc-d72b-4ca3-9979-7c86c2895336 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:40.941730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa36adbc-d72b-4ca3-9979-7c86c2895336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:41.040401 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:41.326347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:41.327876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:41.433828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1bf7f-3d4a-4199-bef7-8ee2ff3ef1e5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:41.468556 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:41.512852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:41.513494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:41.513775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:41.514043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:41.515638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:41.626355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:41.627707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b970-c727-40d1-9f44-a500528649e8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:41.646487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 731/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:44.021487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:44.021943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:44.022048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:44.023383 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:44.028726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13120-9fbd-4b4b-b9c4-0cecb442ef5b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:44.029220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13120-9fbd-4b4b-b9c4-0cecb442ef5b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:44.029329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13120-9fbd-4b4b-b9c4-0cecb442ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:44.108034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9c13120-9fbd-4b4b-b9c4-0cecb442ef5b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:44.109305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9c13120-9fbd-4b4b-b9c4-0cecb442ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:44.123627 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:44.210655 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:52:44.509981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:44.511542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:44.615198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7aea4-63d7-4708-9120-d1d685ef3f67 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:44.628626 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:44.692618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:44.693138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:44.693446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:44.693724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:44.695380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:44.806143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:44.807593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca5db-071d-4427-903c-695d7c2fc96b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:44.825460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 714/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:47.280116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:47.281028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:47.281028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:47.282062 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:47.287245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4205c-f95a-4c44-9375-1606147835b4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:47.287674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4205c-f95a-4c44-9375-1606147835b4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:47.287824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4205c-f95a-4c44-9375-1606147835b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:47.336376 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:47.355088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3dc4205c-f95a-4c44-9375-1606147835b4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:47.356299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3dc4205c-f95a-4c44-9375-1606147835b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:47.458415 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:47.745271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:47.748111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:47.866659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47db1c-5f4a-4b35-91cc-5b96f2e9ab87 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:47.908259 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:47.942880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:47.943492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:47.943772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:47.944043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:47.946229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:48.054089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:48.056327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748721a7-7366-477e-b817-4d2b7c276e7c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:48.076555 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 734/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:50.383403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:50.383987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:50.384100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:50.385448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:52:50.391488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581209-5b14-43c4-9ca9-7f50d51d30e4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:50.391919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581209-5b14-43c4-9ca9-7f50d51d30e4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:50.392083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581209-5b14-43c4-9ca9-7f50d51d30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:50.458558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-67581209-5b14-43c4-9ca9-7f50d51d30e4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:50.459779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67581209-5b14-43c4-9ca9-7f50d51d30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:50.481565 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:50.560937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:50.850230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:50.852647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:50.961910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd8fc-dbc9-42ea-a38e-f14038e24daa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:50.982536 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:51.038068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:51.038678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:51.039085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:51.039475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:51.041212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:51.153360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:51.154789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c630-d51c-4fa3-a17c-4b4264566ded service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:51.172901 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 717/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:53.481687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:53.482409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:53.482409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:53.483573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:53.489488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7065-359b-4f29-b79e-9f0f5a8fbff9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:53.489940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7065-359b-4f29-b79e-9f0f5a8fbff9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:53.490037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7065-359b-4f29-b79e-9f0f5a8fbff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:53.563460 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:53.566257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-080f7065-359b-4f29-b79e-9f0f5a8fbff9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:53.567492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-080f7065-359b-4f29-b79e-9f0f5a8fbff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:53.673290 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:53.966558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:53.968135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:54.086361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b4f0-dfde-420a-a20b-98c95fa93893 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:54.151759 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:54.177911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:54.178524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:54.178802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:54.179072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:54.180940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:54.306852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:54.308343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dcb83-ba9a-4db0-afa2-b558a7feca27 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:54.327716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 737/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:56.762594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:56.763159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:56.763159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:56.764454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:56.769869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e7d5-db42-4bdd-8d30-810d8e0cd998 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:56.770291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e7d5-db42-4bdd-8d30-810d8e0cd998 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:56.770419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e7d5-db42-4bdd-8d30-810d8e0cd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:56.837606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0474e7d5-db42-4bdd-8d30-810d8e0cd998 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:52:56.838824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0474e7d5-db42-4bdd-8d30-810d8e0cd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:56.868773 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:56.938699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:52:57.235962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:52:57.237584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:57.348091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede210b-99f3-43ac-9383-d5dfe2fc6c8a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:52:57.378013 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:57.445844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:52:57.446876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:57.447355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:57.447845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:57.450783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:52:57.578912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:52:57.580418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06621-8fa6-475c-88f1-717ce2ce8ea7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:52:57.600232 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 720/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:59.954779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:59.955352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:59.955352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:52:59.956669 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:52:59.963013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a81f7-7e8d-4be8-bc4d-19dd27e95858 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:52:59.963492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a81f7-7e8d-4be8-bc4d-19dd27e95858 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:52:59.963614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a81f7-7e8d-4be8-bc4d-19dd27e95858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:00.041430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-407a81f7-7e8d-4be8-bc4d-19dd27e95858 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:00.042673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-407a81f7-7e8d-4be8-bc4d-19dd27e95858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:00.051797 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:00.150925 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:00.449220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:00.450840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:00.569741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd046-d7bc-4ada-903b-1ee45de5e415 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:00.639597 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:00.662905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:00.664382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:00.664822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:00.665634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:00.667647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:00.800711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:00.802359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029243bc-ab7d-4bb2-b5cd-153c239b9b69 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:00.824322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 740/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:03.152756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:03.153376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:03.153376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:03.154685 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:03.160148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d4c1-503a-4a62-95c8-b6ee8b8ff0c5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:03.160564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d4c1-503a-4a62-95c8-b6ee8b8ff0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:03.160697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d4c1-503a-4a62-95c8-b6ee8b8ff0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:03.228872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b7a4d4c1-503a-4a62-95c8-b6ee8b8ff0c5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:03.230129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7a4d4c1-503a-4a62-95c8-b6ee8b8ff0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:03.269977 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:03.328854 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:03.617960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:03.619500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:03.733131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ea910-3624-42fe-9e96-d6536150b4c8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:03.775092 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:03.812598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:03.813206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:03.813510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:03.813786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:03.815396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:03.932329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:03.933733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f69b2-ab93-498e-ae5a-696d14da6a67 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:03.954779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 723/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:06.182439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:06.182977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:06.182977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:06.184350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:06.189708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283606-54ac-4d55-9d6d-09de6540226f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:06.190374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283606-54ac-4d55-9d6d-09de6540226f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:06.190374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe283606-54ac-4d55-9d6d-09de6540226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:06.374765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fe283606-54ac-4d55-9d6d-09de6540226f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:06.375971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fe283606-54ac-4d55-9d6d-09de6540226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:06.394621 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:06.473953 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:06.756533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:06.758877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:06.864483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846accc-8867-496e-8793-e6ef2a8af41b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:06.934462 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:06.941358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:06.942048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:06.942328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:06.942597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:06.944206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:07.053536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:07.056529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390badb-e75a-4e3f-a84b-803cc0f5a88e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:07.075223 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 743/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:09.268191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:09.268742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:09.268742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:09.270116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:09.275751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fa88-e185-47d7-bf3d-5291291603e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:09.276199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fa88-e185-47d7-bf3d-5291291603e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:09.276336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fa88-e185-47d7-bf3d-5291291603e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:09.347327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-68b7fa88-e185-47d7-bf3d-5291291603e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:09.348583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68b7fa88-e185-47d7-bf3d-5291291603e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:09.398420 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:09.449230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:09.733639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:09.735188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:09.843627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef12a-2bbb-4c9b-9c5c-dca534587e4b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:09.893169 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:09.919989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:09.920598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:09.920882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:09.921156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:09.922787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:10.035594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:10.037089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca648cbe-4e8b-4208-83e0-95d2d0046427 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:10.055588 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 726/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:19.447712 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=22 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:20.053092 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=66 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:30.463078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50584-f58e-4301-8a7c-7b1ed4d58a67 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:30.463644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50584-f58e-4301-8a7c-7b1ed4d58a67 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:30.463644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50584-f58e-4301-8a7c-7b1ed4d58a67 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:30.464969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 745/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:53:30.470178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524aab-679e-466e-b3b2-2f55574b132b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:30.470777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524aab-679e-466e-b3b2-2f55574b132b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:30.470777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524aab-679e-466e-b3b2-2f55574b132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:30.538948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-19524aab-679e-466e-b3b2-2f55574b132b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:30.540156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-19524aab-679e-466e-b3b2-2f55574b132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:30.640463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 727/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:30.939687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:30.939974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:30.940243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:30.941586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 746/1473] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 25 00:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:30.947190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61ee6-a4e0-49cb-94a1-346014f7d99f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:30.947482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61ee6-a4e0-49cb-94a1-346014f7d99f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:30.947790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61ee6-a4e0-49cb-94a1-346014f7d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:31.021981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a1c61ee6-a4e0-49cb-94a1-346014f7d99f None None] MFA Rules not processed for user `8565cc85e8a149ac8761b7f687ff7552`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:31.024229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a1c61ee6-a4e0-49cb-94a1-346014f7d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:31.045065 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:31.100682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 728/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 25 00:53:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:31.108903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:31.110482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:31.214167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0e8ce-f30e-4bbb-a7db-f3d007d03664 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:31.288588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:31.289186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:31.289493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:31.289766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:31.291356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:31.463060 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:31.521490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:31.523130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc195b3e-0162-419f-a79b-4fcbd0d1de0e service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:31.541579 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 747/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:33.808821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:33.809396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:33.809396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:33.810825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 729/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:33.816462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922c6c6-8298-4a2e-824a-dee44a0e41be None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:33.816959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922c6c6-8298-4a2e-824a-dee44a0e41be None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:33.817062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922c6c6-8298-4a2e-824a-dee44a0e41be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:33.883083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3922c6c6-8298-4a2e-824a-dee44a0e41be None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:33.884292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3922c6c6-8298-4a2e-824a-dee44a0e41be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:33.984785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 748/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:34.266723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:34.268287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:34.397892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd8d3-55cb-456c-8f0e-af67c2a8cd3f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:34.448413 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:34.493879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:34.494474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:34.494749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:34.495012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:34.495638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:34.497371 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:53:34.497371 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 00:53:34.497371 n-d-master-1 devstack@keystone.service[81862]: Sep 25 00:53:34.498544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358b08-d622-42cf-a9c1-6250765390c4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:34.518307 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 730/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 25 00:53:34 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:53:36.687412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:36.687974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:36.688205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:36.690798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 749/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 00:53:36.696253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b39b-89cc-4e5d-8cf9-07ac2b895d2f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:36.696752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b39b-89cc-4e5d-8cf9-07ac2b895d2f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:36.696859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b39b-89cc-4e5d-8cf9-07ac2b895d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:36.763362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7ac7b39b-89cc-4e5d-8cf9-07ac2b895d2f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:36.764595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7ac7b39b-89cc-4e5d-8cf9-07ac2b895d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:36.862113 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 731/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:37.158439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:37.159964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:37.170943 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:37.308092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5efae-fd5f-4b0d-8028-b83a167cff70 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:37.392011 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:37.422798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:37.423362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:37.423638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:37.423911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:37.425546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:37.514649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:37.516246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ef5ae-76cd-4ff3-a682-89a7b4b5a147 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:37.534942 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 750/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:53:39.906567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:39.907160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:39.907160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:39.908506 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 732/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:39.914330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a10-72c0-48bf-861a-d6a2f6d96cc5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:39.914889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a10-72c0-48bf-861a-d6a2f6d96cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:39.914889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a10-72c0-48bf-861a-d6a2f6d96cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:39.985041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d361a10-72c0-48bf-861a-d6a2f6d96cc5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:39.986375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d361a10-72c0-48bf-861a-d6a2f6d96cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:40.039254 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:40.092342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 751/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:40.381960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:40.383587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:40.415237 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:40.502992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2487a-67b0-4e80-b6ec-f37dbf71e935 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:40.585635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:40.586255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:40.586537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:40.586810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:40.588473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:40.668037 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:40.705624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:40.707100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e6bc5-e125-46f6-95a2-2aa142892808 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:40.725900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 733/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:42.969834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:42.970439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:42.970439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:42.971747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 752/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:42.978001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf295c0-6432-4164-aa6f-074d198176d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:42.978499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf295c0-6432-4164-aa6f-074d198176d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:42.978607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf295c0-6432-4164-aa6f-074d198176d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:43.045561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bdf295c0-6432-4164-aa6f-074d198176d0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:43.046769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bdf295c0-6432-4164-aa6f-074d198176d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:43.147199 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 734/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:43.438358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:43.439941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:43.545379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e47d-3f3e-42c8-82c5-a585366fc71d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:43.623093 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:43.624683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:43.625443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:43.625920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:43.626196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:43.628407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:43.752781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:43.754188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4268fc-49de-47a2-b154-b1250e00f4cb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:43.774763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 753/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:46.110932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:46.111462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:46.111462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:46.112820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 735/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:46.118281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8b4b-9e6f-4a2c-94ae-23ea98f8b9ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:46.118738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8b4b-9e6f-4a2c-94ae-23ea98f8b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:46.118847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8b4b-9e6f-4a2c-94ae-23ea98f8b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:46.188940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ccb8b4b-9e6f-4a2c-94ae-23ea98f8b9ed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:46.190195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ccb8b4b-9e6f-4a2c-94ae-23ea98f8b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:46.243890 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:46.288624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 754/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:46.581030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:46.582604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:46.618652 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:46.687944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9a81-2cf9-433c-a7f5-2869cc578b03 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:46.763377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:46.763984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:46.764263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:46.764535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:46.766184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:46.860006 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:46.889510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:46.890961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb038c8-5af4-4471-aea3-f1b92c2a9a2a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:46.908616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 736/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:49.287522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:49.288025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:49.288335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:49.289728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 755/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 25 00:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:53:49.295198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2df37-bb6d-4e05-9eea-488720119df2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:49.295818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2df37-bb6d-4e05-9eea-488720119df2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:49.295818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2df37-bb6d-4e05-9eea-488720119df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:49.363324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a0b2df37-bb6d-4e05-9eea-488720119df2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:53:49.364556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a0b2df37-bb6d-4e05-9eea-488720119df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:49.464544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 737/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 25 00:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:53:49.757831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:53:49.759396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:49.867750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ac83-f394-4eb2-bd64-d0039a500141 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:53:49.943850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:53:49.944456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:53:49.944737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:53:49.945007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:53:49.946652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:53:49.955194 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:50.057853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:53:50.059287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87e24-cc09-4952-bc51-33291400590a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:53:50.077129 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 756/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:59.462985 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:00.074897 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=50 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:04.500532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:04.501129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:04.501129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:04.581561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:04.582811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:04.684514 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 738/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:04.692653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:04.693193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:04.693193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:04.780427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:04.781686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:04.883321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 757/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:04.888227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:04.889472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:04.901095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc67eba-b1cc-4acd-b1c6-2755b46e3a92 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:04.964036 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:04.999260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:04.999860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.000132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.000395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.001027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 00:55:05.001321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.002382 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.002382 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 00:55:05.002382 n-d-master-1 devstack@keystone.service[81862]: Sep 25 00:55:05.003466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.022752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 739/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 00:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:55:05.031176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:05.041589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac384-0429-4557-8910-4d42785d1dbf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:05.104122 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:05.137860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:05.138464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.138739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.139002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.139633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.141367 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.141367 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 00:55:05.141367 n-d-master-1 devstack@keystone.service[81863]: Sep 25 00:55:05.142594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.201493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 758/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 00:55:05 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:55:05.206992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:05.208531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:05.248117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d4eb7-cea5-40c2-a196-c4c04ac6afce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:05.346264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:05.347531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.347813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.348085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.348718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.349815 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.349815 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 00:55:05.349815 n-d-master-1 devstack@keystone.service[81862]: Sep 25 00:55:05.351046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.402124 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 740/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 00:55:05 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 00:55:05.406356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:05.407880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:05.473635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5572-4f87-41ff-9b47-c3c2361a8fdd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:05.561716 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:05.573749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:05.574362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.574682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.574947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.575584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.576596 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.576596 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 00:55:05.576596 n-d-master-1 devstack@keystone.service[81863]: Sep 25 00:55:05.577505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.591213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 759/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:55:05.595522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:05.597068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:05.608671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514442-c3da-4f11-a452-ca7366c3f76c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:05.634128 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:05.708279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:05.708895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.709171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.709486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.710144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.711198 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.711198 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 00:55:05.711198 n-d-master-1 devstack@keystone.service[81862]: Sep 25 00:55:05.712100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6015160-47e6-450c-9fb7-0251e2b68a4d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.725546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 741/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 00:55:05.729887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:05.731412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:05.772693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e754ca-7152-4257-97cd-43cca300f602 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:05.876736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:05.877375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.878291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.878565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] PATH_INFO: `/v3/projects/fd71fcd5676b45449f52f186c2dc66e8/users/3f5a002bdcc54e60b1e9b3c653d59e94/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:05.901645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd71fcd5676b45449f52f186c2dc66e8, user_id=3f5a002bdcc54e60b1e9b3c653d59e94, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:05.902692 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:05.902692 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 00:55:05.902692 n-d-master-1 devstack@keystone.service[81863]: Sep 25 00:55:05.904647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a66c8c-948f-4f4a-b05d-f2a702de4ccc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:05.930098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 760/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 00:55:05 2022] PUT /identity/v3/projects/fd71fcd5676b45449f52f186c2dc66e8/users/3f5a002bdcc54e60b1e9b3c653d59e94/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:55:05.944227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c786-f17b-4c68-a7ec-15c6b52b42a9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:05.944682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c786-f17b-4c68-a7ec-15c6b52b42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:05.944957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c786-f17b-4c68-a7ec-15c6b52b42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.008826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bab9c786-f17b-4c68-a7ec-15c6b52b42a9 None None] MFA Rules not processed for user `3f5a002bdcc54e60b1e9b3c653d59e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:06.010105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bab9c786-f17b-4c68-a7ec-15c6b52b42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:06.090409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 742/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:06.104058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:06.104460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:06.104767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.106180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 761/1503] 10.222.0.16 () {54 vars in 963 bytes} [Sun Sep 25 00:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:55:06.113342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0284c-ba6f-4e78-ab24-8d8398c55ad5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:06.113798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0284c-ba6f-4e78-ab24-8d8398c55ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:06.114178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0284c-ba6f-4e78-ab24-8d8398c55ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.146723 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:06.194196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-15d0284c-ba6f-4e78-ab24-8d8398c55ad5 None None] MFA Rules not processed for user `fe9dafd81a8947f79616064549817153`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:06.195274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15d0284c-ba6f-4e78-ab24-8d8398c55ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:06.279766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 743/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 25 00:55:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:06.288313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:06.290076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:06.341508 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:06.401526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b69f7-c3f9-4406-88f8-16429dd7931c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:06.480012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:06.480622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:06.480901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:06.481172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.482804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:06.590312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:06.591764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:06.595361 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:06.610346 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 762/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:55:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:55:06.658052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461ba5-6791-492b-ab8f-30d811bd3635 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:06.658502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461ba5-6791-492b-ab8f-30d811bd3635 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:06.658683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461ba5-6791-492b-ab8f-30d811bd3635 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.659948 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 744/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sun Sep 25 00:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:55:06.663769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:06.664984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:06.770633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63127f-2030-4062-bd9f-6a44e24f87da service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:06.884375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:06.885010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:06.885281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:06.885583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] PATH_INFO: `/v3/users/3f5a002bdcc54e60b1e9b3c653d59e94` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:06.900238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5a002bdcc54e60b1e9b3c653d59e94)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:06.901282 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:06.901282 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 00:55:06.901282 n-d-master-1 devstack@keystone.service[81863]: Sep 25 00:55:06.902597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:06.914057 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:06.973144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5a002bdcc54e60b1e9b3c653d59e94'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:06.989059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5a002bdcc54e60b1e9b3c653d59e94'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:07.013365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5a002bdcc54e60b1e9b3c653d59e94'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:07.013988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5a002bdcc54e60b1e9b3c653d59e94'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:07.014417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5a002bdcc54e60b1e9b3c653d59e94'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:07.030727 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 763/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 00:55:06 2022] DELETE /identity/v3/users/3f5a002bdcc54e60b1e9b3c653d59e94 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:55:07.036510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:07.036811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:07.037120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:07.095979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:55:07.097327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:07.176876 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:07.190590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 745/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:55:07.200904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:07.202255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:07.308877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5f1a-7447-4f44-a54a-a54544d5ee61 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:07.365772 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:07.389286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:07.389449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:07.389679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:07.389948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:07.391545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:07.509053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:07.510463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d34e0-b4d5-40c3-8f38-1a0da4ef4318 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:07.529903 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 764/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:55:07.868588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:55:07.869934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:55:07.882506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd0d-cf71-4fdf-af62-b325c3386c1c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:55:07.986548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:55:07.987786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:55:07.988066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:55:07.988332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] PATH_INFO: `/v3/projects/fd71fcd5676b45449f52f186c2dc66e8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:55:07.998387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd71fcd5676b45449f52f186c2dc66e8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:55:07.999447 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 00:55:07.999447 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 00:55:07.999447 n-d-master-1 devstack@keystone.service[81862]: Sep 25 00:55:08.000644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:55:08.059815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd71fcd5676b45449f52f186c2dc66e8', 'request_id': 'req-e099ee8a-c974-47fc-9add-3b89f11ea420'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:08.074434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd71fcd5676b45449f52f186c2dc66e8', 'request_id': 'req-e099ee8a-c974-47fc-9add-3b89f11ea420'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:08.085382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd71fcd5676b45449f52f186c2dc66e8', 'request_id': 'req-e099ee8a-c974-47fc-9add-3b89f11ea420'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:08.113999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] The token cache is being invalidate because project fd71fcd5676b45449f52f186c2dc66e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 00:55:08.114295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:08.114827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e099ee8a-c974-47fc-9add-3b89f11ea420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 00:55:08.116149 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 746/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 00:55:07 2022] DELETE /identity/v3/projects/fd71fcd5676b45449f52f186c2dc66e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 00:55:17.527356 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=62 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:55:18.111223 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:36.079661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bd19d-9c68-4b05-9a40-e64ffdb8d2a9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:36.080471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bd19d-9c68-4b05-9a40-e64ffdb8d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:36.080471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bd19d-9c68-4b05-9a40-e64ffdb8d2a9 None None] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:36.082551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 765/1511] 10.222.0.55 () {54 vars in 925 bytes} [Sun Sep 25 00:58:36 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 00:58:36.095115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7531-6991-4478-b5f9-025e63be8d94 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:36.095719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7531-6991-4478-b5f9-025e63be8d94 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:36.095820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7531-6991-4478-b5f9-025e63be8d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:36.204802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-df1a7531-6991-4478-b5f9-025e63be8d94 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:36.206087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df1a7531-6991-4478-b5f9-025e63be8d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:36.370730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 747/1512] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Sep 25 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 00:58:37.212656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a242a5-5b02-4945-98f7-1ceb5ffe03b2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:37.213281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a242a5-5b02-4945-98f7-1ceb5ffe03b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:37.213499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a242a5-5b02-4945-98f7-1ceb5ffe03b2 None None] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:37.214888 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 766/1513] 10.222.0.48 () {54 vars in 925 bytes} [Sun Sep 25 00:58:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 00:58:37.221288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadb728-2a8b-4449-b614-c69b23dc9283 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:37.221946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadb728-2a8b-4449-b614-c69b23dc9283 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:37.221946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadb728-2a8b-4449-b614-c69b23dc9283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:37.244725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-deadb728-2a8b-4449-b614-c69b23dc9283 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:37.246559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-deadb728-2a8b-4449-b614-c69b23dc9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:37.256304 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 748/1514] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Sep 25 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:45.547723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b61c-13bf-49db-8218-320972f9defb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.548614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b61c-13bf-49db-8218-320972f9defb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.548614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b61c-13bf-49db-8218-320972f9defb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.550722 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 767/1515] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 00:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:58:45.559725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e877-a906-4265-ac7b-1f2dc9fbf39c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.560389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e877-a906-4265-ac7b-1f2dc9fbf39c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.560857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378e877-a906-4265-ac7b-1f2dc9fbf39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.591651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b378e877-a906-4265-ac7b-1f2dc9fbf39c None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:45.592890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b378e877-a906-4265-ac7b-1f2dc9fbf39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:45.606237 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 749/1516] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:45.622378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973b61c-13bf-49db-8218-320972f9defb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:45.644623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973b61c-13bf-49db-8218-320972f9defb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:45.653319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:45.654257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.654710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.655089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.668363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:45.670238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9caa-ebd8-4322-8893-d906e34b67c5 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:45.685101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 768/1517] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:58:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 00:58:45.736180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da2bbb-d9a1-48ca-b858-7b9237b9118d None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.736812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da2bbb-d9a1-48ca-b858-7b9237b9118d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.737560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da2bbb-d9a1-48ca-b858-7b9237b9118d None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.739228 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 750/1518] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 00:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:58:45.745239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333933e9-95e5-429d-b958-23b0119f55ae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.745776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333933e9-95e5-429d-b958-23b0119f55ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.746115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333933e9-95e5-429d-b958-23b0119f55ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.774706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-333933e9-95e5-429d-b958-23b0119f55ae None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:45.776668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-333933e9-95e5-429d-b958-23b0119f55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:45.791320 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 769/1519] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:45.798895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da2bbb-d9a1-48ca-b858-7b9237b9118d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:45.828813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da2bbb-d9a1-48ca-b858-7b9237b9118d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:45.835402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:45.836255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:45.836579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:45.836893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:45.847912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:45.849696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94b88-db26-4a74-9c8b-ad9b378525f8 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:45.861309 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 751/1520] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:58:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:58:55.766473 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:55.856446 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:57.902958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:57.903672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:57.903672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:57.904916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 770/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:58:57.910674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a330c2-080f-4815-b8ea-f551f2b8f5f8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:57.910674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a330c2-080f-4815-b8ea-f551f2b8f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:57.911808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a330c2-080f-4815-b8ea-f551f2b8f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:57.976716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-98a330c2-080f-4815-b8ea-f551f2b8f5f8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:57.977951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-98a330c2-080f-4815-b8ea-f551f2b8f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:58.061950 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 752/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:58.221544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:58.223610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:58.331724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b17830-b88c-462e-bfc0-997487466ddb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:58.337367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:58.337997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:58.338280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:58.338556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:58.347483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:58.349111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c718-e790-4ac0-be13-7bd9804ed587 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:58.359696 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 771/1523] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:58:59.520017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58924-23d0-44c0-9244-b9c5bd5fb1aa None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:59.520599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58924-23d0-44c0-9244-b9c5bd5fb1aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:59.520599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58924-23d0-44c0-9244-b9c5bd5fb1aa None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:59.521988 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 753/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 25 00:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:58:59.529321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d29f2-c59c-44f1-8cfe-e542d27a4194 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:59.530190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d29f2-c59c-44f1-8cfe-e542d27a4194 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:59.530190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d29f2-c59c-44f1-8cfe-e542d27a4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:59.552796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fb3d29f2-c59c-44f1-8cfe-e542d27a4194 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:58:59.554450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb3d29f2-c59c-44f1-8cfe-e542d27a4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:58:59.564494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 772/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 25 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:58:59.730281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58924-23d0-44c0-9244-b9c5bd5fb1aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:58:59.744824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58924-23d0-44c0-9244-b9c5bd5fb1aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:58:59.751499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:58:59.752122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:58:59.752404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:58:59.752680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:58:59.762992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:58:59.764632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060161-931f-4fdf-96d1-eeec84d3d9df service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:58:59.775320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 754/1526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:03.835957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:03.836540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:03.836845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:03.838869 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 773/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:59:03.846944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66f20-d701-4491-b4c1-89386f44ce1c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:03.847937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66f20-d701-4491-b4c1-89386f44ce1c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:03.847937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66f20-d701-4491-b4c1-89386f44ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:03.870634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85c66f20-d701-4491-b4c1-89386f44ce1c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:59:03.871885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85c66f20-d701-4491-b4c1-89386f44ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:03.880536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 755/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:59:04.182191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:04.184780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:04.270659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4062d-d1d3-4b39-9941-c3b47cc12709 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:04.274364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:04.274977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:04.275257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:04.275530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:04.285147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:04.286654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f70cb-9641-4999-b9a6-d5b5f7c3fb8b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:04.297008 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 774/1529] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:06.594502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:06.595054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:06.595054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:06.596409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 756/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 25 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:59:06.602736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62fad-3da3-435a-bfc0-96ccf0d192c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:06.603252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62fad-3da3-435a-bfc0-96ccf0d192c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:06.603359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62fad-3da3-435a-bfc0-96ccf0d192c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:06.625772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-afc62fad-3da3-435a-bfc0-96ccf0d192c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:59:06.627025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afc62fad-3da3-435a-bfc0-96ccf0d192c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:06.636567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 775/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 25 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 00:59:06.938804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 00:59:06.940546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:06.954805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff62b3e-656b-43e8-b6f1-36f265def213 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 00:59:06.958644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 00:59:06.959263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:06.959538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:06.959811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:06.970704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 00:59:06.972176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7927-a1d8-46ca-a9cc-6d400a8b4334 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 00:59:06.983738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 757/1532] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 00:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 00:59:16.619233 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:16.978059 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=65 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:57.702282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd87c-93d2-4fde-b5c5-2ba602209232 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:57.702787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd87c-93d2-4fde-b5c5-2ba602209232 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:57.702787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd87c-93d2-4fde-b5c5-2ba602209232 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:57.704133 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 776/1533] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 00:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 00:59:57.711185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f1e4-eef9-46ef-9704-810eb98d9213 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 00:59:57.711742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f1e4-eef9-46ef-9704-810eb98d9213 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 00:59:57.711829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f1e4-eef9-46ef-9704-810eb98d9213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 00:59:57.740452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4828f1e4-eef9-46ef-9704-810eb98d9213 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 00:59:57.741716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4828f1e4-eef9-46ef-9704-810eb98d9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 00:59:57.752265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 758/1534] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:07.733732 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:30.766461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a4bc-4d09-404f-b887-041c351de77c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.767003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a4bc-4d09-404f-b887-041c351de77c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.767003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a4bc-4d09-404f-b887-041c351de77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.794447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-60f3a4bc-4d09-404f-b887-041c351de77c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:30.795812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60f3a4bc-4d09-404f-b887-041c351de77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:30.806023 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 777/1535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:30.815749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.816281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.816369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.846415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:30.847637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:30.852079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bbd1-4b48-40c0-b54d-d51459220997 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.852466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bbd1-4b48-40c0-b54d-d51459220997 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.852651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bbd1-4b48-40c0-b54d-d51459220997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.860476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 759/1536] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:30.865187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:30.878976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492640ff-8db4-481f-8cc9-6a470432468f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:30.886597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e1a5bbd1-4b48-40c0-b54d-d51459220997 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:30.887855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e1a5bbd1-4b48-40c0-b54d-d51459220997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:30.890172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:30.890921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.891200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.891472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.892129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:30.892431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:30.894258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:30.914229 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 778/1537] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:00:30.919632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 760/1538] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:00:30.932359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c971a-9215-4301-baf4-84f5c0530317 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.932690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c971a-9215-4301-baf4-84f5c0530317 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.932922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c971a-9215-4301-baf4-84f5c0530317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.933745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:30.949846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3d2c5-ef02-437d-ac53-e0e18b6200f9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:30.960232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:30.960861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:30.961687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:30.961967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:30.962691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:30.964082 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:30.964082 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:00:30.964082 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:00:30.965491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:30.976272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa6c971a-9215-4301-baf4-84f5c0530317 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:30.977920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa6c971a-9215-4301-baf4-84f5c0530317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:30.998595 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 779/1539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:30.999988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.000281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.000557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.031514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.033553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.037621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 761/1540] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:00:31.038519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.187264 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 780/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.196781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1773a4-a985-43c4-af4d-d44e96640840 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.197858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.210151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.210789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.211122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.211572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.212250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.212552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.218439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013d5fc-f819-4c6a-bab6-c6e58ae84a9a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.220041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5a64-89d8-4361-b852-27fea6283157 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.233144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.233791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.234072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.234342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.234985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.239936 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:31.239936 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:00:31.239936 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:00:31.239936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe9e9-244e-4ac5-88c2-ed86bcbe67a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.247927 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 762/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.249318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee49b-1ac2-437e-b958-3ffe539a710c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.249730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee49b-1ac2-437e-b958-3ffe539a710c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.250056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee49b-1ac2-437e-b958-3ffe539a710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.267664 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 781/1543] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/users => generated 286 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:31.269330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14fa0-d663-45ec-9830-b12ef35c99b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.269799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14fa0-d663-45ec-9830-b12ef35c99b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.270226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14fa0-d663-45ec-9830-b12ef35c99b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.283091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8caee49b-1ac2-437e-b958-3ffe539a710c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.284575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8caee49b-1ac2-437e-b958-3ffe539a710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.294271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-96d14fa0-d663-45ec-9830-b12ef35c99b1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.295245 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 763/1544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.295487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96d14fa0-d663-45ec-9830-b12ef35c99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.302919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b838-5529-47a2-9029-ba7a089f6b8e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.303208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b838-5529-47a2-9029-ba7a089f6b8e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.303482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b838-5529-47a2-9029-ba7a089f6b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.305932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 782/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.307163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.307450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.307728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.326916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c635b838-5529-47a2-9029-ba7a089f6b8e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.328316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.328514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c635b838-5529-47a2-9029-ba7a089f6b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.329519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.337599 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 764/1546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.338640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.338927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.339203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.345925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 783/1547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.346886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.357501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ade0-90b6-4c4e-bf6f-919b50584ed7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.360276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.361509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.363634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.364211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.364498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.364771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.365444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.367148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0172b-6051-4c9a-8b0e-e65666f939dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.371816 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 765/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.372605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.381999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b42a-9008-47cc-859d-4d05c53d4a93 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.382218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 784/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:31.383644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a199-b900-4746-8212-f0ba3e3a70ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.383938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a199-b900-4746-8212-f0ba3e3a70ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.384196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a199-b900-4746-8212-f0ba3e3a70ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.388692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.389321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.389636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.389896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.390538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.392475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09dce5-73df-46e5-8d6c-3b2e2394809e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.404926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f021a199-b900-4746-8212-f0ba3e3a70ec None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.406171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f021a199-b900-4746-8212-f0ba3e3a70ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.414761 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 785/1550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.416025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.416318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.416596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.429062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 766/1551] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:31.429062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832cab-2122-472b-8c7a-45baec29069d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.429062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832cab-2122-472b-8c7a-45baec29069d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.429062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832cab-2122-472b-8c7a-45baec29069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.437896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.439124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.452364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e3832cab-2122-472b-8c7a-45baec29069d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.453842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e3832cab-2122-472b-8c7a-45baec29069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.518173 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 786/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.519165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.528071 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 767/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.529479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.529708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.529980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.533897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0820b-ef70-4afe-8543-f4913fac8f75 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.539558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.540196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.540535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.540821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.541515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.542482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.542834 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:31.542834 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:00:31.542834 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:00:31.543746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc81e-d25d-4986-9096-81a124977d83 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.544462 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:31.560829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.562453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.570446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 787/1554] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.570446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c22b-aa54-482e-9bc6-c41d54ef6dc3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.570446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c22b-aa54-482e-9bc6-c41d54ef6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.570446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c22b-aa54-482e-9bc6-c41d54ef6dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.575604 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 768/1555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.575604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.583372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ae358-6c90-4b69-9556-98c15f5f41b0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.590825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.591915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.592414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.592903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.593977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.595418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51b6c22b-aa54-482e-9bc6-c41d54ef6dc3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.596637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51b6c22b-aa54-482e-9bc6-c41d54ef6dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.597092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.605261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 788/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.610007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.610722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.611102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.614054 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 769/1557] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:31.616587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.627940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6db1-d7e3-45b1-a4c8-49a832c33d8b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.632757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.634116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.634401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.634664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.635295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.637188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:31.637311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.637904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:31.651741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 789/1558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:31.652921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.664831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 770/1559] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:31.664831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.665262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb20b3-bf3f-4dc0-9b3a-f05c843910c9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.669466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.670125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.670416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.670681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.671421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.672338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.674015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d315-0731-48d8-af07-de5de3426434 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.674346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.676219 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:31.680599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.681849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.682423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.682839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.683683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.684074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.685881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.690932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 790/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.691821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.707187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee7d2-0214-4cf7-8a44-31f6491e0f9c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.717392 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 771/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.717392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.717692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.717692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.717692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.717692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.718005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.718510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.728825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56b52-8472-4559-9a8c-dc9884f01f04 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.733852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.734492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.734748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.735015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.735661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.735959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.737600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.751600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 772/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.752430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.753479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 791/1563] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:31.754491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.763003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443834bd-3153-47d5-ac55-df03d60605d5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.827819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.828507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.828625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.828896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.829584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.829888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.831695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.837796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ea7e-6e1e-4a36-a101-bf5f73b51413 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.843533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.844217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.844579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.844845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] PATH_INFO: `/v3/projects/d82812a8bae040f986d216e153fad766/users/f660c178c57142a89005270585593091/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.845924 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 773/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.846770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.857651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd0f54-ebb8-4e4c-9e68-206d9c79d753 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.861880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82812a8bae040f986d216e153fad766, user_id=f660c178c57142a89005270585593091, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.862385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.862989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.863274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.863544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.864507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:31.864686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.864804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.866336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.879607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 792/1565] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:31 2022] PUT /identity/v3/projects/d82812a8bae040f986d216e153fad766/users/f660c178c57142a89005270585593091/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:31.879831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 774/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:31.880978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.882069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.894505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd11c6-a82e-429b-bfbb-c6099032f7ad admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.955024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.955680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.955963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.956236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.956873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.956976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0495b7-2ba9-4c4f-8891-f46e57a283ce admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.958856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.962585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:31.963192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:31.963470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:31.963738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:31.964485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:31.966028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:31.978577 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 793/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:31.979741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:31.993283 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 775/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:31.993518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f43b5-6d39-49b7-8a98-8b7a3687db45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:31.993628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.002647 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.047215 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.058232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.058862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.059164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.059446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.060082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.062044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.062297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b258b-ef2e-424b-9fb5-c9cb5fc1dab5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.067903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.068579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.068875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.069148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.069815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.072784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.098155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 794/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.098155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.106345 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 776/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:31 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.107387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.161579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21399748-6c51-46cd-8066-f8770e797e93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.174595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbee9-3b55-4c89-aff8-94c9f441dc40 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.179583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.181203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.181203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.181203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.181703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.183629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.212777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 777/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.213866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.223081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.223696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.223979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.224252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.224924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.226974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9b0ea-1084-413f-b79d-709c23173134 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.249486 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 795/1572] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.250757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.251047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.251325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.280899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] MFA Rules not processed for user `f660c178c57142a89005270585593091`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:32.281276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a61295-1a28-470a-86f4-87f122c820f1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.287120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:32.287285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.287285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.287285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.287590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.288217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.290410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.325346 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 778/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.325346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.328532 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.376527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 796/1574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:32.377416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.383130 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.390837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88032-4702-441c-9d3a-cad87933682c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.412726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832b941-de7b-4b99-a3b7-b559f20e2e66 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.419204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.420134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.420415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.420723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.421360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.423030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.434167 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 779/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.435390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.447499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c3b01-f68b-4d93-97da-92b5b17689fb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.452350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.452968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.453249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.453568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.454209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.456163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.465771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.466401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.466708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.466983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.467623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.469684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.480738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 780/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.483312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.495202 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 797/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.496756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.499130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf15d4-e26b-4ea6-bb10-3a13c6ee1002 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.506292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.507054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.507513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.507999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.509846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.513263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.514601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a00-b798-4ba6-82bc-0b12d5cdc8a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.521324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.522284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.522724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.523173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.524317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.527777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.544058 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 781/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.544853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.557396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8fb3-b852-49ac-85ee-34ca82301dfe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.562857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 798/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 297 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.562857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.565799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.566414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.566724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.566999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.567646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.569261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.570063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6629c-1532-483e-a530-119a3f8526e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.575933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.576568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.576872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.577145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.577803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.579702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.581034 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 782/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.584406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.591955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749942-f18d-44f1-a133-55bc5ae2953d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.597422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.598092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.598634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.598634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.599242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.601140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.604824 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 799/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.605583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.615257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00fd60-891c-4b77-9b76-b528eadb6dc9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.620761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.621452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.621735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.622014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] PATH_INFO: `/v3/projects/aac6041823d94dacbd14bd62237e6155/users/3bed0270d77f471db82cec87e3063070/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.640198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 783/1582] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.641435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac6041823d94dacbd14bd62237e6155, user_id=3bed0270d77f471db82cec87e3063070, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.641715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.644557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.661296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 800/1583] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:32 2022] PUT /identity/v3/projects/aac6041823d94dacbd14bd62237e6155/users/3bed0270d77f471db82cec87e3063070/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:32.662562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.711674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d05ce-427d-45ab-91da-a6d18416a70c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.749036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423239ec-10c9-463b-882f-aee7bee43e1f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.754476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.755093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.755373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.755647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.755904 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.756299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.758388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.769265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 801/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.770416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.780719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47fe9a-0d75-4586-ac42-928a629b36ea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.783068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.783688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.784110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.784391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.785159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.785466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.786071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.786359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.786633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.786824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.787273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.788853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.797696 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 784/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.798513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.802764 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 802/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.803591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.812004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39686-5ee5-4c85-89f7-8f50f63e4be4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.814383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a880e-93f2-4c2a-8310-9a5313d3a9f0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.817510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.818128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.818414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.818682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.819321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.819463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.819926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.820208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.820504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.821676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.821829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.823296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.835350 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 785/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.835350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.835932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 803/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.835932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.846681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4b9-41ad-4a6e-b56b-da062309df90 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.847010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ff94-3497-492a-8acf-fc487a78695e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.851421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.851778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.852082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.852363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.852524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.852636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.852713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.852930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.853253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.853563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.854889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798968e5-ae60-4f16-b735-eb865a19d880 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.855472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.863609 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:32.866671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 786/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.868671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.868947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.869220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.882752 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 804/1590] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:32.884186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.894036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de72b-741c-4791-b879-6e501bbadcea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.898618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.899229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.899501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.899774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.900413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.902077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.903061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] MFA Rules not processed for user `3bed0270d77f471db82cec87e3063070`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:32.904317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:32.913266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 805/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.914206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.923840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0220b71-124f-4842-b6d6-c0b16a24a8da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.929338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.930712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.930840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.931054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.931692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.933369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.944477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 806/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.945310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.955775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114daa6-631a-4fcf-b1a4-6f19dbe4ffb8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.960522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.961805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.962137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.962391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.963025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.964620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:32.978238 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 787/1593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:32.978402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 807/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:32.978506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.978608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:32.987936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc144-c65f-4cc0-86e2-e91e36bdb36f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.988763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789384-2d47-4dea-94fe-6c7daf34cc8e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:32.993364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.993860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:32.994078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.994358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.994449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:32.994633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] PATH_INFO: `/v3/projects/f09c899b1de245769f6dc20447ed3354/users/67acf709beef4dbf8ba7e613949146c8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.994726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:32.994986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:32.995629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:32.997250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.007890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 788/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:33.009575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.017767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09c899b1de245769f6dc20447ed3354, user_id=67acf709beef4dbf8ba7e613949146c8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.019552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133d8c-16d4-431a-b7ef-9178030aef42 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.020676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.024542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.025209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.025569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.026390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.027163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.029118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.035799 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 808/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:32 2022] PUT /identity/v3/projects/f09c899b1de245769f6dc20447ed3354/users/67acf709beef4dbf8ba7e613949146c8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.036981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.043042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 789/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:33.043042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.053085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19602-1fee-4814-94e8-0ec98cc1d6c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.103422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10192a62-78c9-4935-8df6-7550e9819858 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.108649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.109310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.109604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.109877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.111533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.111672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.112195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.112483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.112759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] PATH_INFO: `/v3/projects/30785e233cce4faf935d12f26be0db4d/users/8fa94183119e4b1e93721001f72404c5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.113223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.126947 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 809/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:33.126947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.131442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30785e233cce4faf935d12f26be0db4d, user_id=8fa94183119e4b1e93721001f72404c5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.132853 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:33.132853 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:00:33.132853 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:00:33.134643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f01f9-d2f4-403b-89de-36e536a00d71 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.135344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.139910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.140537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.140815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.141103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] PATH_INFO: `/v3/projects/66595ae4cf724de68e6880b89c32bc77/users/fd8db2556a4c4ccba1166838c711664d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.151363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 790/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/30785e233cce4faf935d12f26be0db4d/users/8fa94183119e4b1e93721001f72404c5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.152172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.165964 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.168751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66595ae4cf724de68e6880b89c32bc77, user_id=fd8db2556a4c4ccba1166838c711664d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.171539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.187131 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 810/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/66595ae4cf724de68e6880b89c32bc77/users/fd8db2556a4c4ccba1166838c711664d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.187998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.222031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06ba0-8f5f-4365-bab7-f0674f378ffb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.262184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b548d-43f0-4080-927b-b0d86f3b294f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.267190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.267800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.268082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.268356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.268994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.270946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.280686 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.282860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.283538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.283817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.284089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] PATH_INFO: `/v3/projects/76e2bd25bf09473c9a209cc718dec687/users/a86f4e46084b4343b80d07e1ebffb237/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.301222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 811/1601] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:33.301476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e2bd25bf09473c9a209cc718dec687, user_id=a86f4e46084b4343b80d07e1ebffb237, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.302066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.304266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.318186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 791/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/76e2bd25bf09473c9a209cc718dec687/users/a86f4e46084b4343b80d07e1ebffb237/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.326658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.369791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f68f6-e143-4c60-8ed0-361490732391 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.392999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598a379-971b-434f-839d-59742ba3ea79 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.397955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.399259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.399453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.399723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] PATH_INFO: `/v3/projects/92c7bea122934e44b7908c805f431e0a/users/725bbefab51841029b79a380ca8b54da/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.420155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c7bea122934e44b7908c805f431e0a, user_id=725bbefab51841029b79a380ca8b54da, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.422885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d984a01-be0c-4b13-8d9e-1382e45b8778 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.428863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.429756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.430054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.430493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] PATH_INFO: `/v3/projects/7b3b7f9e3f494890ac14e46a66585d0d/users/549ac14b43eb4f0d85c9d9e975515df1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.436991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 792/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/92c7bea122934e44b7908c805f431e0a/users/725bbefab51841029b79a380ca8b54da/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.438279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093fc2-8453-4496-a19d-9c2a8e9e3dca None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.438570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093fc2-8453-4496-a19d-9c2a8e9e3dca None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.438842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093fc2-8453-4496-a19d-9c2a8e9e3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.448304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3b7f9e3f494890ac14e46a66585d0d, user_id=549ac14b43eb4f0d85c9d9e975515df1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.451201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.465649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 812/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/7b3b7f9e3f494890ac14e46a66585d0d/users/549ac14b43eb4f0d85c9d9e975515df1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.466451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.476359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-60093fc2-8453-4496-a19d-9c2a8e9e3dca None None] MFA Rules not processed for user `67acf709beef4dbf8ba7e613949146c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.478910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-60093fc2-8453-4496-a19d-9c2a8e9e3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.483432 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.544989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6fc1-5d68-4d84-ba23-bafd5f3cdd7d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.550416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.551148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.551625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 793/1605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.551731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.551731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] PATH_INFO: `/v3/projects/133e5dee604644fdb6462424b94f0701/users/90c928642ee942b9808556e6112f9304/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.552878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.553168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.553466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.568452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133e5dee604644fdb6462424b94f0701, user_id=90c928642ee942b9808556e6112f9304, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.571630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a88349-a7a4-4240-9f4e-5b8f2c526eb7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.584446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] MFA Rules not processed for user `8fa94183119e4b1e93721001f72404c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.585754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.585904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 813/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:33 2022] PUT /identity/v3/projects/133e5dee604644fdb6462424b94f0701/users/90c928642ee942b9808556e6112f9304/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:33.588091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808a95-a2d8-402c-be50-6c6ef7857e25 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.588390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808a95-a2d8-402c-be50-6c6ef7857e25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.588643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808a95-a2d8-402c-be50-6c6ef7857e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.596183 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.619833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-24808a95-a2d8-402c-be50-6c6ef7857e25 None None] MFA Rules not processed for user `fd8db2556a4c4ccba1166838c711664d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.621077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24808a95-a2d8-402c-be50-6c6ef7857e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.662621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 794/1607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.667152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.693750 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 814/1608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.695105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef88a-f2ae-4ea9-be25-a78984bc7b79 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.695442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef88a-f2ae-4ea9-be25-a78984bc7b79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.695719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef88a-f2ae-4ea9-be25-a78984bc7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.724416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8afef88a-f2ae-4ea9-be25-a78984bc7b79 None None] MFA Rules not processed for user `a86f4e46084b4343b80d07e1ebffb237`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.725715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8afef88a-f2ae-4ea9-be25-a78984bc7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.737204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1894e-961a-46d0-95f8-11be87a47fec None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.742078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.742719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.742993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.743449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.744089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.746045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b86d52-59f9-4036-b545-108321241015 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.768746 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 795/1609] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:33.770181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.770473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.770752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.794296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 815/1610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.795574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.795891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.796136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.800594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] MFA Rules not processed for user `725bbefab51841029b79a380ca8b54da`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.801840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.814831 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.827442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] MFA Rules not processed for user `549ac14b43eb4f0d85c9d9e975515df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:33.828760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:33.875684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 796/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.876549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.900384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 816/1612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:33.901252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.911954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9544ad4-f268-4954-bb8a-116371a2560d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.919012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.919644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.919926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.920223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.920856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.922524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.928467 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:33.933808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 817/1613] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:33.935005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:33.941386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339a4a-aa7e-4e96-b23a-6234ff508908 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.945795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.946073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fee0-0cb6-46c7-83c8-98a428f40ca7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:33.947071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.947352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.947662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.950612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:33.951214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:33.951495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:33.951773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:33.952411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:33.954395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:33.986223 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 818/1614] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:33.987315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.010755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.012234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.022000 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 797/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:34.026894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.041232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb9b5-5f6e-44a7-9ab5-098b92294c03 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.066557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f813c-9414-4ac3-bd09-9ef36b19b9d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.076918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.077589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.077914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.078231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.078922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.081386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.118695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 819/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:33 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.119116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.119596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.120322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.120605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.120874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.121599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.123232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.135661 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 798/1617] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.136624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.143426 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.147874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e9b3-7e49-43f4-b42f-b91c86c0918c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.201157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a4ba-1092-403a-a6b8-46d76047d593 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.205277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.205926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.206205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.206783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.207107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.209032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.220276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.221156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.221469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.222156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.222795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.224929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.243000 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 820/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.243868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.263969 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 799/1619] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.263969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.303535 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.322197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f52e5-1531-4b9c-8d08-ded32001dd11 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.345648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f0fbf-8111-4c34-bb28-f2fbc82d4f6a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.354011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.356617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.356617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.356617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] PATH_INFO: `/v3/projects/133e5dee604644fdb6462424b94f0701/users/90c928642ee942b9808556e6112f9304/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.358189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=133e5dee604644fdb6462424b94f0701, user_id=90c928642ee942b9808556e6112f9304, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.360891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.373113 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 800/1620] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:34 2022] PUT /identity/v3/projects/133e5dee604644fdb6462424b94f0701/users/90c928642ee942b9808556e6112f9304/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:34.373657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.393680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.394347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.394635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.394916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.395644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.397616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.427711 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 821/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.428529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.449393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf60a-22e3-4b53-b3d9-c509e8798c9f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.482069 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.498694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbceb44-2e2a-4342-9089-91fc155afc4f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.503715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.504336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.504617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.505004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.505924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.508010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.516016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.516650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.516932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.517210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.517913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.519956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.537567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 822/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.538521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.544580 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 801/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.545891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.550546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342a7d9-5fb4-48bc-918e-f5649e46dfcc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.556358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.557048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.557343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.557480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01ada-8282-4000-a8c6-e385b62f8f86 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.557687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] PATH_INFO: `/v3/projects/f98f6fc220564971bf958d85cb265c29/users/59f46939463e422682d38e22a504286e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.562270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.562964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.563310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.563647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.564347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.566433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.575475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98f6fc220564971bf958d85cb265c29, user_id=59f46939463e422682d38e22a504286e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.578278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2937d8-8088-423e-92ea-4b5ab1c6ea30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.592394 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 802/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/users => generated 306 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.593228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.594131 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 823/1625] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:34 2022] PUT /identity/v3/projects/f98f6fc220564971bf958d85cb265c29/users/59f46939463e422682d38e22a504286e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:34.595368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.595766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.595965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.606815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80121e-a73e-4dc3-aa36-46f0a58b9f21 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.627379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] MFA Rules not processed for user `90c928642ee942b9808556e6112f9304`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:34.628616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.666307 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.671508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.672120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.672395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.672667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.673348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.675266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.702939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 803/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.702939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.707701 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 824/1627] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:34.708755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.712439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77cbe-4d27-403b-9e67-43fbe04e7902 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.719037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.719666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.719856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f285e7-36b6-4859-8134-db9b91ec0361 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.719964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.720198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] PATH_INFO: `/v3/users/67acf709beef4dbf8ba7e613949146c8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.721432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67acf709beef4dbf8ba7e613949146c8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.722496 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:34.722496 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:00:34.722496 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:00:34.723725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.725599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.726291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.727627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.727936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.728889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.730883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.756481 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 825/1628] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:34 2022] POST /identity/v3/users => generated 303 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:34.757897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.770491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cede38-ff37-4946-9843-b3f0f6b493b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.776334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.777032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.777318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.777655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.778720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.780086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.792052 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 826/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.792995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.803291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ca92-7fa6-48c1-8d08-b042cff027f3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.803571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67acf709beef4dbf8ba7e613949146c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:34.804200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67acf709beef4dbf8ba7e613949146c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:34.809012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.809552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.809819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.810092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.810740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.812353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.816604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67acf709beef4dbf8ba7e613949146c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:34.824306 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 827/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.825017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.826879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.837923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67acf709beef4dbf8ba7e613949146c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:34.838676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67acf709beef4dbf8ba7e613949146c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:34.840735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8af14-18d9-4437-9d66-445244994c74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.845853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.846422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.846847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.847156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.847809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.850716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.860425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 804/1631] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:34 2022] DELETE /identity/v3/users/67acf709beef4dbf8ba7e613949146c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:34.860425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.862541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.870718 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 828/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.870897 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=80,keystone:INSERT=10,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.871778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.873924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.886739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b616f3-0522-419e-95f8-a5735e752904 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.939289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86561-4782-42fc-ae14-9d912cee9520 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.944055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.944670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.944789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.945236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.945236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.945473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.945866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.945965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.946348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.947012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.947510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f65e-010f-4fc5-b5ee-132802b06238 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.948639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:34.957846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 805/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.959232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.959525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.959802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.961288 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 806/1634] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 01:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:34.961768 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 829/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:34.962107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.962696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:34.965902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.966432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:34.979248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3d8b-53cd-4762-b74a-c300514131fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.981933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f64a-1dec-4e00-a311-07c9342ee2f4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:34.983834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.984520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.984798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.985074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] PATH_INFO: `/v3/projects/c10459f2160f4830af009d990f34303e/users/d255604e4a7b4aa8939135e562430579/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.986762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:34.987361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:34.987643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:34.987920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:34.988560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:34.990243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.000890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10459f2160f4830af009d990f34303e, user_id=d255604e4a7b4aa8939135e562430579, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.001298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 807/1636] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.002127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.003591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24b58d-2dd7-45b3-83d6-0381f1d958d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.003838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.018361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324b1f-3449-43db-bdd0-1c8ddfc05def admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.018750 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 830/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:34 2022] PUT /identity/v3/projects/c10459f2160f4830af009d990f34303e/users/d255604e4a7b4aa8939135e562430579/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.020133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.020454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.020731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.042869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:35.044101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.079879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.080571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.080857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.081133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] PATH_INFO: `/v3/projects/c1e3bf6896a74af3b90345043a52b854/users/35884c6b48614bb4bbc11150cc455b61/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.093668 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.097386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e3bf6896a74af3b90345043a52b854, user_id=35884c6b48614bb4bbc11150cc455b61, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.100496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.112112 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 831/1638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:35.112112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.117247 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 808/1639] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/c1e3bf6896a74af3b90345043a52b854/users/35884c6b48614bb4bbc11150cc455b61/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.118587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.124821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7f1e-6ea0-4e8a-8927-ef9165ec1567 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.184090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.184302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaf533-a21a-40f4-851a-5e0da5dad5df admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.184822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.185066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.185343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] PATH_INFO: `/v3/projects/cce574297d2a41358efbef3d79964980/users/2dbda9f37d5c4ab880e9511f12bdc086/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.189038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.189801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.190144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.190450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] PATH_INFO: `/v3/projects/f98f6fc220564971bf958d85cb265c29/users/59f46939463e422682d38e22a504286e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.192481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98f6fc220564971bf958d85cb265c29, user_id=59f46939463e422682d38e22a504286e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.195219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.200739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce574297d2a41358efbef3d79964980, user_id=2dbda9f37d5c4ab880e9511f12bdc086, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.203451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f064-e1e8-44c6-93ce-f8d0c5a22a15 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.206700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 809/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/f98f6fc220564971bf958d85cb265c29/users/59f46939463e422682d38e22a504286e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.207574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.217775 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.227229 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 832/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/cce574297d2a41358efbef3d79964980/users/2dbda9f37d5c4ab880e9511f12bdc086/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.227229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.227229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.227229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.266447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:35.267769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.275839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74988879-b57e-432f-af1d-e6d1355035e5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.337282 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 833/1642] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:35.337586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.338160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.338259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.338639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.338946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] PATH_INFO: `/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92/users/7b488e3b4e064b559907146f62175f37/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.348710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e10cb-c247-454e-afd3-8f5da4285362 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.354829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.355656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.355933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.356211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] PATH_INFO: `/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884/users/0d35a97419384c60a5fbcb76bd593f7f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.358200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7a84df4fc24fc4898dfb1a0aef9b92, user_id=7b488e3b4e064b559907146f62175f37, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.360889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.374372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ff735d40ae4e7c8001fe1e726b8884, user_id=0d35a97419384c60a5fbcb76bd593f7f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.375521 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 810/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92/users/7b488e3b4e064b559907146f62175f37/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.378405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.378528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.392418 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 834/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884/users/0d35a97419384c60a5fbcb76bd593f7f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.393389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.396637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.434607 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.451422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc3c8-1d56-4dad-b4a9-75724e0db2b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.460231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1600290-2343-4188-ab83-9308b8ba0973 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.464692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.465310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.465622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.465909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.493888 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.512913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.513817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.514102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.514375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.515026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.516643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.529526 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 811/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.530495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.537838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.540078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a71ea-df63-4a42-8518-80ee829e6e62 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.542521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dbc24-0db3-43c5-bfaa-9ccedba5d150 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.548438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.549066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.549350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.549655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.550303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.551914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.552012 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 835/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:35.553280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.553633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.554086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.563682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 812/1647] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.564424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.578096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5d9db-23dd-4549-a5d7-446ca092c67a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.587461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.588186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.588472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.588752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] MFA Rules not processed for user `59f46939463e422682d38e22a504286e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:35.588879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.589483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.589999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.592269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.613720 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 813/1648] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.613720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.689338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 836/1649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:35.689338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.696636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd5d22-4d49-47e6-b256-4f189d68b581 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.702134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.703705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.703705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.703705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.704242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.706686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.721488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 837/1650] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.722635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.738838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9280a-fc32-4b48-8b49-3667cabc3d46 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.744867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.745579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.746029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.746420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.747142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.748703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.765228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 838/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:35.766219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.769317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c179-f67a-4ce9-a29c-79296b806a1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.773218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.774773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.774944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.775085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.776935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:35.783180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658faf4-7de9-4339-b63c-16e7f208c331 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.788851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.790581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.790950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.791454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] PATH_INFO: `/v3/projects/c10459f2160f4830af009d990f34303e/users/d255604e4a7b4aa8939135e562430579/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.793506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10459f2160f4830af009d990f34303e, user_id=d255604e4a7b4aa8939135e562430579, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.796563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.813451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 839/1652] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/c10459f2160f4830af009d990f34303e/users/d255604e4a7b4aa8939135e562430579/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.813451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.853319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.855100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.859949 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.868390 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 814/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:35.869733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.881582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043894-be1a-40f3-b2af-65aa8ff50b90 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.904812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3de70-5cc2-4353-a0ef-4280ad2ff3cf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:35.911432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.912739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.913313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.913749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] PATH_INFO: `/v3/projects/c1e3bf6896a74af3b90345043a52b854/users/35884c6b48614bb4bbc11150cc455b61/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.916991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e3bf6896a74af3b90345043a52b854, user_id=35884c6b48614bb4bbc11150cc455b61, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.920079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da4aa-2a0a-41ef-bd79-b95203937bba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:35.934798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 840/1654] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/c1e3bf6896a74af3b90345043a52b854/users/35884c6b48614bb4bbc11150cc455b61/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:35.945042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841839d-f618-48c0-9458-0102755a45b7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.946215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841839d-f618-48c0-9458-0102755a45b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.947417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841839d-f618-48c0-9458-0102755a45b7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.955988 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.956768 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 841/1655] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 25 01:00:35 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:35.958897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841839d-f618-48c0-9458-0102755a45b7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:35.973092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:35.973969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:35.974356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:35.978495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] PATH_INFO: `/v3/projects/cce574297d2a41358efbef3d79964980/users/2dbda9f37d5c4ab880e9511f12bdc086/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:35.982481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce574297d2a41358efbef3d79964980, user_id=2dbda9f37d5c4ab880e9511f12bdc086, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:35.986797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.012756 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 815/1656] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/cce574297d2a41358efbef3d79964980/users/2dbda9f37d5c4ab880e9511f12bdc086/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:36.014329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.099714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841839d-f618-48c0-9458-0102755a45b7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.102378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011779b-73d6-4f97-b772-dfa5172cb6aa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.107189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.107857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.108139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.108472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] PATH_INFO: `/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884/users/0d35a97419384c60a5fbcb76bd593f7f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.109913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.110419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ff735d40ae4e7c8001fe1e726b8884, user_id=0d35a97419384c60a5fbcb76bd593f7f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.112616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.113114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90682bd-16e6-46f2-9b8c-4b954c7912c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.114165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.115308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] PATH_INFO: `/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92/users/7b488e3b4e064b559907146f62175f37/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.119904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7a84df4fc24fc4898dfb1a0aef9b92, user_id=7b488e3b4e064b559907146f62175f37, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.125106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.125727 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 816/1657] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:36 2022] PUT /identity/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884/users/0d35a97419384c60a5fbcb76bd593f7f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:36.131658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78338f3b-1d3c-4a71-9e54-13df9776d72c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.134463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78338f3b-1d3c-4a71-9e54-13df9776d72c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.135991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78338f3b-1d3c-4a71-9e54-13df9776d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.144241 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 842/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:35 2022] PUT /identity/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92/users/7b488e3b4e064b559907146f62175f37/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:36.144908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.154083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.188672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-78338f3b-1d3c-4a71-9e54-13df9776d72c None None] MFA Rules not processed for user `d255604e4a7b4aa8939135e562430579`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.189978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78338f3b-1d3c-4a71-9e54-13df9776d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.259360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ee2e0-39d7-447e-9b9c-0824625d7d1d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.265042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.265772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.266210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.266488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] PATH_INFO: `/v3/projects/f09c899b1de245769f6dc20447ed3354` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.267659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09c899b1de245769f6dc20447ed3354)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.268740 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:00:36.268740 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:00:36.268740 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:00:36.270035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.284419 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 817/1659] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.285795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4f2d-df0d-4b25-b5cb-23a54979919a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.286083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4f2d-df0d-4b25-b5cb-23a54979919a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.286483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4f2d-df0d-4b25-b5cb-23a54979919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.317390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fb6b4f2d-df0d-4b25-b5cb-23a54979919a None None] MFA Rules not processed for user `35884c6b48614bb4bbc11150cc455b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.318935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fb6b4f2d-df0d-4b25-b5cb-23a54979919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.334661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09c899b1de245769f6dc20447ed3354', 'request_id': 'req-6f268a59-9062-4216-8499-dba9dd6502b8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.348828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09c899b1de245769f6dc20447ed3354', 'request_id': 'req-6f268a59-9062-4216-8499-dba9dd6502b8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.355555 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:36.357077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09c899b1de245769f6dc20447ed3354', 'request_id': 'req-6f268a59-9062-4216-8499-dba9dd6502b8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.375346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] The token cache is being invalidate because project f09c899b1de245769f6dc20447ed3354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:36.375541 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:36.375696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.376526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f268a59-9062-4216-8499-dba9dd6502b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.378401 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 843/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:36 2022] DELETE /identity/v3/projects/f09c899b1de245769f6dc20447ed3354 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:36.379480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3342-17f1-4c37-af0a-d233976e5155 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.379770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3342-17f1-4c37-af0a-d233976e5155 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.380049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3342-17f1-4c37-af0a-d233976e5155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.401719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-770a3342-17f1-4c37-af0a-d233976e5155 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.402974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-770a3342-17f1-4c37-af0a-d233976e5155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.406108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 818/1661] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.407195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf783c-e933-4d64-b08e-7c673acc6b12 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.407512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf783c-e933-4d64-b08e-7c673acc6b12 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.408095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf783c-e933-4d64-b08e-7c673acc6b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.442748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-22cf783c-e933-4d64-b08e-7c673acc6b12 None None] MFA Rules not processed for user `2dbda9f37d5c4ab880e9511f12bdc086`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.444315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-22cf783c-e933-4d64-b08e-7c673acc6b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.481540 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 844/1662] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.483118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.483492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.483875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.521862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] MFA Rules not processed for user `0d35a97419384c60a5fbcb76bd593f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.523137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.531432 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 819/1663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.531432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.531432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.531432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.560231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] MFA Rules not processed for user `7b488e3b4e064b559907146f62175f37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.561463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.597169 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 845/1664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.598149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.599428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.637592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 820/1665] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.638784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.640071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.668613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284447-3e78-4d2e-a44a-9af7bbb70f39 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.673504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.674248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.674529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.674800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] PATH_INFO: `/v3/users/f660c178c57142a89005270585593091` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.675934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f660c178c57142a89005270585593091)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.678046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.684924 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:36.709410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0165ac3-4141-4ca0-896d-e67e4d0ac54a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.715186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.715810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.716107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.716359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.717009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:36.717318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.719312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd81f6d-f0c2-44e6-8e04-73d0a7b3238b tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.721475 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:36.731780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f660c178c57142a89005270585593091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.734956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 821/1666] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:36.736202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.736491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.736753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.739460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f660c178c57142a89005270585593091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.754478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f660c178c57142a89005270585593091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.755313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f660c178c57142a89005270585593091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.755941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f660c178c57142a89005270585593091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:36.759562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.761048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.769936 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 822/1667] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:36.770491 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 846/1668] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:36 2022] DELETE /identity/v3/users/f660c178c57142a89005270585593091 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:36.770900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.771803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.772355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.774158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.788736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa766d45-d29c-4e17-a343-2ee59647b9f9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.857967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c868074-4118-4ce3-aff9-62065f8ec1cd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:36.858732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.859366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.859647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.859923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.861950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.865141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:36.865987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.866679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.867737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.870196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.938335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.940012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff3c47-6ad7-4334-a5b4-d3e1fc869fec service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.947619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:36.949215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:36.950709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 847/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:36.952004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918233-3022-4d15-a21f-fb7092e87e2b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:36.952367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918233-3022-4d15-a21f-fb7092e87e2b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:36.952666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918233-3022-4d15-a21f-fb7092e87e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:36.962022 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 823/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:36.962867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:36.964287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:36.991921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc918233-3022-4d15-a21f-fb7092e87e2b None None] MFA Rules not processed for user `549ac14b43eb4f0d85c9d9e975515df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:36.993545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc918233-3022-4d15-a21f-fb7092e87e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.007607 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:37.058736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96dc66-09f6-4593-a5ed-7a61458fe868 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.078641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.079281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.079564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.079847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.080488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.082452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d8a5-a9b5-485a-83ee-5fcde293a4b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.085516 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 848/1671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:37.086742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.087037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.087312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.110300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:37.111679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.118758 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 824/1672] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:36 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:37.120911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.121779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.122228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.132419 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:37.152420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:37.155047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.187765 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 849/1673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:37.190339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.209930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8b80d-3103-4c53-8fe5-5cd740a77566 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.234227 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 825/1674] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:37.234227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.294453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.295210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.295428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.295741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.297758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.305483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79414de-d27d-42cf-aeb6-6386b3719b3a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.310275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.310823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.311138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.311369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.312057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:37.312358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.313990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.326550 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 826/1675] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:37.327352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.329051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.365202 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:37.367918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.369607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.380305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 850/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:37.381071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.391473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753599b-bb11-4362-bcd3-20e93abfef08 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.394991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1257c-0f52-47f3-b524-650e0d33c9c6 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.396757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.397146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.397455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.397740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.399650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:37.399650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.400709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.401194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.401379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.401677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.401958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.412711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.414361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.424266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 851/1677] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:37.425217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.426374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 827/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:37.436464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.451552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbdd-3aac-4824-9f86-3748d16f8c2a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.458774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd286d-83e4-4211-84b5-eece835bb6af service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.464171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.464581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.465243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.465598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.468666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.468888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.468966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.469034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.469034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.469359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.473201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.506616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 828/1679] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:37 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:00:37.508103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.541893 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:37.563684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.565261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.578228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 852/1680] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:37.579099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.592322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632e24-0215-446d-8a60-7a11a791f1a4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.642031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6a3f6-35bb-4278-8db3-b08e217abde8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.650055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.650687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.650973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.651248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.653186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.709933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.710687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.711600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.711877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.712528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.714556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.722779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.724697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.735987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 829/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:37.742946 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 853/1682] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:37 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:37.747486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.759779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be42d-f54e-4509-9f9a-ae64f401a4b4 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.765634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.766396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.766743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.767109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.767815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.769834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.787633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 830/1683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:37.791658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.795997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.805969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bf2b6-65eb-40e8-8420-8bd939856d28 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.810130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddb10-3f99-4490-b790-6b8762c2eb7b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.812345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.812957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.813754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.813754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.815322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.816076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.816427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.816771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.817559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.819232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd1868-cfa2-4800-953c-cc1482b89b85 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.830636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 831/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:37.831916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f65d6-7b70-4f48-a515-124304784863 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.832275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f65d6-7b70-4f48-a515-124304784863 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.832622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f65d6-7b70-4f48-a515-124304784863 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.834331 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 832/1685] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:37.835313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f65d6-7b70-4f48-a515-124304784863 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.850473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f65d6-7b70-4f48-a515-124304784863 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:37.856547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:37.857396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.857783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.858121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] PATH_INFO: `/v3/projects/1020ece1acf040c78fe6a1bc69b3c77e/users/a87bad3e91ee4218aad0f3bfbcb51250/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.876571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1020ece1acf040c78fe6a1bc69b3c77e, user_id=a87bad3e91ee4218aad0f3bfbcb51250, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.880371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018bc0f-233e-4a65-bfa6-b41d25650815 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.896653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:37.897812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 833/1686] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:37 2022] PUT /identity/v3/projects/1020ece1acf040c78fe6a1bc69b3c77e/users/a87bad3e91ee4218aad0f3bfbcb51250/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:37.899387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:37.903079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d85b7-ea49-4f23-b833-842ea86478b3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:37.903436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d85b7-ea49-4f23-b833-842ea86478b3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:37.904421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d85b7-ea49-4f23-b833-842ea86478b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:37.911711 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:37.917681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 854/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:37.919258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:37.921822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.931581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-141d85b7-ea49-4f23-b833-842ea86478b3 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:37.935967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-141d85b7-ea49-4f23-b833-842ea86478b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:37.937896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa84a-3bd5-41ad-bc33-ba443f5d9bf4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.021832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.022936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.023426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.024421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] PATH_INFO: `/v3/projects/d82812a8bae040f986d216e153fad766` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.026278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82812a8bae040f986d216e153fad766)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.029798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.037958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 834/1688] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:38.039363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.039708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.039982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.047292 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:38.075358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] MFA Rules not processed for user `a87bad3e91ee4218aad0f3bfbcb51250`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:38.076694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.096473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82812a8bae040f986d216e153fad766', 'request_id': 'req-613bc504-935f-4ede-9a49-a1930fcc47e6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.103162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82812a8bae040f986d216e153fad766', 'request_id': 'req-613bc504-935f-4ede-9a49-a1930fcc47e6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.110219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82812a8bae040f986d216e153fad766', 'request_id': 'req-613bc504-935f-4ede-9a49-a1930fcc47e6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.127794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] The token cache is being invalidate because project d82812a8bae040f986d216e153fad766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:38.128088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.128753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-613bc504-935f-4ede-9a49-a1930fcc47e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.134394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 855/1689] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:37 2022] DELETE /identity/v3/projects/d82812a8bae040f986d216e153fad766 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:38.134394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.134394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.134394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.136181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 856/1690] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:38.137174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.139207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.161441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 835/1691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:38.161441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.167603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.227722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea80a-9bf9-4b69-87ae-d43ffd143d1f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.231449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.232061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.232354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.232615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.234402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.235305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9af594-370c-4821-af0d-a8f9a8f64ad2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.240070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.240705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.240985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.241256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] PATH_INFO: `/v3/users/90c928642ee942b9808556e6112f9304` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.242565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c928642ee942b9808556e6112f9304)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.244504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.260515 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:38.304555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c928642ee942b9808556e6112f9304'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.305296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c928642ee942b9808556e6112f9304'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.312720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c928642ee942b9808556e6112f9304'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.320151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.322099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.325579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c928642ee942b9808556e6112f9304'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.326261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c928642ee942b9808556e6112f9304'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:38.335793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 857/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:38.337517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:38.339115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.345949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 836/1693] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:38 2022] DELETE /identity/v3/users/90c928642ee942b9808556e6112f9304 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:38.345949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.350873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.356134 n-d-master-1 devstack@keystone.service[81863]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 25 01:00:38.356617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.358247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.373270 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:38.462113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8306d-edb8-4f34-bb86-31f418928592 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.468001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.468821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.469371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.469757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.470765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.474054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.478022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de327-9eab-4ec6-a1f3-12ae6a91db26 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.533182 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 837/1694] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:38 2022] POST /identity/v3/projects => generated 391 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:38.535885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.563450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.564169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.564502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.564922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects/36c46355d34346969dadad0bd090fe83` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.567201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:get_project(project_id=36c46355d34346969dadad0bd090fe83)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.568581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.572055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 858/1695] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:38 2022] GET /identity/v3/projects/36c46355d34346969dadad0bd090fe83 => generated 369 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:38.663451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1dcf6-16bc-43c7-bfd3-0e2dff81eab9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.670093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.670722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.671004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.671279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.676601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.678873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.712905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 838/1696] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:38 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:00:38.716634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.737743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f55adb-0762-4755-b2b9-cc797906d50c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.743114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.743804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.744323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.744665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.745436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.747182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.759793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 859/1697] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:00:38.764592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.777430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ee139-e282-45c3-8983-c7bd59bdedc4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.785227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.786808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.787198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.787543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] PATH_INFO: `/v3/projects/6703fad10307448cb635deefeb4a25b2/users/06750bca6eca43b7ad646d2012b7306d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.817137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6703fad10307448cb635deefeb4a25b2, user_id=06750bca6eca43b7ad646d2012b7306d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.821337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.831011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.832803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:38.846584 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 839/1698] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:38 2022] PUT /identity/v3/projects/6703fad10307448cb635deefeb4a25b2/users/06750bca6eca43b7ad646d2012b7306d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:38.848234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e7e35-d740-49fd-baf8-6938ae94fcf0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.850631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:38.909262 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:38.934492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.936932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.937238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.937562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] PATH_INFO: `/v3/projects/133e5dee604644fdb6462424b94f0701` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.938906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=133e5dee604644fdb6462424b94f0701)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.940874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.963606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949077-5b15-4386-a814-7d107da9ce72 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:38.968934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:38.969591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.969872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.970142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.970786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:38.972584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506511a-3fd5-45e3-a5b0-58e843f7cf1a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:38.975089 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:38.991146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 840/1699] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:38.994650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322796b7-cbea-48d8-9f02-22d4d5aec0f2 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:38.994953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322796b7-cbea-48d8-9f02-22d4d5aec0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:38.995232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322796b7-cbea-48d8-9f02-22d4d5aec0f2 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:38.998278 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 841/1700] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:38.998959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322796b7-cbea-48d8-9f02-22d4d5aec0f2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.018530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322796b7-cbea-48d8-9f02-22d4d5aec0f2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.045222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133e5dee604644fdb6462424b94f0701', 'request_id': 'req-d0c4fca8-542c-4973-a7e9-c4decb238bf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:39.052527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133e5dee604644fdb6462424b94f0701', 'request_id': 'req-d0c4fca8-542c-4973-a7e9-c4decb238bf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:39.060597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133e5dee604644fdb6462424b94f0701', 'request_id': 'req-d0c4fca8-542c-4973-a7e9-c4decb238bf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:39.076056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] The token cache is being invalidate because project 133e5dee604644fdb6462424b94f0701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:39.076375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:39.077044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:39.078601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 860/1701] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:38 2022] DELETE /identity/v3/projects/133e5dee604644fdb6462424b94f0701 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:39.079354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:39.080856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.093028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.093884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.094164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.094439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] PATH_INFO: `/v3/projects/6703fad10307448cb635deefeb4a25b2/users/06750bca6eca43b7ad646d2012b7306d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.096493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6703fad10307448cb635deefeb4a25b2, user_id=06750bca6eca43b7ad646d2012b7306d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.099249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.119734 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 842/1702] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:38 2022] PUT /identity/v3/projects/6703fad10307448cb635deefeb4a25b2/users/06750bca6eca43b7ad646d2012b7306d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:39.120991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.129121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.160328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.161643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.205733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fae7-0600-43f6-a5bb-bca3ae4f8347 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.210876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.211491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.211953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.212232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.214026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.225378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.225726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4fca8-542c-4973-a7e9-c4decb238bf4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.227684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5256f-0566-4d3c-908d-972518e7c176 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.237590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 843/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:39.239091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fa78-9de4-4e32-8c7a-d730652502fd None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.239201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fa78-9de4-4e32-8c7a-d730652502fd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.239380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fa78-9de4-4e32-8c7a-d730652502fd None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.240777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 844/1704] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:39.241688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75a19-0b8f-4f0f-9c50-4c49f75ebe6d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.241972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75a19-0b8f-4f0f-9c50-4c49f75ebe6d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.242821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75a19-0b8f-4f0f-9c50-4c49f75ebe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.244356 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:39.264385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ceb75a19-0b8f-4f0f-9c50-4c49f75ebe6d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.265635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ceb75a19-0b8f-4f0f-9c50-4c49f75ebe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.292245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.293010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.293367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.294066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects/36c46355d34346969dadad0bd090fe83` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.295223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:get_project(project_id=36c46355d34346969dadad0bd090fe83)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.297345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408919e-160d-4fe0-bee5-61c38b3b52e8 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.303175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 861/1705] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/projects/36c46355d34346969dadad0bd090fe83 => generated 369 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:39.309016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.309308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.309619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.347403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] MFA Rules not processed for user `06750bca6eca43b7ad646d2012b7306d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.349142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.357859 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 845/1706] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.360598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.361376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.361683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.391233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.392454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.422497 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:39.449622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 862/1707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.450562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.475431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e11a91-4e78-4b8c-b574-bfbc56bd2b14 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.483389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.484139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.484421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.484695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.485522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:39.485814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.487888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0c03d-b322-493e-adca-9bfeb621c2ac tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.504295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 863/1708] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:39.505637 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 846/1709] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.509192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.512499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580ef2-1a28-4558-922d-230e6e2b1a49 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.512654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580ef2-1a28-4558-922d-230e6e2b1a49 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.513093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580ef2-1a28-4558-922d-230e6e2b1a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.524169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c5fb-7a54-4138-a233-23864f43fd4c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.530832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.533628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.534124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.535002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.536115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.538598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.560370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d5580ef2-1a28-4558-922d-230e6e2b1a49 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.562027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5580ef2-1a28-4558-922d-230e6e2b1a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.573582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 847/1710] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/users => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:00:39.574192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 864/1711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.575697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.575832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847419b7-47af-40bb-a5db-cda908a65880 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.576130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847419b7-47af-40bb-a5db-cda908a65880 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.576446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847419b7-47af-40bb-a5db-cda908a65880 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.578073 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 865/1712] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:39.578181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.578932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847419b7-47af-40bb-a5db-cda908a65880 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.593692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847419b7-47af-40bb-a5db-cda908a65880 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.598584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.599267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.599617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.599975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.600725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:39.601110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.603468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.619828 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 866/1713] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:39.620887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.635170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff529-0ca9-4a33-a801-25edd341f19e tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.640398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.641749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.642067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.642384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.643182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:39.643488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.645683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c1f8d-d6fc-4bf2-be61-d5d3edcbfffc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.653500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441dc56-c676-46e5-91ae-a22335568166 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.665262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 867/1714] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:39.665262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.665262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.665262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.666771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.667538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.668871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.669349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.685677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.686355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:39.687545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.687746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.697492 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 868/1715] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:39.698416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.711741 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 848/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:39.714687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02ea8d-d488-4dde-9f1e-7644234804c1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.720876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.722296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.722636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.723156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.723627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.725759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.736501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.760565 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 869/1717] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:39.762415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d35bd-9106-4a0c-8772-cfaa66d61f25 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.764426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.820115 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:39.859202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e7d09-c097-45d6-9984-011c943b39ec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.872704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.873275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.873592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.873913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.874565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.876513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.878177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.879325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.880072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.880670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.894539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.898089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ba5c7-3abc-4cf2-b6fe-deae67e0551f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.902380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 870/1718] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:39 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:00:39.903257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.906756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:39.911306 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 849/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:39.919013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375d8c-2a46-4324-aaf7-e85a2488a245 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.919331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375d8c-2a46-4324-aaf7-e85a2488a245 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.919647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375d8c-2a46-4324-aaf7-e85a2488a245 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.921472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 850/1720] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:39.922212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375d8c-2a46-4324-aaf7-e85a2488a245 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:39.931859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e983049-5810-4d1b-a7b4-31df5c364907 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.943983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.944766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.945449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.945912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] PATH_INFO: `/v3/users/a87bad3e91ee4218aad0f3bfbcb51250` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.947696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87bad3e91ee4218aad0f3bfbcb51250)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.950370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.958422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375d8c-2a46-4324-aaf7-e85a2488a245 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:39.977281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:39.978182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:39.978467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:39.978727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:39.979372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:39.980997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:39.994038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 851/1721] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:39.994992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:39.998641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.041643 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:40.043323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87bad3e91ee4218aad0f3bfbcb51250'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.055045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87bad3e91ee4218aad0f3bfbcb51250'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.076059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87bad3e91ee4218aad0f3bfbcb51250'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.080472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87bad3e91ee4218aad0f3bfbcb51250'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.082276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87bad3e91ee4218aad0f3bfbcb51250'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.114556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 871/1722] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:39 2022] DELETE /identity/v3/users/a87bad3e91ee4218aad0f3bfbcb51250 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:40.116233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.118686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.143724 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 25 01:00:40.144214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.231894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a6aa-4978-4def-9b17-68573f4ebc97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.239017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.240395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.240748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.241097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.241892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.243662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2abc6-1281-4341-99a2-5e0ff695c158 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.245037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07dbd-f4ce-4192-8542-c06ab780f0fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.262177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 872/1723] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:40.262177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.262177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.262177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.285072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:40.286368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.303310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 873/1724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:40.303310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.322179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553b39a-c4b3-4d3f-bf74-2e4d909f67fe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.328643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.329880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.330796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.330796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] PATH_INFO: `/v3/projects/fbd08c233d6944199beebf1a2e1a1a23/users/98ed412afded46c49d993a2749e42c65/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.349626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd08c233d6944199beebf1a2e1a1a23, user_id=98ed412afded46c49d993a2749e42c65, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.351328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.364393 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:40.373794 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 874/1725] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:40 2022] PUT /identity/v3/projects/fbd08c233d6944199beebf1a2e1a1a23/users/98ed412afded46c49d993a2749e42c65/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:40.374989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.375168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.375697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.375926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.376199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects/36c46355d34346969dadad0bd090fe83` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.378341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:get_project(project_id=36c46355d34346969dadad0bd090fe83)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.379312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.380614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.382472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 852/1726] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:39 2022] GET /identity/v3/projects/36c46355d34346969dadad0bd090fe83 => generated 369 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:40.383399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.402353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.425793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7612-f21f-461e-a7c3-143cb9defab4 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.510288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a3b2-28cb-4ef2-8c4f-2c03eb9ea30e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:40.532240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.532923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.533203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.533499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.549138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:40.550085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.550481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.550851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] PATH_INFO: `/v3/users/3bed0270d77f471db82cec87e3063070` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.552221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bed0270d77f471db82cec87e3063070)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.556100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.560151 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:40.645830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bed0270d77f471db82cec87e3063070'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.646737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bed0270d77f471db82cec87e3063070'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.661170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bed0270d77f471db82cec87e3063070'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.682899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bed0270d77f471db82cec87e3063070'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.683682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b394e1d2-706f-4588-9a22-43f164f6e61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bed0270d77f471db82cec87e3063070'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:40.691406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:40.693314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae3cb-601f-4432-9f2d-ddff433d25ae service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:40.706556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 875/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:40.707752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.708042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.708316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.711476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 853/1728] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:40 2022] DELETE /identity/v3/users/3bed0270d77f471db82cec87e3063070 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:40.713082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc894fe-2df6-4f34-b4fa-6e5463d7fb44 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.713508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc894fe-2df6-4f34-b4fa-6e5463d7fb44 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.713907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc894fe-2df6-4f34-b4fa-6e5463d7fb44 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.715835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 854/1729] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:40.719025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:40.719668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:40.719934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:40.740313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:40.742728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.760492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:40.761953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.867773 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 876/1730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:40.869187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:40.872097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.890198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 855/1731] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:40.895429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:40.904166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:40.950983 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:41.003167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54add05-925d-44d0-a517-6877aedeb91b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.009545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.010744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.011686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.012141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.027574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.030263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.032874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.035857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:41.045889 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 856/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:41.046897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.057100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c053f-5a67-4c22-b07e-44222f3cb652 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.062326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.063199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.063556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.064029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.078374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.080520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.096586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 857/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:41.170013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305c20-c708-4a62-a19a-8a48b5ef8bf0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.176448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.177623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.177914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.178191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects/36c46355d34346969dadad0bd090fe83` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.180419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:get_project(project_id=36c46355d34346969dadad0bd090fe83)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.184068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.186394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 877/1734] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:40 2022] GET /identity/v3/projects/36c46355d34346969dadad0bd090fe83 => generated 369 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:41.254754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.281578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.283518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331461c-5233-4e3d-8551-f60d5ddb8ac9 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.283658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:41.299404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.300209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.300613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.300994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/users/4dbc5a002d7b44c1aca282c190b395f4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.321890 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:41.324258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f667e0-100a-4620-bc54-a6775a6c8dc5 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.339612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.340849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.341054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.342515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] PATH_INFO: `/v3/projects/1020ece1acf040c78fe6a1bc69b3c77e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.343948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4dbc5a002d7b44c1aca282c190b395f4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.344382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1020ece1acf040c78fe6a1bc69b3c77e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.350196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.357339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.494123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1020ece1acf040c78fe6a1bc69b3c77e', 'request_id': 'req-2e48425c-bca4-4fff-ad47-94a5cb521735'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.506443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbc5a002d7b44c1aca282c190b395f4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.508936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbc5a002d7b44c1aca282c190b395f4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.511537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1020ece1acf040c78fe6a1bc69b3c77e', 'request_id': 'req-2e48425c-bca4-4fff-ad47-94a5cb521735'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.561885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1020ece1acf040c78fe6a1bc69b3c77e', 'request_id': 'req-2e48425c-bca4-4fff-ad47-94a5cb521735'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.568029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbc5a002d7b44c1aca282c190b395f4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.586304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] The token cache is being invalidate because project 1020ece1acf040c78fe6a1bc69b3c77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:41.589343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.591346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.598485 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 878/1735] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:41 2022] DELETE /identity/v3/projects/1020ece1acf040c78fe6a1bc69b3c77e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:41.605064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.607460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:41.625080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbc5a002d7b44c1aca282c190b395f4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.626225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbc5a002d7b44c1aca282c190b395f4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.663871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 858/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:41 2022] DELETE /identity/v3/users/4dbc5a002d7b44c1aca282c190b395f4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:41.666154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:41.670314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:41.806693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48425c-bca4-4fff-ad47-94a5cb521735 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.838674 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:41.849220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd985b8-5688-463d-bae2-1c97e582161c tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:41.859178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd255604e4a7b4aa8939135e562430579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10459f2160f4830af009d990f34303e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.860684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.862564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.863464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] PATH_INFO: `/v3/projects/36c46355d34346969dadad0bd090fe83` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.866180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36c46355d34346969dadad0bd090fe83)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.874081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.912284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:41.912955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:41.913238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:41.913547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] PATH_INFO: `/v3/users/06750bca6eca43b7ad646d2012b7306d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:41.918342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06750bca6eca43b7ad646d2012b7306d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:41.921997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:41.977787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c46355d34346969dadad0bd090fe83', 'request_id': 'req-a4f0c6df-1193-4b88-bd93-cc182ee9965a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.988141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c46355d34346969dadad0bd090fe83', 'request_id': 'req-a4f0c6df-1193-4b88-bd93-cc182ee9965a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:41.997313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c46355d34346969dadad0bd090fe83', 'request_id': 'req-a4f0c6df-1193-4b88-bd93-cc182ee9965a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.014632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] The token cache is being invalidate because project 36c46355d34346969dadad0bd090fe83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:42.014970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.015869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.022706 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 859/1737] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:41 2022] DELETE /identity/v3/projects/36c46355d34346969dadad0bd090fe83 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:00:42.025094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:42.026847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.033647 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:42.063261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06750bca6eca43b7ad646d2012b7306d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.084187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06750bca6eca43b7ad646d2012b7306d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.107096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06750bca6eca43b7ad646d2012b7306d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.107872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06750bca6eca43b7ad646d2012b7306d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.108497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06750bca6eca43b7ad646d2012b7306d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.128950 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 879/1738] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:41 2022] DELETE /identity/v3/users/06750bca6eca43b7ad646d2012b7306d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:00:42.129718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:42.131142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.236097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c6df-1193-4b88-bd93-cc182ee9965a tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:42.303716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692662-bbdd-4c7e-948c-45bbe0726b45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:42.317422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:42.318287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.318628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.318908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.321852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.370133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:42.371108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.371393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.371667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.376320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.379471 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:42.505059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:42.511407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:42.539460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:42.541735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:42.552001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 880/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:42.556137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:42.560864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.567833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 860/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:42.568814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:42.572439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:42.706010 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:42.780869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71da4-5727-499f-908e-9cf922012244 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:42.796004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:42.796672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.796955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.797222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] PATH_INFO: `/v3/projects/aac6041823d94dacbd14bd62237e6155` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.798910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0ff65-a458-4725-8bd5-588e18ed3c87 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:42.800315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac6041823d94dacbd14bd62237e6155)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:42.802360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:42.814346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:42.815001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.815278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.815549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] PATH_INFO: `/v3/users/fd8db2556a4c4ccba1166838c711664d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.818255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8db2556a4c4ccba1166838c711664d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:42.820849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:42.907825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac6041823d94dacbd14bd62237e6155', 'request_id': 'req-3f2a0beb-f054-4fae-b4a1-a708c015b915'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.914857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8db2556a4c4ccba1166838c711664d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.921736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac6041823d94dacbd14bd62237e6155', 'request_id': 'req-3f2a0beb-f054-4fae-b4a1-a708c015b915'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.927973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8db2556a4c4ccba1166838c711664d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.937835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac6041823d94dacbd14bd62237e6155', 'request_id': 'req-3f2a0beb-f054-4fae-b4a1-a708c015b915'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.958119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] The token cache is being invalidate because project aac6041823d94dacbd14bd62237e6155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:42.958948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8db2556a4c4ccba1166838c711664d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.959570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.959993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8db2556a4c4ccba1166838c711664d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.961521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf6cfbbd-7b8e-4d43-b430-8aac286733e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8db2556a4c4ccba1166838c711664d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.962064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a0beb-f054-4fae-b4a1-a708c015b915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:42.965030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 861/1741] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:42 2022] DELETE /identity/v3/projects/aac6041823d94dacbd14bd62237e6155 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:42.967050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4604c8-b295-4699-88cb-da83bbd5dd45 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.967518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4604c8-b295-4699-88cb-da83bbd5dd45 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.969196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4604c8-b295-4699-88cb-da83bbd5dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.990405 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 881/1742] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:42 2022] DELETE /identity/v3/users/fd8db2556a4c4ccba1166838c711664d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:42.994511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:42.994886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:42.995326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:42.999011 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 882/1743] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:43.000609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:43.003954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.054245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4d4604c8-b295-4699-88cb-da83bbd5dd45 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:43.056696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d4604c8-b295-4699-88cb-da83bbd5dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.099667 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:43.142547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17dddb-74fa-44d7-af45-b0ba9dd7b7b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:43.156422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:43.157326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.160115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.161539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] PATH_INFO: `/v3/users/59f46939463e422682d38e22a504286e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.166523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f46939463e422682d38e22a504286e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:43.166812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 862/1744] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:43.168471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b69ab-3360-4d82-9669-6eafbc6d544b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.168750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b69ab-3360-4d82-9669-6eafbc6d544b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.169073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b69ab-3360-4d82-9669-6eafbc6d544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.175894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:43.214226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1e8b69ab-3360-4d82-9669-6eafbc6d544b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:43.218073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e8b69ab-3360-4d82-9669-6eafbc6d544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.239906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 863/1745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:43.241211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.241531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.241859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.285880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:43.288518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.351190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f46939463e422682d38e22a504286e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:43.368957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f46939463e422682d38e22a504286e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:43.374017 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:43.398882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f46939463e422682d38e22a504286e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:43.401855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f46939463e422682d38e22a504286e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:43.402548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f46939463e422682d38e22a504286e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:43.433870 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 883/1746] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:42 2022] DELETE /identity/v3/users/59f46939463e422682d38e22a504286e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:43.434765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:43.438285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.478959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 864/1747] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:43.479769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:43.486408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.530552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797287-54d5-4175-85ea-b1b2f50a61f2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:43.536093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:43.537167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.537636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.538191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.542188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.684571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee927b-1758-419a-b9c5-a83e6b103f41 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:43.687290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:43.688935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:43.727406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 884/1748] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:43.727406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:43.731417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.805692 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:43.850154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:43.850632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.851024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.852008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.858604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:43.918554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc79d-7d01-4373-8194-7a09c60793a6 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:43.927566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:43.928327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:43.928626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:43.929018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:43.951628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:43.955105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:43.992906 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:44.006517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:44.012850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125e0f-465e-434b-b3fb-63666ca0dced service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:44.021440 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 885/1749] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:44.048821 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 865/1750] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:44.080319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:44.081956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.099351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.099750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.099842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.127716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47935d-ddff-45b9-9555-c9293487e069 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:44.168646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:44.171177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.176980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.184118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] PATH_INFO: `/v3/projects/6703fad10307448cb635deefeb4a25b2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.188430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:44.189967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.200920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6703fad10307448cb635deefeb4a25b2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:44.216813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:44.235945 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 866/1751] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Sep 25 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:00:44.250642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:44.255862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.283373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085a29a-4153-405f-8372-3165c16b5f58 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:44.323438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:44.324143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.324439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.324721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.360036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:44.366681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad460-52c4-4cf9-9cd6-88904e53f019 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:44.426645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6703fad10307448cb635deefeb4a25b2', 'request_id': 'req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:44.431135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 867/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:00:44.432680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8510c4-d59f-4db3-9bb8-271c35d1974b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.436626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8510c4-d59f-4db3-9bb8-271c35d1974b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.436932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8510c4-d59f-4db3-9bb8-271c35d1974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.438564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6703fad10307448cb635deefeb4a25b2', 'request_id': 'req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:44.478087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6703fad10307448cb635deefeb4a25b2', 'request_id': 'req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:44.535264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5b8510c4-d59f-4db3-9bb8-271c35d1974b None None] MFA Rules not processed for user `725bbefab51841029b79a380ca8b54da`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:44.536395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] The token cache is being invalidate because project 6703fad10307448cb635deefeb4a25b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:44.536512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5b8510c4-d59f-4db3-9bb8-271c35d1974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.536878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:44.537723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f4c17e9-b22d-4f5e-abd2-ea033e3aa5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:44.541597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 886/1753] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:44 2022] DELETE /identity/v3/projects/6703fad10307448cb635deefeb4a25b2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:44.547194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.547840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.549545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.621367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:44.622993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.769647 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 868/1754] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:44.865228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 887/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:44.873478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:44.874168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:44.874676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:44.902089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:44.904870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.920349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:44.928952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:44.964236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 869/1756] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:44.967738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.005001 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:45.008171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487e30-7b4d-495f-84c2-c84be9dac4ce None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.025037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.027364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.028812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.030528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.032271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:45.033606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.038528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.076658 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 870/1757] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:45.081200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.102782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce42298-3937-4893-af47-863e4257fcc4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.113716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.116876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.118185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.118759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.121293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.124295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.141479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246e0c-553a-4112-beee-6dfbe2b16776 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.158757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.159606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.159992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.160641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.166326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:45.193584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.199017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.201937 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 871/1758] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:45.205759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.224778 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 888/1759] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:00:45.372174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdefb36-41ff-45cd-9235-ab79013c26b4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.381673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.382426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.384207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.384619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.385435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.389353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.466943 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 872/1760] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:45 2022] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:45.468541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.496595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc621dff-1464-40e4-b080-d45e37f71476 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.521759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.524216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.525669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.526227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.529040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.533893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.584028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.584544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 889/1761] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:45.606606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8eeb-3e53-49ad-93d5-83dc28f15390 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.612896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.613708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.613969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.614322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.614960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.616727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe136ff8-e1f2-4713-b5ba-0683a540b074 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.678093 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 873/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:45.680647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:45.705085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096bf4-5483-4567-97ff-032cd3f77939 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:45.725715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:45.726519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.726977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.727436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667/users/eb6c7e141ee847598b81de2821521ee2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.761453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3376ef868ee24293bb5d11ce59505667, user_id=eb6c7e141ee847598b81de2821521ee2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:45.764614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:45.811408 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 890/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:45 2022] PUT /identity/v3/projects/3376ef868ee24293bb5d11ce59505667/users/eb6c7e141ee847598b81de2821521ee2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:45.822996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:45.823352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:45.823639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:45.837154 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:45.890347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] MFA Rules not processed for user `eb6c7e141ee847598b81de2821521ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:45.894449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:46.066359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.068145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:46.107143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 874/1764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:46.118105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.297713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42247bb-c8b7-4436-8764-b1b7109fc831 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.321506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.322367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.322811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.323603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] PATH_INFO: `/v3/projects/f98f6fc220564971bf958d85cb265c29` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.328999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98f6fc220564971bf958d85cb265c29)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.331226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.334059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c744d-d096-42f4-aeac-eb6661cb4247 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.342112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.342965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.343370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.343846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.344792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.348743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.450146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 875/1765] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:46 2022] POST /identity/v3/projects => generated 381 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:46.466401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98f6fc220564971bf958d85cb265c29', 'request_id': 'req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.472086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.503779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98f6fc220564971bf958d85cb265c29', 'request_id': 'req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.519218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98f6fc220564971bf958d85cb265c29', 'request_id': 'req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.544125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] The token cache is being invalidate because project f98f6fc220564971bf958d85cb265c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:46.544615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.545560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5dc501fa-855a-4f5a-aa0b-6a325ce7c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:46.552150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 891/1766] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:46 2022] DELETE /identity/v3/projects/f98f6fc220564971bf958d85cb265c29 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:46.561440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1224a8-c8ab-47cc-8d7a-baed2268a5f6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.561440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1224a8-c8ab-47cc-8d7a-baed2268a5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.561440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1224a8-c8ab-47cc-8d7a-baed2268a5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.582423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9e1224a8-c8ab-47cc-8d7a-baed2268a5f6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:46.584895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e1224a8-c8ab-47cc-8d7a-baed2268a5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:46.597850 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:46.717052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb3ba-f7f0-426f-afa0-cbffe26e5801 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.726805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.727807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.728788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.730142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.733392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.740601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.766663 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 892/1767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:46.778223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.778889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.779391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.801751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 876/1768] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:46 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:46.802680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.804582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:46.833944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe1f5-83ba-4dba-8d40-cbb6f2896e41 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.839971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.840624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.840908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.841236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.843110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.845361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.846916 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:46.870424 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 877/1769] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:46.871845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:46.873670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:46.877892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.901272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 893/1770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:46.902642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.911519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570934ac-e9ad-4eb8-8b4c-64e1661619ed admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.922363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ca8a-082c-4ad6-89f3-1cbec7e1f59c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:46.931094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.931744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.932029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.932309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.933042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:46.933484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:46.936211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:46.939452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:46.940211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:46.940497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:46.940777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] PATH_INFO: `/v3/projects/02e67780d06642c58b4caeacb15b6d4a/users/226426223f7d44bf85d4ab69c470027f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:46.989798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 894/1771] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:46.990811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:46.996889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e67780d06642c58b4caeacb15b6d4a, user_id=226426223f7d44bf85d4ab69c470027f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.002845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.013189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250e0b-357a-4bef-89c9-7f30b9cd920e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.034179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.034847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.035100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.035419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.036030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.043096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.046594 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 878/1772] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:46 2022] PUT /identity/v3/projects/02e67780d06642c58b4caeacb15b6d4a/users/226426223f7d44bf85d4ab69c470027f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:47.051937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.167564 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 895/1773] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:46 2022] POST /identity/v3/projects => generated 401 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:47.170669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.260041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590839d-62d9-4519-b331-93f7f39aa3a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.309657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a1dc-2cc6-491f-b6ae-51d1223b1234 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.318114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.319020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.319428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.319861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.320740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.325164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.377134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 896/1774] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:47 2022] POST /identity/v3/users => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:47.379780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.406387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297889e9-37ca-46e4-afe1-3aab85716faa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.463273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.465959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.467649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.468060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.471268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.471862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.472955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.474615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.475410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.477221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.478683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.494120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.532206 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 879/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:47.536002 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 897/1776] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:47.541580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.547452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.554503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:47.560081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421fd4-24da-458a-9b33-06a96cae65e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.571475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.573253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.574488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.575122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] PATH_INFO: `/v3/projects/02e67780d06642c58b4caeacb15b6d4a/users/226426223f7d44bf85d4ab69c470027f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.595724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e67780d06642c58b4caeacb15b6d4a, user_id=226426223f7d44bf85d4ab69c470027f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.603430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.619828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec12645-11a8-4b82-a11e-0a13eb96d75a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.636894 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 898/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:47 2022] PUT /identity/v3/projects/02e67780d06642c58b4caeacb15b6d4a/users/226426223f7d44bf85d4ab69c470027f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:47.644485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:47.800806 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:47.854401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.854965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.855323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.855501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] PATH_INFO: `/v3/projects/66595ae4cf724de68e6880b89c32bc77` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.856782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66595ae4cf724de68e6880b89c32bc77)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.858780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.904973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267e4f-89d8-419c-a20e-8c28b8357e92 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:47.910402 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:47.926300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:47.937763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.938266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.939864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.941176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:47.949608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b433-402b-4d72-96ad-f705ec3a6848 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:47.968872 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 899/1778] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:47.971180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:47.971855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:47.972162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:47.973439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66595ae4cf724de68e6880b89c32bc77', 'request_id': 'req-733db19c-03eb-4794-93f5-8c17bbfa3e74'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:47.993969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66595ae4cf724de68e6880b89c32bc77', 'request_id': 'req-733db19c-03eb-4794-93f5-8c17bbfa3e74'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.007690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66595ae4cf724de68e6880b89c32bc77', 'request_id': 'req-733db19c-03eb-4794-93f5-8c17bbfa3e74'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.027071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] MFA Rules not processed for user `226426223f7d44bf85d4ab69c470027f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:48.037109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.048275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] The token cache is being invalidate because project 66595ae4cf724de68e6880b89c32bc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:48.048644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.050446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.059625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 880/1779] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:47 2022] DELETE /identity/v3/projects/66595ae4cf724de68e6880b89c32bc77 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:48.060610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:48.075430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.276343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db19c-03eb-4794-93f5-8c17bbfa3e74 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:48.290543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 900/1780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:48.291813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:48.293582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.298444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:48.299207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:48.299667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:48.300045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] PATH_INFO: `/v3/projects/e229bbd4baef4f60bf5d39787b04ee8a/users/d928fb6cc5dd45a78f6b5a7bd4e3e823/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:48.319252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b98848-5c78-4587-87e2-1414788cdd80 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:48.327132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:48.329127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:48.329581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:48.330294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] PATH_INFO: `/v3/users/d255604e4a7b4aa8939135e562430579` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:48.331389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d255604e4a7b4aa8939135e562430579)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:48.334780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:48.373287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e229bbd4baef4f60bf5d39787b04ee8a, user_id=d928fb6cc5dd45a78f6b5a7bd4e3e823, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:48.381506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:48.419394 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 881/1781] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:48 2022] PUT /identity/v3/projects/e229bbd4baef4f60bf5d39787b04ee8a/users/d928fb6cc5dd45a78f6b5a7bd4e3e823/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:48.420252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:48.431866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd255604e4a7b4aa8939135e562430579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.444107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.453355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd255604e4a7b4aa8939135e562430579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.509522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd255604e4a7b4aa8939135e562430579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.512558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd255604e4a7b4aa8939135e562430579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.513197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd255604e4a7b4aa8939135e562430579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:48.553266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 901/1782] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:48 2022] DELETE /identity/v3/users/d255604e4a7b4aa8939135e562430579 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:48.553266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:48.556852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.658376 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:48.693209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885409-8eea-4201-9fc4-f72a4ed1b17d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:48.790182 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:48.811107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5bec0-216a-4b01-b885-bb3b7413c95c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:48.838289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:48.839388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:48.839388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:48.839581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:48.844921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:48.885879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:48.887957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:48.889103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:48.890702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] PATH_INFO: `/v3/users/8fa94183119e4b1e93721001f72404c5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:48.897880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa94183119e4b1e93721001f72404c5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:48.900889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:49.091034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa94183119e4b1e93721001f72404c5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:49.092988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa94183119e4b1e93721001f72404c5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:49.115791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:49.117783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5ac9c-a57c-4935-9c76-8a323babba4a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:49.128283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa94183119e4b1e93721001f72404c5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:49.155438 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 902/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:49.159020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:49.159373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:49.159650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:49.172725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa94183119e4b1e93721001f72404c5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:49.174217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41c0c39e-af6c-4a22-a7da-7d382b2417ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa94183119e4b1e93721001f72404c5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:49.214257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 882/1784] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:48 2022] DELETE /identity/v3/users/8fa94183119e4b1e93721001f72404c5 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:49.215753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b15a8-ec6c-4705-a737-a3fe66ab968e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:49.216051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b15a8-ec6c-4705-a737-a3fe66ab968e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:49.216312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b15a8-ec6c-4705-a737-a3fe66ab968e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:49.218080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 883/1785] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:49.222886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:49.223161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:49.223426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:49.260987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] MFA Rules not processed for user `d928fb6cc5dd45a78f6b5a7bd4e3e823`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:49.263203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.280546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:49.287301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.460399 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 884/1786] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:49.462762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:49.464399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.466166 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 903/1787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:49.470192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:49.474232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.517071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c714f-14f6-4096-b05b-58fb26137d79 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:49.526336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:49.526995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:49.527364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:49.527688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:49.528434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:49.533574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:49.598914 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 904/1788] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:49 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:49.599857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:49.602779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.642693 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:49.698299 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:49.726888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:49.742588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:49.760162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259e3f-9e9f-4276-9caf-0419268422db admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:49.770536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:49.772240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:49.772825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:49.774423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.033083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.034754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335abaf-8235-43bb-983c-efa63f6d7149 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.051376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea514-7725-4f49-9e65-c06a66a2bc55 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.063868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 905/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:50.065532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7676e-0c24-4673-aff0-c10f05686399 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.066342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7676e-0c24-4673-aff0-c10f05686399 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.066760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7676e-0c24-4673-aff0-c10f05686399 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.068482 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 906/1790] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:50.070841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7676e-0c24-4673-aff0-c10f05686399 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.111152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7676e-0c24-4673-aff0-c10f05686399 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.137567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.138369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.141226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.141645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.142423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.151039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5bb07-399a-489b-b35b-2aeecd088093 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.224448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 907/1791] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:50 2022] POST /identity/v3/users => generated 308 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:50.226577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007014-e501-4994-a89e-2c2d681a6c94 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.227598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007014-e501-4994-a89e-2c2d681a6c94 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.228078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007014-e501-4994-a89e-2c2d681a6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.300924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-89007014-e501-4994-a89e-2c2d681a6c94 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:50.303780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89007014-e501-4994-a89e-2c2d681a6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:50.339922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.342311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.343111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.343844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.346072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.348869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.367727 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 885/1792] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:49 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 907 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:50.370555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.417551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 908/1793] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:50.418983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b36038-07db-4031-bb2a-f99a763f87d9 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.430624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.432439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.432802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.435777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.436581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.443514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.443932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.444101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.444385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.447001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 909/1794] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:00:50.452276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:50.454222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:50.499944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.502968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 886/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:50.506934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.529030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38de206-bb6f-4b07-8a37-ef1a991a42c8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.543725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.544780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.545200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.545736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.548991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.550790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf126a-4921-42c1-a1b0-5562d8781545 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.555609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.561182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 910/1796] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:50 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:00:50.563272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.568260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.569152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.569384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.570735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.586611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.589606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3f5b-d220-46d4-b31e-66c55cd985a9 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.608103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40789c1b-4b92-43b7-8ddd-074e3d5e0171 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.623492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.624280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.624616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.626129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] PATH_INFO: `/v3/projects/7d695f9d4a0e4dd3980de606cbd33530/users/26e0092d2dfd4ae698aa8fb9ac07a840/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.658409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 887/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:50.673310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d695f9d4a0e4dd3980de606cbd33530, user_id=26e0092d2dfd4ae698aa8fb9ac07a840, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.676595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.707364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.707952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.708759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.730014 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 911/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:50 2022] PUT /identity/v3/projects/7d695f9d4a0e4dd3980de606cbd33530/users/26e0092d2dfd4ae698aa8fb9ac07a840/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:50.733115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.771461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] MFA Rules not processed for user `eb6c7e141ee847598b81de2821521ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:50.778129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:50.810308 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:50.905239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f845-e703-4ffc-82e5-568d95033ff5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:50.910411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:50.910865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:50.911163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:50.911433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:50.912132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:50.913838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:50.942415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 912/1799] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:50.943518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:50.984929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909a923-5bd3-4176-8547-c11c6245a035 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:51.023095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:51.030485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:51.031112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:51.031918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] PATH_INFO: `/v3/projects/7d695f9d4a0e4dd3980de606cbd33530/users/26e0092d2dfd4ae698aa8fb9ac07a840/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:51.032435 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 888/1800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:51.034664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d695f9d4a0e4dd3980de606cbd33530, user_id=26e0092d2dfd4ae698aa8fb9ac07a840, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:51.035410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:51.044039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11e97e-16f2-4eea-a3a9-28598ae71044 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:51.084571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 913/1801] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:50 2022] PUT /identity/v3/projects/7d695f9d4a0e4dd3980de606cbd33530/users/26e0092d2dfd4ae698aa8fb9ac07a840/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:51.096090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:51.096732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:51.097223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:51.128211 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:51.177650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] MFA Rules not processed for user `26e0092d2dfd4ae698aa8fb9ac07a840`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:51.178958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:51.325521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96311985-7a42-40de-aced-ce17a7ebd1f2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:51.550120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:51.550929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:51.551317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:51.551773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:51.560353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:51.561144 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 914/1802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:00:51.562069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:51.570930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:51.835049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:51.842928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:51.885587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2856fb-d738-4f88-8c6e-13f2fa191ca4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:51.891563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 889/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:51.893207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:51.894250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:51.894825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:51.895370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] PATH_INFO: `/v3/projects/c10459f2160f4830af009d990f34303e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:51.896849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10459f2160f4830af009d990f34303e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:51.900184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:51.986192 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:52.026685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:52.028354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.040306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10459f2160f4830af009d990f34303e', 'request_id': 'req-91aa6e00-68fd-4944-abd8-0127138b8861'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.059311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d039f-bb41-4f12-9ac4-bda68b6e0ed1 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:52.062609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10459f2160f4830af009d990f34303e', 'request_id': 'req-91aa6e00-68fd-4944-abd8-0127138b8861'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.098665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10459f2160f4830af009d990f34303e', 'request_id': 'req-91aa6e00-68fd-4944-abd8-0127138b8861'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.137080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] The token cache is being invalidate because project c10459f2160f4830af009d990f34303e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:52.137571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.139294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-91aa6e00-68fd-4944-abd8-0127138b8861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.148310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 915/1804] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:51 2022] DELETE /identity/v3/projects/c10459f2160f4830af009d990f34303e => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:52.150082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d47e-bf0e-49f5-aaa7-40c82fceffd4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.150372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d47e-bf0e-49f5-aaa7-40c82fceffd4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.150649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d47e-bf0e-49f5-aaa7-40c82fceffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.202332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2c9d47e-bf0e-49f5-aaa7-40c82fceffd4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:52.206730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2c9d47e-bf0e-49f5-aaa7-40c82fceffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.227431 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:52.238735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:52.239958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.240388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.241290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] PATH_INFO: `/v3/projects/30785e233cce4faf935d12f26be0db4d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.243205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=30785e233cce4faf935d12f26be0db4d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:52.247321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:52.396910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30785e233cce4faf935d12f26be0db4d', 'request_id': 'req-401be9c3-1963-4f43-889f-bfa9fb8942bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.407323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30785e233cce4faf935d12f26be0db4d', 'request_id': 'req-401be9c3-1963-4f43-889f-bfa9fb8942bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.433206 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 916/1805] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:52.439349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708346-fe4f-46cf-b8da-772011989033 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.439749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708346-fe4f-46cf-b8da-772011989033 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.440095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708346-fe4f-46cf-b8da-772011989033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.442195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30785e233cce4faf935d12f26be0db4d', 'request_id': 'req-401be9c3-1963-4f43-889f-bfa9fb8942bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.478961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] The token cache is being invalidate because project 30785e233cce4faf935d12f26be0db4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:52.479278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.481208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-401be9c3-1963-4f43-889f-bfa9fb8942bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:52.484412 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 890/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:52 2022] DELETE /identity/v3/projects/30785e233cce4faf935d12f26be0db4d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:00:52.485773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.486058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.486332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.488133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-98708346-fe4f-46cf-b8da-772011989033 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:52.493035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98708346-fe4f-46cf-b8da-772011989033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.573868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:52.576557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.681371 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 917/1807] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:52.682817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98708346-fe4f-46cf-b8da-772011989033 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:52.686010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98708346-fe4f-46cf-b8da-772011989033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.707904 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 891/1808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:52.709094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:52.712178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.883798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98708346-fe4f-46cf-b8da-772011989033 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:52.906775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:52.908205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.908647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.908871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fcdcf-806e-4b00-9272-6a5956f019bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:52.911028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] PATH_INFO: `/v3/users/35884c6b48614bb4bbc11150cc455b61` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.916995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:52.918177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:52.918741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:52.919208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:52.921225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35884c6b48614bb4bbc11150cc455b61)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:52.922047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:52.931534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:52.950366 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:52.987888 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:53.080121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35884c6b48614bb4bbc11150cc455b61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:53.099168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:53.112859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:53.124328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35884c6b48614bb4bbc11150cc455b61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:53.146428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 892/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:53.147294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:53.153575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:53.197701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35884c6b48614bb4bbc11150cc455b61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:53.198757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35884c6b48614bb4bbc11150cc455b61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:53.199484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35884c6b48614bb4bbc11150cc455b61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:53.269642 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 918/1810] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:52 2022] DELETE /identity/v3/users/35884c6b48614bb4bbc11150cc455b61 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:53.271749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:53.278227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:53.366331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd093-6d8b-4266-872d-d2b139add621 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:53.505793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f8aa-bf4f-40a6-8bf5-bdc0dd4676b2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:53.541921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:53.542601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:53.542890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:53.543171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:53.543872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:53.544161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:53.545855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:53.552022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:53.554266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:53.554695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:53.555047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:53.562016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:53.588680 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 919/1811] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:53.588680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:53.593191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:53.732289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:53.734025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:53.768476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 893/1812] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:53.770983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:53.779281 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:53.786584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc0b2-8687-439d-8a3f-9185bdd949e9 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:53.794078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:53.795033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:53.795266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:53.796076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:53.796648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:53.799240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:53.862088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4707b-a7ba-4740-ae7e-6413788d4c55 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:53.878856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:53.881030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:53.883536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:53.883859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:53.887911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:53.901832 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 894/1813] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:53 2022] POST /identity/v3/projects => generated 407 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:53.907323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:53.919777 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:53.995252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:53.998306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:54.014642 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 920/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:54.143557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46694-2b17-43f6-9746-a780302c0efe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:54.160560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:54.161204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.161531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.161859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.163738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:54.169993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:54.231537 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 895/1815] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:53 2022] POST /identity/v3/users => generated 304 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:54.233154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:54.249738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda89f-86c6-461e-a3e8-098f80b65759 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:54.269849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:54.270829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.271149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.271409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.272704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:54.278444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:54.303214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 921/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:54.306531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:54.334646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5b67-7a65-4d84-b5d9-fbd2e63ac5fa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:54.355633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:54.356643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.357115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.357680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.358671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:54.365765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e2efd-3041-4915-b885-3c4ac48203f7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:54.405265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 896/1817] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:54.410499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:54.429344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682160-2473-4158-93bb-fd4b52a8b368 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:54.448871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:54.453233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.455069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.455647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] PATH_INFO: `/v3/projects/1cfb6fff4e5843cd939398d4bb2f88c6/users/5340191ef1eb4757ae8b8330a60b8b6c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.527898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578705-c7fe-4afd-b7da-79e45c7adf61 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.528264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578705-c7fe-4afd-b7da-79e45c7adf61 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.528782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578705-c7fe-4afd-b7da-79e45c7adf61 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.537484 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 897/1818] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:54.542075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfb6fff4e5843cd939398d4bb2f88c6, user_id=5340191ef1eb4757ae8b8330a60b8b6c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:54.543055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa6e5-3d42-42f1-824e-3d4baf8ad3e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.543646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa6e5-3d42-42f1-824e-3d4baf8ad3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.544068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa6e5-3d42-42f1-824e-3d4baf8ad3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.546509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:54.586729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 922/1819] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:54 2022] PUT /identity/v3/projects/1cfb6fff4e5843cd939398d4bb2f88c6/users/5340191ef1eb4757ae8b8330a60b8b6c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:54.587799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:54.588980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b09aa6e5-3d42-42f1-824e-3d4baf8ad3e8 None None] MFA Rules not processed for user `98ed412afded46c49d993a2749e42c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:54.591070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b09aa6e5-3d42-42f1-824e-3d4baf8ad3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:54.748001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 898/1820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:00:54.753464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:54.753851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:54.755624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:54.826529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:54.828830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] MFA Rules not processed for user `5340191ef1eb4757ae8b8330a60b8b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:54.830294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:54.833875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:54.951172 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:55.047213 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 899/1821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:55.052954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.059667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:55.061108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419613-2196-458d-b8ec-c12fd7b92516 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.080694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.081522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.081786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.082053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.086787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.103010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.104858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 923/1822] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:54 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:55.105919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.196960 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:55.275245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d6ef-9a63-4bc0-abaf-838997f05d81 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.296992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.312170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.312683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.313152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.314045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.316134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cedd99-8a85-4340-a4f3-39082e48cb93 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.343271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596ef4-9f31-4436-a248-1eee9132a645 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.365759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.367142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.367552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.368031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.368971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.371117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.442978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 900/1823] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:55 2022] POST /identity/v3/projects => generated 403 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:55.444406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c8b-d277-44e6-9432-344c13a24d73 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.444736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c8b-d277-44e6-9432-344c13a24d73 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.445041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c8b-d277-44e6-9432-344c13a24d73 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.447070 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 901/1824] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:55.447850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474c8b-d277-44e6-9432-344c13a24d73 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.481962 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 924/1825] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:55 2022] POST /identity/v3/projects => generated 407 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:55.486802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:55.682892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.722736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474c8b-d277-44e6-9432-344c13a24d73 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.845111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5deb-04f0-45c8-9dc4-9514fa4fa490 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.857205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.857921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.858248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.858975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.860983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.863690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.878124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.878508 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 925/1826] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:55 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:55.879440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.880034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.880322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.881218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.882057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.885551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.910689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b95e-7119-45b9-81d3-1572964b5c2b tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.911191 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:55.933331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.933989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 902/1827] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:55 2022] POST /identity/v3/users => generated 308 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:55.934456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.934881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.935019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.935421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.936218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.936891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:55.938529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.951504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a9d4-b01a-418c-a2cc-c871cd277169 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:55.957081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:55.957909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:55.958227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:55.958535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] PATH_INFO: `/v3/projects/c1e3bf6896a74af3b90345043a52b854` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:55.959901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e3bf6896a74af3b90345043a52b854)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:55.963313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:55.984607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 926/1828] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:55 2022] POST /identity/v3/users => generated 310 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:55.987207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:55.991201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.014946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ee52-dedc-46d9-8c1d-fe0d6b384b7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:56.020630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:56.021310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.021706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.021909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] PATH_INFO: `/v3/users/d928fb6cc5dd45a78f6b5a7bd4e3e823` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.023370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d928fb6cc5dd45a78f6b5a7bd4e3e823)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:56.025564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:56.047145 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:56.123508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e3bf6896a74af3b90345043a52b854', 'request_id': 'req-996cd60d-c6db-416c-a6b3-5784b345b619'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.129684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd928fb6cc5dd45a78f6b5a7bd4e3e823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.144076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e3bf6896a74af3b90345043a52b854', 'request_id': 'req-996cd60d-c6db-416c-a6b3-5784b345b619'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.151484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd928fb6cc5dd45a78f6b5a7bd4e3e823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.156594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e3bf6896a74af3b90345043a52b854', 'request_id': 'req-996cd60d-c6db-416c-a6b3-5784b345b619'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.198593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd928fb6cc5dd45a78f6b5a7bd4e3e823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.199624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] The token cache is being invalidate because project c1e3bf6896a74af3b90345043a52b854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:56.199974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.200079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd928fb6cc5dd45a78f6b5a7bd4e3e823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.200733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd928fb6cc5dd45a78f6b5a7bd4e3e823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.202152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:56.210078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 903/1829] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:55 2022] DELETE /identity/v3/projects/c1e3bf6896a74af3b90345043a52b854 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:56.215215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.216823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.254694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 927/1830] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:55 2022] DELETE /identity/v3/users/d928fb6cc5dd45a78f6b5a7bd4e3e823 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:56.265884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.270911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.312406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd60d-c6db-416c-a6b3-5784b345b619 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:56.411341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:56.412339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.412838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.413322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.414587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:56.416463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cefb5-44ba-4aca-a0d0-095a598fba0c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:56.429702 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 904/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:56.432713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.433162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.433593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.471029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb332d-4438-481c-aa11-141027576e48 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:56.483581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:56.484939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:56.485664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.485952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.486335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.486950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:56.488593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.491057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dabe5-bb34-4ad0-990e-23b6e29ec964 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:56.517984 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 928/1832] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:56.524593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 905/1833] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:56.525961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.526220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ff8d-df2c-4bcd-9ad5-896da0c0cf29 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.534595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ff8d-df2c-4bcd-9ad5-896da0c0cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.535189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ff8d-df2c-4bcd-9ad5-896da0c0cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.541251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d3879-9c1f-485c-a194-ef8551d13772 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:56.549320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:56.550278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.550865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.551244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] PATH_INFO: `/v3/projects/3d3702a599b248909d6d2828d3ce58bf/users/d467ea16905d40ce8b4121b21942bf7d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.585082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3702a599b248909d6d2828d3ce58bf, user_id=d467ea16905d40ce8b4121b21942bf7d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:56.589528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:56.598310 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:56.605156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2d2ff8d-df2c-4bcd-9ad5-896da0c0cf29 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:56.611957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2d2ff8d-df2c-4bcd-9ad5-896da0c0cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.640194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 906/1834] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:56 2022] PUT /identity/v3/projects/3d3702a599b248909d6d2828d3ce58bf/users/d467ea16905d40ce8b4121b21942bf7d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:56.641034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.646958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.651136 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 929/1835] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:56.655686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.656042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.656472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.710343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:56.715348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.776966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe974-80a1-4e8e-8641-30df51e0a9c4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:56.790798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:56.791644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:56.792081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:56.792541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] PATH_INFO: `/v3/projects/36091b4b36964aa0948bd541b96f58df/users/a7519c8b53b448ed9eb2303d9ed29438/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:56.814670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36091b4b36964aa0948bd541b96f58df, user_id=a7519c8b53b448ed9eb2303d9ed29438, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:56.818442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:56.851626 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 907/1836] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:56 2022] PUT /identity/v3/projects/36091b4b36964aa0948bd541b96f58df/users/a7519c8b53b448ed9eb2303d9ed29438/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:56.854087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.884410 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 930/1837] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:56.885782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:56.889688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:56.951589 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.033270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1e4c-b683-407e-8e09-3cf43cea4c59 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.047300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b562-0557-4cb2-9e61-d7afa556fa8e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.060051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.062072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.063246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.063611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.064469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.068374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963357a-ce1e-4a9e-bc48-31540cd9c685 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.096949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 908/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:57.098553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b6eb-b90c-407f-8b02-9e06137093a2 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.101091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b6eb-b90c-407f-8b02-9e06137093a2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.105718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b6eb-b90c-407f-8b02-9e06137093a2 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.106779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 909/1839] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:00:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:00:57.109940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.111696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.112062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.153224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.153224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.153224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.153224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.165994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:57.166257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.168053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.173202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:57.193758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 931/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:57.194975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.208414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 910/1841] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Sep 25 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:57.213750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.218636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73e492-5db3-42ea-ac8a-ae3b1f9ae965 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.228665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.229626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.231957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.232384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.233448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.237318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.260753 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 932/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:57.260971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890446-dde6-43f7-bb17-07138baefd7a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.261118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.280907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.281944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.285930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.286250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.290961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:00:57.291362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.300848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c329ff-7a98-48e0-b311-fadd8c30c0e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.301346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.323128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.324467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.324899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.325316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] PATH_INFO: `/v3/projects/3d3702a599b248909d6d2828d3ce58bf/users/d467ea16905d40ce8b4121b21942bf7d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.327788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3702a599b248909d6d2828d3ce58bf, user_id=d467ea16905d40ce8b4121b21942bf7d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.331286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.349455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 911/1843] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:57.355280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:00:57.360716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 933/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:57 2022] PUT /identity/v3/projects/3d3702a599b248909d6d2828d3ce58bf/users/d467ea16905d40ce8b4121b21942bf7d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:57.360716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.360967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:57.557011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33303-00cc-4555-bcad-3ca88d4b78d4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.565310 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.574363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.574363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.574363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.574363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] PATH_INFO: `/v3/projects/36091b4b36964aa0948bd541b96f58df/users/a7519c8b53b448ed9eb2303d9ed29438/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.579590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36091b4b36964aa0948bd541b96f58df, user_id=a7519c8b53b448ed9eb2303d9ed29438, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.586701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.613155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.614700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:57.616128 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 934/1845] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:57 2022] PUT /identity/v3/projects/36091b4b36964aa0948bd541b96f58df/users/a7519c8b53b448ed9eb2303d9ed29438/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:57.617100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:57.786282 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.786671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b2508-04eb-4572-8aea-53fb980945dc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.815721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062c906-db61-4319-b303-4aab312303c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:57.832321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:57.834381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.834970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.836584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.838128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:57.857711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c176c-f892-49f9-88d5-1aca62147773 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:57.962788 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 935/1846] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:00:57 2022] POST /identity/v3/projects => generated 383 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:57.964403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:57.964812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:57.965182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:57.999959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:58.001684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.002009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.002346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.009359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:58.012145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:58.017698 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 912/1847] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:00:57 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 668 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:00:58.020710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:58.034451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] MFA Rules not processed for user `a7519c8b53b448ed9eb2303d9ed29438`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:58.036221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:58.039034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:58.078982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893696d1-9981-4ea6-a3c7-28d47b3a188a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:58.396433 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 936/1848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:58.399133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:58.403944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:58.405916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.406206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.406489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] PATH_INFO: `/v3/projects/e229bbd4baef4f60bf5d39787b04ee8a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.420928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e229bbd4baef4f60bf5d39787b04ee8a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:58.425595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:58.438924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4dd9e-5c73-496a-b912-ff0a9e1828ce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:58.450070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:58.450710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.451064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.451344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.452077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:58.457627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c9ea-4efd-4889-aa14-4d0d4fadcb07 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:58.556989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 937/1849] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:00:58 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:00:58.564538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.566790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.567416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.579745 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:58.607524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e229bbd4baef4f60bf5d39787b04ee8a', 'request_id': 'req-3b524f7b-f8be-477f-8c0a-4d96e18fa490'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:58.636523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e229bbd4baef4f60bf5d39787b04ee8a', 'request_id': 'req-3b524f7b-f8be-477f-8c0a-4d96e18fa490'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:58.640525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] MFA Rules not processed for user `eb6c7e141ee847598b81de2821521ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:58.644271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:58.667230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e229bbd4baef4f60bf5d39787b04ee8a', 'request_id': 'req-3b524f7b-f8be-477f-8c0a-4d96e18fa490'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:58.728349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] The token cache is being invalidate because project e229bbd4baef4f60bf5d39787b04ee8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:00:58.731292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:58.732733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:58.735048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 913/1850] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:00:58 2022] DELETE /identity/v3/projects/e229bbd4baef4f60bf5d39787b04ee8a => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:58.736307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:58.739919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:58.791060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 938/1851] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:58.792545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:58.794627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:58.934730 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:58.955895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524f7b-f8be-477f-8c0a-4d96e18fa490 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:58.971065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d42d2-dc19-4436-a41c-3f4c08c707af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:58.973197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:58.975405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.979279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.980324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] PATH_INFO: `/v3/users/5340191ef1eb4757ae8b8330a60b8b6c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.981619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:58.982426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:58.982820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:58.983250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:58.984133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:58.985243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5340191ef1eb4757ae8b8330a60b8b6c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:58.990360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:58.992894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:59.025692 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 939/1852] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:59.027216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:59.029497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.076437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa192-aa51-4b15-818d-56481d500c57 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:59.090096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:59.094337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.095783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.096177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] PATH_INFO: `/v3/users/26e0092d2dfd4ae698aa8fb9ac07a840` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.099841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e0092d2dfd4ae698aa8fb9ac07a840)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:59.104234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:59.138157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5340191ef1eb4757ae8b8330a60b8b6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.145505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5340191ef1eb4757ae8b8330a60b8b6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.167557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5340191ef1eb4757ae8b8330a60b8b6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.189610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5340191ef1eb4757ae8b8330a60b8b6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.193104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5340191ef1eb4757ae8b8330a60b8b6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.244712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 914/1853] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:58 2022] DELETE /identity/v3/users/5340191ef1eb4757ae8b8330a60b8b6c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:59.246774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:59.249579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.323865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e0092d2dfd4ae698aa8fb9ac07a840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.342383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e0092d2dfd4ae698aa8fb9ac07a840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.384924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e0092d2dfd4ae698aa8fb9ac07a840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.389265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e0092d2dfd4ae698aa8fb9ac07a840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.409245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e0092d2dfd4ae698aa8fb9ac07a840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:00:59.436777 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:59.490676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa224-f8af-4844-8448-3d3acbd471a9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:59.512381 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 940/1854] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:00:59 2022] DELETE /identity/v3/users/26e0092d2dfd4ae698aa8fb9ac07a840 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:00:59.513042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:59.533782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.535061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:59.539200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.539744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.544516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.545793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:59.547795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef088a-e143-4c17-957e-50d89b08604e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:59.580505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 915/1855] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:00:59.582842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.583189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.587039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.639119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:00:59.642165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.822013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604428-d96c-4480-96ef-986b3602981e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:59.834486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:59.837184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.838101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.838322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.846826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 916/1856] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:00:59.847052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.847149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:59.850775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.884801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:59.886443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:59.896854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8f3bc-8c5d-4bb1-a5d4-b453e572d5ee None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:59.911221 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 941/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:59.911738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:00:59.913964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:59.914667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.914779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:00:59.914995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.915215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] PATH_INFO: `/v3/projects/5d97e6749ea8470788e7c39a19e8e915/users/3d9611c77204433387444c04c1f1401c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.941784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbd9c-4f73-49e2-ad6a-8c327aa5a9e0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:00:59.955641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:00:59.957936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:00:59.958430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:00:59.960747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:00:59.992014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:59.993543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4028f-ce94-4ada-8ae7-be53d7672024 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:00:59.995227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d97e6749ea8470788e7c39a19e8e915, user_id=3d9611c77204433387444c04c1f1401c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:00:59.998247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:00.021317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 942/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:00.063021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 917/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:00:59 2022] PUT /identity/v3/projects/5d97e6749ea8470788e7c39a19e8e915/users/3d9611c77204433387444c04c1f1401c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:00.064631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:00.064922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:00.066112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:00.170118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] MFA Rules not processed for user `3d9611c77204433387444c04c1f1401c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:00.176885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:00.332428 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:00.432246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:00.434527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 943/1860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:00.660494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5eb5-da1d-49b5-8d08-96e4648904e4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:00.686342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:00.686999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:00.687282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:00.687544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:00.688192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:00.690320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:00.832344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:00.833189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 918/1861] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:00.878275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4fd5d-0014-4c46-81e7-5217cf7eb41a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.113883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.115230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.116057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.116619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.117324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.119985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.180315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 944/1862] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:00 2022] POST /identity/v3/users => generated 299 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:01.185533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:01.228856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a746c5-ccd9-4a5e-85fb-ece3cb5ba812 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.279240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.279894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.280172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.280444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.281102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.306373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.344508 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 919/1863] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:01.348929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:01.368440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6e6da-0bb5-4381-b40e-3f65ea3ff65f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.396171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.396946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.397229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.397644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] PATH_INFO: `/v3/projects/d5e8b70f69264b329841d6b11285e6ec/users/c7ca82f19d8e475a93fd6947d77b3496/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.447048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e8b70f69264b329841d6b11285e6ec, user_id=c7ca82f19d8e475a93fd6947d77b3496, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.459515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.505332 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 945/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:01 2022] PUT /identity/v3/projects/d5e8b70f69264b329841d6b11285e6ec/users/c7ca82f19d8e475a93fd6947d77b3496/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:01.511023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:01.526594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036bd86-540c-4548-957c-85c118df8b5e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.603592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:01.605594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:01.747815 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:01.841583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2d67-49b9-4d26-a61a-3b6960439ce6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.844572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.846222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.846769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.847244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.848498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.853047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.858137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.858820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.859099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.859375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] PATH_INFO: `/v3/projects/7d695f9d4a0e4dd3980de606cbd33530` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.864700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d695f9d4a0e4dd3980de606cbd33530)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.868656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.884126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 920/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:01.888307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:01.920092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6835a-3ff6-4069-95c2-1c99d079feb7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:01.930682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:01.950206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:01.952129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:01.953204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] PATH_INFO: `/v3/projects/d5e8b70f69264b329841d6b11285e6ec/users/c7ca82f19d8e475a93fd6947d77b3496/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:01.975341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e8b70f69264b329841d6b11285e6ec, user_id=c7ca82f19d8e475a93fd6947d77b3496, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:01.977226 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:01.983873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d695f9d4a0e4dd3980de606cbd33530', 'request_id': 'req-633c1174-927e-4382-8602-f050ad77316a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:01.990011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec333e-6a77-498a-ba45-b93bfe10bd3e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:01.996301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d695f9d4a0e4dd3980de606cbd33530', 'request_id': 'req-633c1174-927e-4382-8602-f050ad77316a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.014950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d695f9d4a0e4dd3980de606cbd33530', 'request_id': 'req-633c1174-927e-4382-8602-f050ad77316a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.046380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] The token cache is being invalidate because project 7d695f9d4a0e4dd3980de606cbd33530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:02.048256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.050743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-633c1174-927e-4382-8602-f050ad77316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.053601 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 921/1866] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:01 2022] PUT /identity/v3/projects/d5e8b70f69264b329841d6b11285e6ec/users/c7ca82f19d8e475a93fd6947d77b3496/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:02.063780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.064190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.064578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.065381 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 946/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:01 2022] DELETE /identity/v3/projects/7d695f9d4a0e4dd3980de606cbd33530 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:02.072032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184a23-aec4-4876-b4ce-873ff439eaf7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.074192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184a23-aec4-4876-b4ce-873ff439eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.075344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184a23-aec4-4876-b4ce-873ff439eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.129871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:02.135175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.167158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac184a23-aec4-4876-b4ce-873ff439eaf7 None None] MFA Rules not processed for user `c7ca82f19d8e475a93fd6947d77b3496`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:02.170809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac184a23-aec4-4876-b4ce-873ff439eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.364589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 922/1868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:02.364589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:02.364589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.410634 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 947/1869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:02.416007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.416007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.416007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.416422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67b602-6a16-48c4-8217-54d245925c90 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:02.428377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:02.429504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.429794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.430074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] PATH_INFO: `/v3/projects/1cfb6fff4e5843cd939398d4bb2f88c6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.432803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfb6fff4e5843cd939398d4bb2f88c6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:02.434953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:02.468489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:02.469944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.515049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 948/1870] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:02.515049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:02.523329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.605929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfb6fff4e5843cd939398d4bb2f88c6', 'request_id': 'req-26f1eb45-0a04-460a-be89-9c73f5ebbb76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.615164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfb6fff4e5843cd939398d4bb2f88c6', 'request_id': 'req-26f1eb45-0a04-460a-be89-9c73f5ebbb76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.627510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfb6fff4e5843cd939398d4bb2f88c6', 'request_id': 'req-26f1eb45-0a04-460a-be89-9c73f5ebbb76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.661515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] The token cache is being invalidate because project 1cfb6fff4e5843cd939398d4bb2f88c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:02.664864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.668637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:02.675605 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 923/1871] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:02 2022] DELETE /identity/v3/projects/1cfb6fff4e5843cd939398d4bb2f88c6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:02.677736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:02.680582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.792091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfee34-72ec-461d-8871-b76d06feb829 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:02.844018 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:02.900991 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:02.928409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1eb45-0a04-460a-be89-9c73f5ebbb76 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:02.945758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:02.947079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.947807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.949169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.950453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:02.952245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:02.954355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:02.972147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:02.973149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:02.973719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:02.974202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:02.979691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:02.986712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 924/1872] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:02.989778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:02.994728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:03.055260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b892c-f711-469d-8d2f-881695219244 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:03.071272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:03.073959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:03.074509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:03.077207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] PATH_INFO: `/v3/users/a7519c8b53b448ed9eb2303d9ed29438` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:03.079088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7519c8b53b448ed9eb2303d9ed29438)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:03.087707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:03.198908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:03.204535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:03.259453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7519c8b53b448ed9eb2303d9ed29438'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:03.261394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7519c8b53b448ed9eb2303d9ed29438'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:03.265573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 949/1873] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:03.266586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:03.279562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7519c8b53b448ed9eb2303d9ed29438'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:03.306431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b149-6251-450a-87d4-d436dd612482 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:03.330134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:03.333150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:03.336182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:03.337044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:03.339727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:03.340850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7519c8b53b448ed9eb2303d9ed29438'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:03.349304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:03.353397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7519c8b53b448ed9eb2303d9ed29438'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:03.394186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 925/1874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:02 2022] DELETE /identity/v3/users/a7519c8b53b448ed9eb2303d9ed29438 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:03.454180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 950/1875] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:03.459122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:03.462558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:03.655317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51b7f8-03bf-4cbc-8c1e-7fe69177ad89 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:03.832085 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:03.849125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:03.850692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:03.851675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:03.852119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:03.852990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:03.861872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:03.944723 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 926/1876] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:03 2022] POST /identity/v3/users => generated 292 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:03.947308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:03.968985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368c264-2870-458e-8288-b2bb1b2a6cf3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:03.983222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:03.984152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:03.984513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:03.984917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:03.985673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:03.989885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:04.022061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 951/1877] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:01:04.026857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:04.055222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b9b61-07c6-4938-9c0a-603c07a199e8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:04.082886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:04.083812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:04.084098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:04.084460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:04.085228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:04.086935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ea18a-be5a-45ef-9e9c-ffdcc432fe15 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:04.136379 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 927/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:04.137292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:04.155881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e71f-460e-4a91-89ed-095190aa24a6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:04.168670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:04.169501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:04.169887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:04.170245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] PATH_INFO: `/v3/projects/d32c3a547947439aa0ce955a10cc05c7/users/5c32e71622fa41fbaa80b08c047b8b33/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:04.206882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32c3a547947439aa0ce955a10cc05c7, user_id=5c32e71622fa41fbaa80b08c047b8b33, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:04.210958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:04.248325 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 952/1879] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:04 2022] PUT /identity/v3/projects/d32c3a547947439aa0ce955a10cc05c7/users/5c32e71622fa41fbaa80b08c047b8b33/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:04.250728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:04.251095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:04.251272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:04.344503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] MFA Rules not processed for user `5c32e71622fa41fbaa80b08c047b8b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:04.345900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:04.619374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 928/1880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:04.624121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.014397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efca28-c0a7-4c1e-8c7e-33437d47c5eb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:05.041878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:05.042980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:05.043482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:05.043964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:05.045340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:05.061894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:05.185691 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 953/1881] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:05.190820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.233601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b2fc-aa0a-4636-8bf0-1bb3f479ab41 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:05.359052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:05.359868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:05.360226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:05.360604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:05.361594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:05.371256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:05.419065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.419371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 929/1882] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:05 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:05.443895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b822-2ff2-4646-97ee-22a2693f35bd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:05.455642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:05.456422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:05.456870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:05.457143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:05.457979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:05.459641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:05.490339 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:05.512151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.515621 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 954/1883] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:05.539434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896dec6-c83b-4cd7-86b2-287030c8ceea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:05.567705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:05.568604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:05.569062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:05.569579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] PATH_INFO: `/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5/users/7f4bc39c602f4354985ffc2d648b2be2/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:05.618604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8799ca69ff7e4bc2b69a4ac8542c82f5, user_id=7f4bc39c602f4354985ffc2d648b2be2, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:05.621504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:05.652212 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 930/1884] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:05 2022] PUT /identity/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5/users/7f4bc39c602f4354985ffc2d648b2be2/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:05.653317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.670293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37c2e-caec-4712-b159-9221e0f1914b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:05.874436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:05.874884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:05.875174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:05.875434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:05.876086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:05.877810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98eba-980b-4a11-b221-6effa5c3d10a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:05.919769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:05.923467 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 955/1885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:05.978801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0ad12-0f50-44cb-b72f-b72826bebbcc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:06.027784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:06.028957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:06.029495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:06.029991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] PATH_INFO: `/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5/users/7f4bc39c602f4354985ffc2d648b2be2/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:06.048177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8799ca69ff7e4bc2b69a4ac8542c82f5, user_id=7f4bc39c602f4354985ffc2d648b2be2, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:06.072589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:06.124692 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 931/1886] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:05 2022] PUT /identity/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5/users/7f4bc39c602f4354985ffc2d648b2be2/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:06.137908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ec2-8853-4f32-81ea-1173411e3cdb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:06.138846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ec2-8853-4f32-81ea-1173411e3cdb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:06.139124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ec2-8853-4f32-81ea-1173411e3cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:06.224625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:06.228167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:06.275138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66c50ec2-8853-4f32-81ea-1173411e3cdb None None] MFA Rules not processed for user `7f4bc39c602f4354985ffc2d648b2be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:06.277292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66c50ec2-8853-4f32-81ea-1173411e3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:06.346804 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:06.661671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085af90-fb10-448b-8b6b-ea87c3cf5658 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:06.683594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:06.684304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:06.684555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:06.685018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] PATH_INFO: `/v3/projects/36091b4b36964aa0948bd541b96f58df` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:06.687521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36091b4b36964aa0948bd541b96f58df)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:06.689800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:06.696575 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 956/1887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:06.801765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:06.802619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:06.803239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:06.806808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 957/1888] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:01:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:01:06.814842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36091b4b36964aa0948bd541b96f58df', 'request_id': 'req-d58fb185-7b1c-4e97-942d-770e3eddabf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:06.821460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:01:06.824596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36091b4b36964aa0948bd541b96f58df', 'request_id': 'req-d58fb185-7b1c-4e97-942d-770e3eddabf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:06.826119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:06.843459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36091b4b36964aa0948bd541b96f58df', 'request_id': 'req-d58fb185-7b1c-4e97-942d-770e3eddabf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:06.875607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] The token cache is being invalidate because project 36091b4b36964aa0948bd541b96f58df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:06.875931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:06.877313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d58fb185-7b1c-4e97-942d-770e3eddabf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:06.887736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 932/1889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:06 2022] DELETE /identity/v3/projects/36091b4b36964aa0948bd541b96f58df => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:06.889756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:06.890047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:06.890325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:06.932946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:06.934269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.009515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.010922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.037166 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:07.097767 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 933/1890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:07.097767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.097767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.138537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ca74a-2f2c-4946-89d7-301351726196 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.151141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.151793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.152077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.152350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.153202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c352-dad4-47b8-91df-15ae48963b6b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.160204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.167217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.167895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.168273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.168445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.169966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.172124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d368148-5a90-4177-99a9-9964180fa698 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.174191 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 958/1891] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:01:06 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:07.192980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.193294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.193584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.261711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:07.262982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.286157 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 959/1892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:07.291143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.310176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d51d-31ba-445b-afe7-0084d86c3e55 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.322939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.323567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.323857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.324173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.324852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:07.325489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.326845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.328789 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:07.360085 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 960/1893] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:07.367002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.376550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.386019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251e26-f18e-45de-95f0-b6d8ddf256a6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.392562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.395355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.396245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.396730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.397191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.398127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.404540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4ce4d-7324-47a1-b49f-bddb1e69965d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.436694 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 934/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:07.461747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 961/1895] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:07 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:07.467566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.486232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d069-ae5b-4a2b-ac47-23f2c1fd1656 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.622554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.623040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.623426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.625393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 962/1896] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:01:07.641642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.642148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:01:07.654961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.655920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.656859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.658671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.662578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.722621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 935/1897] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:07 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:07.728658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.746346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4afd-303e-44ca-8c59-ec1b270ffaf1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.765176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.765596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.765874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.767322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.767322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.768415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.784001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 936/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:07.794843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.811072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d6179-c1d7-4f1c-8cf1-fdfb67e83e8d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.821580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.823362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.823645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.823983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.825680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.829792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:07.847920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.852678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.855745 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 937/1899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:07.856681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:07.858543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:07.874746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397731-ba86-456d-83d8-aaa88e633538 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:07.889440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:07.890067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:07.890560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:07.890669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] PATH_INFO: `/v3/users/3d9611c77204433387444c04c1f1401c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:07.895887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9611c77204433387444c04c1f1401c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:07.896287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:08.036384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c20d-166d-4c90-86b1-393e43cb2931 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:08.041646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9611c77204433387444c04c1f1401c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:08.042844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9611c77204433387444c04c1f1401c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:08.054827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:08.056355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.057013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.057719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.065164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:08.070428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9611c77204433387444c04c1f1401c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:08.079362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:08.083813 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 963/1900] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:01:07 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:01:08.085542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:08.088095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.091772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9611c77204433387444c04c1f1401c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:08.094206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841775f3-7ed5-440b-9118-fb4ce0bc9b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9611c77204433387444c04c1f1401c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:08.115354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ebe3a-1459-4b8a-b629-5506dec5bc92 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:08.124537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:08.126108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.126453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.126739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] PATH_INFO: `/v3/projects/66b3353b3fbc4f97a0387a6c40e4fb15/users/2eddf0cd4fb54de2ab7f26843380a1be/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.138182 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 938/1901] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:07 2022] DELETE /identity/v3/users/3d9611c77204433387444c04c1f1401c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:08.140668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1abc4-9157-4a36-b43f-98c64aa94a46 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.140957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1abc4-9157-4a36-b43f-98c64aa94a46 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.141231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1abc4-9157-4a36-b43f-98c64aa94a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.173154 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:08.183496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f3a1abc4-9157-4a36-b43f-98c64aa94a46 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:08.185117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3a1abc4-9157-4a36-b43f-98c64aa94a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.190116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3353b3fbc4f97a0387a6c40e4fb15, user_id=2eddf0cd4fb54de2ab7f26843380a1be, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:08.195092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd9b1-b908-472d-8170-65f5cf571bf4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:08.211208 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:08.241523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 964/1902] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:08 2022] PUT /identity/v3/projects/66b3353b3fbc4f97a0387a6c40e4fb15/users/2eddf0cd4fb54de2ab7f26843380a1be/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:08.257747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.258944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.260167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.352062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 939/1903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:08.359192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.359442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.359822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.361640 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 940/1904] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:01:08.362812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] MFA Rules not processed for user `2eddf0cd4fb54de2ab7f26843380a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:08.365093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.373546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:01:08.378158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.515933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:08.521162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.611124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 965/1905] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:08.614580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:08.619410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:08.683457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b2f3-f73e-4a79-92ba-3daa45f22e8b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:08.696244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:08.698339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.699211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.699211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.701037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:08.703032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:08.718569 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 941/1906] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:01:08 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:01:08.719620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:08.805507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562de07-eec5-422b-b8f1-84549a2f3c88 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:08.825664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:08.832467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.832467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.833505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.923830 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:08.940244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d330-5bdf-40bf-9a15-1116a71bb79a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:08.961171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:08.962322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:08.962435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:08.963794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:08.967266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:08.969775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.052968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.053791 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 942/1907] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:09.054918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.070763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143cf70-cbd8-42dc-a450-2efd25f42db5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.074563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:09.108478 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 966/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:09.109844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.110135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.110409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.177989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] MFA Rules not processed for user `eb6c7e141ee847598b81de2821521ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:09.179431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:09.187327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aead5-3a8c-41f4-90c0-b0e208aa12a2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.196625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:09.197291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.197598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.198017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] PATH_INFO: `/v3/users/5c32e71622fa41fbaa80b08c047b8b33` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.199296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c32e71622fa41fbaa80b08c047b8b33)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.202573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.240183 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:09.313730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c32e71622fa41fbaa80b08c047b8b33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:09.315085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c32e71622fa41fbaa80b08c047b8b33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:09.330555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c32e71622fa41fbaa80b08c047b8b33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:09.332649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 967/1909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:09.340538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.343171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:09.354035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c32e71622fa41fbaa80b08c047b8b33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:09.356091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f41683f0-0d54-49a6-9c77-517ef5687919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c32e71622fa41fbaa80b08c047b8b33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:09.390973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52346e2-2258-4351-a053-3eaf866f15d8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.393678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 943/1910] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:09 2022] DELETE /identity/v3/users/5c32e71622fa41fbaa80b08c047b8b33 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:09.395603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.396234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.396755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.508146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:09.509616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:09.638445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:09.641007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.641300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.641606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.642267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.644317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.646267 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 944/1911] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:09.672403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.674102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:09.677998 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 968/1912] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:09 2022] POST /identity/v3/users => generated 295 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:09.683399 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:09.686103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.702141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea327-534a-4e07-9c6b-8a1134f96c96 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.731157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:09.732332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.732770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.733238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.734520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.736439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.750936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 969/1913] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:09.756769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.770185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c92a5-7978-4b7b-a0df-9ff60daca86e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.779298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:09.780613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.781086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.781717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] PATH_INFO: `/v3/projects/f14704bcf9e547a88595a26c70a98a00/users/46e97397fc0d4e9e980eb3138ae9b872/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.787302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828b138-d279-4c97-8d31-93ea34d5aa3a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.792310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:09.793102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.793487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.793834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:09.808684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.810606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.823773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 945/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:09.826933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14704bcf9e547a88595a26c70a98a00, user_id=46e97397fc0d4e9e980eb3138ae9b872, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:09.835140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cef00-bcad-4669-94a2-52c194025d8f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:09.869931 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 970/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:09 2022] PUT /identity/v3/projects/f14704bcf9e547a88595a26c70a98a00/users/46e97397fc0d4e9e980eb3138ae9b872/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:09.875219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:09.895454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d5ca-8afc-4f70-9e5a-0985e94c3610 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:09.955182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b5a1-3885-41ee-ac30-76643e6829ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:09.955616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b5a1-3885-41ee-ac30-76643e6829ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:09.955997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b5a1-3885-41ee-ac30-76643e6829ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.026562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5bb7b5a1-3885-41ee-ac30-76643e6829ad None None] MFA Rules not processed for user `d467ea16905d40ce8b4121b21942bf7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:10.038965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5bb7b5a1-3885-41ee-ac30-76643e6829ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.048938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:10.049666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.049947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.050227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.050979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:10.052705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:10.070402 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 946/1916] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:10.077474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:10.109841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4a55-4873-41ad-a466-f95d17d4b285 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:10.132134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:10.133005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.133280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.133580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] PATH_INFO: `/v3/projects/f14704bcf9e547a88595a26c70a98a00/users/46e97397fc0d4e9e980eb3138ae9b872/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.141335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14704bcf9e547a88595a26c70a98a00, user_id=46e97397fc0d4e9e980eb3138ae9b872, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:10.149666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:10.192541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 947/1917] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:10 2022] PUT /identity/v3/projects/f14704bcf9e547a88595a26c70a98a00/users/46e97397fc0d4e9e980eb3138ae9b872/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:10.192541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:10.197864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.226599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 971/1918] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:10.228130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.228422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.228699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.334483 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:10.347724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] MFA Rules not processed for user `46e97397fc0d4e9e980eb3138ae9b872`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:10.354050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.443888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a7b9-46ab-4d8d-b5b1-e1010b22ea80 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:10.461659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:10.462451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.464268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.464651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] PATH_INFO: `/v3/projects/5d97e6749ea8470788e7c39a19e8e915` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.468400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d97e6749ea8470788e7c39a19e8e915)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:10.475064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:10.554143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 972/1919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:10.564119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:10.564234 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:10.564327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.599031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d97e6749ea8470788e7c39a19e8e915', 'request_id': 'req-17929bbb-d7da-450d-9b53-07d81fc896c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.611515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d97e6749ea8470788e7c39a19e8e915', 'request_id': 'req-17929bbb-d7da-450d-9b53-07d81fc896c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.621555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d97e6749ea8470788e7c39a19e8e915', 'request_id': 'req-17929bbb-d7da-450d-9b53-07d81fc896c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.667615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] The token cache is being invalidate because project 5d97e6749ea8470788e7c39a19e8e915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:10.669115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.671173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.680570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 948/1920] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:10 2022] DELETE /identity/v3/projects/5d97e6749ea8470788e7c39a19e8e915 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:10.681351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:10.683969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.691869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49c487-d3ae-4157-99cb-d22145f0f505 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:10.786367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:10.787080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.787455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.787811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.792296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.807416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929bbb-d7da-450d-9b53-07d81fc896c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:10.815809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:10.816736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.817915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.818495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] PATH_INFO: `/v3/projects/d32c3a547947439aa0ce955a10cc05c7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.820095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32c3a547947439aa0ce955a10cc05c7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:10.822808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:10.845266 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:10.883911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:10.885791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e06f-dec9-487a-90fe-dd90b31272ae service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:10.891760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32c3a547947439aa0ce955a10cc05c7', 'request_id': 'req-27b5e3ab-43e2-4ab8-87f9-adf678002648'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.900809 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 973/1921] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:10.902546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e8bf-0de4-44fb-8b83-7685f3983073 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:10.902896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e8bf-0de4-44fb-8b83-7685f3983073 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:10.903182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e8bf-0de4-44fb-8b83-7685f3983073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:10.904149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32c3a547947439aa0ce955a10cc05c7', 'request_id': 'req-27b5e3ab-43e2-4ab8-87f9-adf678002648'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.924359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32c3a547947439aa0ce955a10cc05c7', 'request_id': 'req-27b5e3ab-43e2-4ab8-87f9-adf678002648'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.940058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0477e8bf-0de4-44fb-8b83-7685f3983073 None None] MFA Rules not processed for user `2eddf0cd4fb54de2ab7f26843380a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:10.941773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0477e8bf-0de4-44fb-8b83-7685f3983073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:10.949673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] The token cache is being invalidate because project d32c3a547947439aa0ce955a10cc05c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:10.949906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.952109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:10.955516 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 949/1922] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:10 2022] DELETE /identity/v3/projects/d32c3a547947439aa0ce955a10cc05c7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:10.957353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:10.959855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.023574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 974/1923] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:11.025314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:11.025800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:11.026086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:11.027530 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 975/1924] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:01:11.028311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:11.030345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.059621 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:11.084762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5e3ab-43e2-4ab8-87f9-adf678002648 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:11.094474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:11.096292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:11.097109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:11.097479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] PATH_INFO: `/v3/users/c7ca82f19d8e475a93fd6947d77b3496` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:11.099627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ca82f19d8e475a93fd6947d77b3496)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:11.101880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:11.109834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1f6e3-828e-470a-8df0-c3bbc66b8b92 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:11.115117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:11.115432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:11.115760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:11.116040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] PATH_INFO: `/v3/users/7f4bc39c602f4354985ffc2d648b2be2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:11.118513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4bc39c602f4354985ffc2d648b2be2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:11.120813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:11.184033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4bc39c602f4354985ffc2d648b2be2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.188328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ca82f19d8e475a93fd6947d77b3496'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.190320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ca82f19d8e475a93fd6947d77b3496'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.198668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4bc39c602f4354985ffc2d648b2be2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.206044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ca82f19d8e475a93fd6947d77b3496'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.228910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4bc39c602f4354985ffc2d648b2be2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.230150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4bc39c602f4354985ffc2d648b2be2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.230903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4bc39c602f4354985ffc2d648b2be2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.233159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ca82f19d8e475a93fd6947d77b3496'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.234860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ca82f19d8e475a93fd6947d77b3496'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:11.252640 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:11.273551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 976/1925] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:11 2022] DELETE /identity/v3/users/7f4bc39c602f4354985ffc2d648b2be2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:11.286633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 950/1926] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:10 2022] DELETE /identity/v3/users/c7ca82f19d8e475a93fd6947d77b3496 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:11.288524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:01:11.294682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.314110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:11.315749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.496938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:11.502629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.531306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51cc3b-7366-490f-b61d-74553ecc9c60 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:11.561224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:11.564077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:11.564634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:11.579978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:11.598403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.710734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d16ea-898d-4f0e-a1dc-46090ef04594 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:11.723041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226426223f7d44bf85d4ab69c470027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02e67780d06642c58b4caeacb15b6d4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:11.724416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:11.725100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:11.726388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:11.728438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorizing `identity:get_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:11.733191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:11.738346 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 951/1927] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:01:11 2022] GET /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 381 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:11.791637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:11.794683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:11.812191 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:11.851393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:11.864906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:11.912629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 977/1928] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:12.043587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.066394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647897-9976-42eb-b08f-8592da3f2968 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.067831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d22a6-f7ba-4686-afe9-f56154da3ef5 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.076848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.078213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.079079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.079509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.079984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.080398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.080654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.081247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] PATH_INFO: `/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.083506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8799ca69ff7e4bc2b69a4ac8542c82f5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.084273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.089153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.183067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8799ca69ff7e4bc2b69a4ac8542c82f5', 'request_id': 'req-8f6bb5a2-05cb-435c-b588-899a6239b768'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.194961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8799ca69ff7e4bc2b69a4ac8542c82f5', 'request_id': 'req-8f6bb5a2-05cb-435c-b588-899a6239b768'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.213655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8799ca69ff7e4bc2b69a4ac8542c82f5', 'request_id': 'req-8f6bb5a2-05cb-435c-b588-899a6239b768'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.226840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.228998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96f88-e706-4da5-ada4-bc3cf6582eb1 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.235303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] The token cache is being invalidate because project 8799ca69ff7e4bc2b69a4ac8542c82f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:12.235712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.238807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.242802 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 952/1929] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:11 2022] DELETE /identity/v3/projects/8799ca69ff7e4bc2b69a4ac8542c82f5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:12.243892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.245463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.247070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 978/1930] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:12.248580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3d20-cfbf-4c0d-a1f6-7312ad865b50 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.249022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3d20-cfbf-4c0d-a1f6-7312ad865b50 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.249610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3d20-cfbf-4c0d-a1f6-7312ad865b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.274656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-92dc3d20-cfbf-4c0d-a1f6-7312ad865b50 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:12.278212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92dc3d20-cfbf-4c0d-a1f6-7312ad865b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.352474 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:12.390933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bb5a2-05cb-435c-b588-899a6239b768 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.399571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.400865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.400865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.400865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] PATH_INFO: `/v3/projects/d5e8b70f69264b329841d6b11285e6ec` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.401937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e8b70f69264b329841d6b11285e6ec)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.404046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.436979 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 979/1931] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:12.446110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.446526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.446876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.463007 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:12.474264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e8b70f69264b329841d6b11285e6ec', 'request_id': 'req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.479591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:12.481306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.487066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e8b70f69264b329841d6b11285e6ec', 'request_id': 'req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.498005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e8b70f69264b329841d6b11285e6ec', 'request_id': 'req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.524279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] The token cache is being invalidate because project d5e8b70f69264b329841d6b11285e6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:12.525450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.527063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb188b91-1584-4f9c-adc6-fd36f6b4f81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:12.529463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 953/1932] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:12 2022] DELETE /identity/v3/projects/d5e8b70f69264b329841d6b11285e6ec => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:12.536424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d40b6-5166-4d09-aeff-51d60d8769ed None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.538509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d40b6-5166-4d09-aeff-51d60d8769ed None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.539253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d40b6-5166-4d09-aeff-51d60d8769ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.575197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0d0d40b6-5166-4d09-aeff-51d60d8769ed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:12.577133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0d0d40b6-5166-4d09-aeff-51d60d8769ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.584929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 980/1933] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:12.589595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.593197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 954/1934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:12.596116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.596406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.596683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.610994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ed38d-38c4-4942-997c-b45b2023b3ed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.620078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:12.621511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:12.623752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.626051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.626818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.628213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.630351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:12.631301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.636075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 955/1935] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:12.636701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.637715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.651556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529819c2-e6a9-41a2-930c-a122e675de0b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.660855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.661537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.661878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.662154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.662824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:12.663670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.665347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.666477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 981/1936] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:01:12.671708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.691577 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 956/1937] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:12.692014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.699484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3138-c515-462e-b002-861fd7addfd2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.705198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f585-7968-40e0-bc41-9883a23a3849 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.712574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.715167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.715167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.715167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.715167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.717853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.721770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.722407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.722712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.722984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.723891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.726247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:12.780401 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 957/1938] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:12.780887 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 982/1939] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:12.790591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.790790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:12.939462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d97b7-3300-4831-a9b7-e3b5e5194f2d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.968711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecfff3-5388-4992-8a10-5ca902ee6b46 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:12.975005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:12.975892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:12.976647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:12.977049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:12.977921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:12.982367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.024755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 983/1940] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:13.026151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.028183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.046600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41ac2-727e-4338-95ec-44693baf134b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.060721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.061782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.062091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.062373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] PATH_INFO: `/v3/users/eb6c7e141ee847598b81de2821521ee2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.063839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6c7e141ee847598b81de2821521ee2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.064674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.066040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.066392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.067339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.067681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.068773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.071189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.107476 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:13.117161 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 958/1941] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:12 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:13.117161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.133279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a717cd-55fb-4880-8e6e-5d97663b1575 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.142168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.142568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.142915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.143597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.144515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.146356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf3fee-47ec-42cf-a568-2db10d537cd5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.164783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 959/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:13.165907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6c7e141ee847598b81de2821521ee2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:13.166169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.166457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.166732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.177157 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:13.186890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6c7e141ee847598b81de2821521ee2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:13.204068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] MFA Rules not processed for user `2eddf0cd4fb54de2ab7f26843380a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:13.206448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.233616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6c7e141ee847598b81de2821521ee2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:13.235972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6c7e141ee847598b81de2821521ee2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:13.237818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6c7e141ee847598b81de2821521ee2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:13.277922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 984/1943] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:13 2022] DELETE /identity/v3/users/eb6c7e141ee847598b81de2821521ee2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:13.280344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.289581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.319007 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 960/1944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:13.320920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.322570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.367730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a252-d61b-4189-ab58-f0c667d0dfa7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.461396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a973bf6-80f1-44e1-90b3-a10ebcee55ea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.475192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.476489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.476773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.477051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.478461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.482580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb1a8-c079-42b1-9838-65c0830d5ce4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.507848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 985/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:13.512480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.512789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.515363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.555611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:13.565303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.580164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 986/1946] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:13.581184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.601457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5f61-79c8-4d44-bc08-c830bc28bb07 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.615901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.617108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.617413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.617697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.618414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.618751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.620390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.620685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.621467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.621943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.628089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.634912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.651368 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 987/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:13.655589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 961/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:13.655589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.656780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.659055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:13.679566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb6a3d-5665-4b49-a41f-0ca64fffb4c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.691974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.692745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.693030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.693325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] PATH_INFO: `/v3/projects/c397d557139743a4acd2953a2a4f2580/users/b1a775dc8cf847d49ad2f839e7d73a6c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.721471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c397d557139743a4acd2953a2a4f2580, user_id=b1a775dc8cf847d49ad2f839e7d73a6c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.724480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.746654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 962/1949] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:13 2022] PUT /identity/v3/projects/c397d557139743a4acd2953a2a4f2580/users/b1a775dc8cf847d49ad2f839e7d73a6c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:13.747976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:13.755078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693dfb1-a72b-4e9d-bbd2-a86f98a9d993 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.851673 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:13.912459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.913726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.914229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.914522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.921028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e485cf-8478-4f22-bd43-b207907c2c74 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:13.926768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:13.929330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a244-82ac-4721-ba68-ef2743f7cdd6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:13.944517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:13.945328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 988/1950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:13.947883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.948528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.949134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.958045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:13.958561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:13.966075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] PATH_INFO: `/v3/projects/690bc212bdcd4840870904941ab1a13f/users/7cf6078c31ca4f4ca840983e1b8b16e9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:13.993357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] MFA Rules not processed for user `b1a775dc8cf847d49ad2f839e7d73a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:13.997686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:14.041144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=690bc212bdcd4840870904941ab1a13f, user_id=7cf6078c31ca4f4ca840983e1b8b16e9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:14.055114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090aa6-1922-4bf5-9330-305f11de296b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:14.084142 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 963/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:13 2022] PUT /identity/v3/projects/690bc212bdcd4840870904941ab1a13f/users/7cf6078c31ca4f4ca840983e1b8b16e9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:14.095937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:14.096282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:14.096530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:14.120323 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:14.233397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] MFA Rules not processed for user `7cf6078c31ca4f4ca840983e1b8b16e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:14.235856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:14.279758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 989/1952] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:14.286102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:14.317697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00670-939b-4e5a-8f96-48c7c4342281 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:14.424544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:14.425394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:14.425672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:14.426092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:14.427938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:14.429750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:14.459499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 964/1953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:14.466195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:14.485093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 990/1954] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:14 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:01:14.488821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:14.497147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcb243-cc8e-4caa-9ac8-67cfd883a2b9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:14.628277 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:14.699138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781524-cf9d-47e8-98cb-6a730d36c546 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:14.702637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:14.703283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:14.703565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:14.703855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:14.704473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:14.713654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:14.740406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:14.743460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:14.744388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:14.744714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:14.745334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:14.751846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:14.810915 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 991/1955] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:14 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:14.812024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:14.815848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:14.830945 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 965/1956] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:14 2022] POST /identity/v3/projects => generated 383 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:14.833201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:14.847651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc2803-863c-4375-a53b-476c18ae8d65 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.012362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1a80-e5af-4a1e-aae6-13b2a47fed90 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.016886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.018775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.019338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.019838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] PATH_INFO: `/v3/projects/3376ef868ee24293bb5d11ce59505667` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.022640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3376ef868ee24293bb5d11ce59505667)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.025100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.028995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.029667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.030003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.030331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.030999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.035885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.057467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 966/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:15.057467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.068546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092026c-cc9a-402b-ab0d-c987bc16d2a4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.094284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.095631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.095920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.097359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.098321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.101325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.123733 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:15.124171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3376ef868ee24293bb5d11ce59505667', 'request_id': 'req-7ca4e359-7c88-4b45-8fbc-081990a7ada6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.144927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3376ef868ee24293bb5d11ce59505667', 'request_id': 'req-7ca4e359-7c88-4b45-8fbc-081990a7ada6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.146880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 967/1958] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:15 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:15.149026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.159999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3376ef868ee24293bb5d11ce59505667', 'request_id': 'req-7ca4e359-7c88-4b45-8fbc-081990a7ada6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.181200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ffc2b-8d7f-4521-86c8-2eaeb123b4f8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.185360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] The token cache is being invalidate because project 3376ef868ee24293bb5d11ce59505667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:15.185669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.189597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.194929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 992/1959] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:14 2022] DELETE /identity/v3/projects/3376ef868ee24293bb5d11ce59505667 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:15.194929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.195883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:15.349520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e359-7c88-4b45-8fbc-081990a7ada6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.365785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.366982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.367265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.367540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.368280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.369936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.381119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.402334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.403308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 993/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:15.403782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.405516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.410682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:15.410828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] PATH_INFO: `/v3/projects/7458a233fead489c98113f8bda5056aa/users/54074b03ef5a46cba0c2cfbcf27ce059/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.434602 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:15.445499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e86b-2fe9-4644-8a58-b293c3736abf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.464156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.465356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.466214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.466819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] PATH_INFO: `/v3/users/226426223f7d44bf85d4ab69c470027f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.468818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=226426223f7d44bf85d4ab69c470027f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.472967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.487931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458a233fead489c98113f8bda5056aa, user_id=54074b03ef5a46cba0c2cfbcf27ce059, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.495738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a80cc-5f3d-4915-8a36-83273e76eb84 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.555186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 968/1961] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:15 2022] PUT /identity/v3/projects/7458a233fead489c98113f8bda5056aa/users/54074b03ef5a46cba0c2cfbcf27ce059/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:15.557315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e32-88b3-4af4-8888-37bd50f38f0a None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.562662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e32-88b3-4af4-8888-37bd50f38f0a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.562662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e32-88b3-4af4-8888-37bd50f38f0a None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.564636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 969/1962] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:01:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:01:15.566527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4e32-88b3-4af4-8888-37bd50f38f0a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.595104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226426223f7d44bf85d4ab69c470027f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.604460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226426223f7d44bf85d4ab69c470027f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.641159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226426223f7d44bf85d4ab69c470027f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.642565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226426223f7d44bf85d4ab69c470027f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.644565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226426223f7d44bf85d4ab69c470027f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:15.669251 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 994/1963] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:15 2022] DELETE /identity/v3/users/226426223f7d44bf85d4ab69c470027f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:15.670642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.673600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:15.694801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4e32-88b3-4af4-8888-37bd50f38f0a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.828592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.832193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.832402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.832689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] PATH_INFO: `/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248/users/b7ce8d7ba17145428673640ed43aa362/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.834040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfc1b-0b4a-4d80-a66d-dab02aa79ae8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:15.849012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:15.849833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.850448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.850708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.852707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.855969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507f894-1a0d-4dc8-a34a-9e37dd3b770b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.875472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7dc7c0e1e41e5ab4643b41a291248, user_id=b7ce8d7ba17145428673640ed43aa362, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:15.891751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:15.894881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 995/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:15.896205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:15.896553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:15.896829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:15.924246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:15.925852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:15.936063 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 970/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:15 2022] PUT /identity/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248/users/b7ce8d7ba17145428673640ed43aa362/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:15.938904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:15.962454 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:16.124476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f4a8b-4d6a-43d9-8e18-adfd3054cae8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:16.152807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:16.153732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.154117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.154604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] PATH_INFO: `/v3/projects/7458a233fead489c98113f8bda5056aa/users/54074b03ef5a46cba0c2cfbcf27ce059/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.158456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 996/1966] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:16.159308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:16.159428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458a233fead489c98113f8bda5056aa, user_id=54074b03ef5a46cba0c2cfbcf27ce059, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:16.161331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:16.166683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44300fc4-a866-4c0c-9981-045e6f741950 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:16.185097 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:16.194143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8000524-4cf5-4954-a03f-8ab59915f13f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:16.206384 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 971/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:15 2022] PUT /identity/v3/projects/7458a233fead489c98113f8bda5056aa/users/54074b03ef5a46cba0c2cfbcf27ce059/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:16.208136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.208534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.208914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.275960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] MFA Rules not processed for user `54074b03ef5a46cba0c2cfbcf27ce059`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:16.277539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:16.442274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:16.443659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.445251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.445748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.450451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:16.459321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:16.513153 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 997/1968] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:16.514619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:16.517833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:16.561233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 972/1969] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:16.561233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:16.609129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea162f-397b-409f-80f7-a84ed20cce18 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:16.619717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:16.620570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.621041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.621571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] PATH_INFO: `/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248/users/b7ce8d7ba17145428673640ed43aa362/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.633896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7dc7c0e1e41e5ab4643b41a291248, user_id=b7ce8d7ba17145428673640ed43aa362, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:16.636811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7c43f-c3e4-4a3a-a32d-8c54c47b35be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:16.672100 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 973/1970] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:16 2022] PUT /identity/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248/users/b7ce8d7ba17145428673640ed43aa362/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:16.673879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.674231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.674580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.747581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] MFA Rules not processed for user `b7ce8d7ba17145428673640ed43aa362`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:16.751106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:16.774978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd16bb-6454-4c56-98ee-becf81cc40c3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:16.891452 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:16.898899 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 974/1971] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:16.972481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:16.973119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:16.973119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:16.973119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:16.988524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:16.990708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38158d-37dc-4ed6-a3d0-6f2e51336490 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:17.017968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 998/1972] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:17.078848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:17.081303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:17.082343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:17.084000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:17.105736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5cd1e-a93c-4175-8e84-a14a7bb81aa1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:17.118505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] MFA Rules not processed for user `98ed412afded46c49d993a2749e42c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:17.122400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:17.130597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:17.131271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:17.131723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:17.133044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:17.184001 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:17.284662 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 999/1973] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:17.288737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:17.293278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:17.303265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:17.308776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:17.332372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa282-c11a-4dd7-ab39-de03aabaa0da None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:17.336820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 975/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:17.341641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:17.342381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:17.342738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:17.343085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:17.353605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:17.355351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216f5c0-fdb0-4788-b649-a0632cb86fec service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:17.374555 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1000/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:17.876914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:17.878404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.021586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785044b4-d5a9-4e9a-8452-0dde20bd4e57 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.026104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.026781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.027066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.027342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] PATH_INFO: `/v3/projects/02e67780d06642c58b4caeacb15b6d4a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.028601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e67780d06642c58b4caeacb15b6d4a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.031060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.159879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e67780d06642c58b4caeacb15b6d4a', 'request_id': 'req-88cc90a9-409d-4102-b878-af944ed73e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:18.181757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e67780d06642c58b4caeacb15b6d4a', 'request_id': 'req-88cc90a9-409d-4102-b878-af944ed73e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:18.196204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e67780d06642c58b4caeacb15b6d4a', 'request_id': 'req-88cc90a9-409d-4102-b878-af944ed73e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:18.216014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] The token cache is being invalidate because project 02e67780d06642c58b4caeacb15b6d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:18.222493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:18.223357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:18.229452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 976/1976] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:17 2022] DELETE /identity/v3/projects/02e67780d06642c58b4caeacb15b6d4a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:18.233656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc4f79-6a0c-4805-afb1-218f91871fea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.234236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc4f79-6a0c-4805-afb1-218f91871fea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.234315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc4f79-6a0c-4805-afb1-218f91871fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.266241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a1dc4f79-6a0c-4805-afb1-218f91871fea None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:18.268224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1dc4f79-6a0c-4805-afb1-218f91871fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.350350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.352366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.401798 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:18.436100 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1001/1977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:18.444736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.445185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.445616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.499068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:18.500298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.505281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc90a9-409d-4102-b878-af944ed73e5f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.511237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1002/1978] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:18.515505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.522052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.522799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.523650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.523650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.527755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdfe3f-18b9-4d3f-a5f6-9b3ba06da654 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.528549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.533393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.534914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.535361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.535786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.537169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:18.537660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.539965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.554378 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1003/1979] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:01:18.559812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.593445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57da66-490f-472c-b82f-5c5f3a897bff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.603502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.604208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.604504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.604770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.605509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.607486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.686532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1004/1980] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:18 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:18.689822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.691627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.693371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.732663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 977/1981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:18.802953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.805341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:18.820240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293732-f8a3-4efa-a254-1c9061ce05df service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.858833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a587-8aa4-49fa-ac0f-408a6f509c53 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.874497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.875890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.876272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.876782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.878926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.883956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.913995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.914719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.915032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.915382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] PATH_INFO: `/v3/users/7cf6078c31ca4f4ca840983e1b8b16e9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.916678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf6078c31ca4f4ca840983e1b8b16e9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.920119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.926794 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1005/1982] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:18 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:18.932225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:18.941188 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:18.947053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e3e0-11d5-47f2-a077-ad521c27c426 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:18.956764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:18.957698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:18.958244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:18.958622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:18.959496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:18.961877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:18.995154 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1006/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:19.000629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.016326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb74f7-78d0-435a-afff-3bd7f63dee01 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.024491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.024491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.024491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.024491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.025244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf6078c31ca4f4ca840983e1b8b16e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:19.027543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.027662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf6078c31ca4f4ca840983e1b8b16e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:19.027751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.036292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf6078c31ca4f4ca840983e1b8b16e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:19.043236 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1007/1984] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:19.044224 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:19.044367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.046348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:19.055265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf6078c31ca4f4ca840983e1b8b16e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:19.056100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f39d1b22-e5cd-4410-a510-c7886e30cefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf6078c31ca4f4ca840983e1b8b16e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:19.067962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbda08-b8e9-45e0-95ed-d76390efbad1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.078795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.080488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.081663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.082176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] PATH_INFO: `/v3/projects/7688235e54844aa4885b5b11b02bd716/users/54bb9e01043646d0bd8de49a0f5a5717/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.082964 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 978/1985] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:18 2022] DELETE /identity/v3/users/7cf6078c31ca4f4ca840983e1b8b16e9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:19.087963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a50f6-d9bf-462b-8530-f39bbab5af8d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.088276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a50f6-d9bf-462b-8530-f39bbab5af8d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.089564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a50f6-d9bf-462b-8530-f39bbab5af8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.114530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7688235e54844aa4885b5b11b02bd716, user_id=54bb9e01043646d0bd8de49a0f5a5717, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.120678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cddf51-cc00-4edb-862f-79c176b66a08 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.142021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e76a50f6-d9bf-462b-8530-f39bbab5af8d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:19.144657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e76a50f6-d9bf-462b-8530-f39bbab5af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:19.175795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1008/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:19 2022] PUT /identity/v3/projects/7688235e54844aa4885b5b11b02bd716/users/54bb9e01043646d0bd8de49a0f5a5717/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:19.194582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.195391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.196058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.266473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] MFA Rules not processed for user `54bb9e01043646d0bd8de49a0f5a5717`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:19.267826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:19.360971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 979/1987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:19.365686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.366200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.366591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.409861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:19.411681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:19.483321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1009/1988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:19.485018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.488736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:19.561797 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 980/1989] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:19.565508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.595901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7fc8-8a0a-4b72-ae05-5ae5de19c46f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.604793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.605630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.606027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.606398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.607349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.609605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.686766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daede3-402b-4066-bff9-c19b9cfa5425 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.698042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 981/1990] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:19 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:19.698042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.698357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.698357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.698357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.699286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.720716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.723277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.762434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1010/1991] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:19.762434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:19.775546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf700-1920-4537-a411-6dcf4d9a8f06 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.871314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246845-5e1a-43ac-a3fd-e9f4ed86b8f7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:19.883737 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:19.896032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.899523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.899921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.900491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.923259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.924626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:19.925795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:19.926147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.926579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:19.927257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:19.932348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:19.936944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:19.974607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 982/1992] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:19.996044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1011/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:19 2022] POST /identity/v3/users => generated 308 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:20.002731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:20.044464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155319a8-8e90-4870-970e-0b869b171a6b service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:20.060401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:20.062159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.062857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.063700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.065079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:20.068620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:20.082155 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:20.101551 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 983/1994] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:20.103507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:20.115175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e53b5-51e2-4861-a45d-96fa25fd9054 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:20.120661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:20.121450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.121755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.122002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] PATH_INFO: `/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072/users/bb679d9d32c441bbb114e13d3dd8f208/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.143078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f6cbbc798e4ba3be5ec506dcecc072, user_id=bb679d9d32c441bbb114e13d3dd8f208, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:20.146164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:20.165248 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1012/1995] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:20 2022] PUT /identity/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072/users/bb679d9d32c441bbb114e13d3dd8f208/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:20.170092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:20.190123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd6d5-78c6-45d0-92ac-8c9ae30c2f78 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:20.304925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:20.305931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.306400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.306829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.307722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:20.310931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2244c1-f2d3-4036-a6f3-35f45345423e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:20.325306 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 984/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:20.330253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:20.350346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed15bf-95b2-4ce2-a60a-d78df7c992ec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:20.358343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:20.359559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.359857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.360135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] PATH_INFO: `/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072/users/bb679d9d32c441bbb114e13d3dd8f208/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.362717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f6cbbc798e4ba3be5ec506dcecc072, user_id=bb679d9d32c441bbb114e13d3dd8f208, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:20.363290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3702-03e7-443f-8782-b791fecc71be None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.363865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3702-03e7-443f-8782-b791fecc71be None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.364478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f3702-03e7-443f-8782-b791fecc71be None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.367489 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 985/1997] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:01:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:01:20.367619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a196c-0ff5-45e5-bd1f-ebe35a0e1991 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:20.398871 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1013/1998] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:20 2022] PUT /identity/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072/users/bb679d9d32c441bbb114e13d3dd8f208/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:20.405051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.406467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.406960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:20.407756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:20.409280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.414308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:20.446081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:20.448274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:20.488578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] MFA Rules not processed for user `bb679d9d32c441bbb114e13d3dd8f208`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:20.490069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:20.630037 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1014/1999] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:20.631195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 986/2000] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:21.144902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:21.146695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:21.165448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9be82-44de-4ee9-82df-129d6a2b49ff None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:21.176105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:21.177443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:21.180109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:21.180702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:21.198029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:21.199576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:21.221877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:21.224462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:21.233488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f25b6-ac6e-46af-8dc8-93b6e929865d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:21.241119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:21.241944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:21.242237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:21.242651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:21.255371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:21.259194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:21.259481 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1015/2001] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:21.261122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:21.263520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:21.287038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 987/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:21.534234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac969-f785-4420-b2b0-a6f6db50365a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:21.540730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:21.541583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:21.541984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:21.542388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] PATH_INFO: `/v3/projects/690bc212bdcd4840870904941ab1a13f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:21.545218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690bc212bdcd4840870904941ab1a13f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:21.547694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:21.606277 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:21.729574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690bc212bdcd4840870904941ab1a13f', 'request_id': 'req-50d1a263-6233-425f-91ad-2c9f93e4d0d3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:21.745788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690bc212bdcd4840870904941ab1a13f', 'request_id': 'req-50d1a263-6233-425f-91ad-2c9f93e4d0d3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:21.758240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690bc212bdcd4840870904941ab1a13f', 'request_id': 'req-50d1a263-6233-425f-91ad-2c9f93e4d0d3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:21.789329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] The token cache is being invalidate because project 690bc212bdcd4840870904941ab1a13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:21.790019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:21.791208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:21.801187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:21.805504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1016/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:21 2022] DELETE /identity/v3/projects/690bc212bdcd4840870904941ab1a13f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:21.863978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e967b8-aa72-41bf-95eb-0d46aff990ef service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:21.942456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:21.944752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.044584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:22.045899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.046079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.046415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] PATH_INFO: `/v3/users/b7ce8d7ba17145428673640ed43aa362` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.048221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ce8d7ba17145428673640ed43aa362)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:22.050218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:22.065143 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:22.131121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a263-6233-425f-91ad-2c9f93e4d0d3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:22.140822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:22.142315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.142602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.142883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] PATH_INFO: `/v3/users/b1a775dc8cf847d49ad2f839e7d73a6c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.144462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a775dc8cf847d49ad2f839e7d73a6c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:22.146731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:22.165009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ce8d7ba17145428673640ed43aa362'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.166647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ce8d7ba17145428673640ed43aa362'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.190927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ce8d7ba17145428673640ed43aa362'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.222130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ce8d7ba17145428673640ed43aa362'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.223762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e45dbdb0-bd7e-4ce0-8b37-db6e9ef779c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ce8d7ba17145428673640ed43aa362'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.237483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a775dc8cf847d49ad2f839e7d73a6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.258360 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 988/2004] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:21 2022] DELETE /identity/v3/users/b7ce8d7ba17145428673640ed43aa362 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:22.271721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a775dc8cf847d49ad2f839e7d73a6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.324033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a775dc8cf847d49ad2f839e7d73a6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.326226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a775dc8cf847d49ad2f839e7d73a6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.328606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a775dc8cf847d49ad2f839e7d73a6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:22.363161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1017/2005] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:21 2022] DELETE /identity/v3/users/b1a775dc8cf847d49ad2f839e7d73a6c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:22.369498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.369786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.370062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.409301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:22.410858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.560218 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 989/2006] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:22.560386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:22.562526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.614810 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:22.665501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c1e3-eb8a-4573-9a3e-debbf602ce92 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:22.670564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:22.673358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.673662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.674048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.683278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:22.685997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.694978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:22.697718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:22.717787 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1018/2007] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:22.912705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f58663-4945-4fe5-94a8-364184f8158a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:22.913715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:22.915231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.925935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:22.927240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.928009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.929074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.934472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:22.937024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96390602-fdd6-4b43-9f71-caad98b4be66 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:22.942493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:22.943159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:22.943446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:22.943729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] PATH_INFO: `/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:22.946028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae7dc7c0e1e41e5ab4643b41a291248)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:22.948316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:22.995459 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:23.052985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae7dc7c0e1e41e5ab4643b41a291248', 'request_id': 'req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.079360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae7dc7c0e1e41e5ab4643b41a291248', 'request_id': 'req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.091331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.095172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:23.096364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae7dc7c0e1e41e5ab4643b41a291248', 'request_id': 'req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.131973 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 990/2008] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:23.185530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] The token cache is being invalidate because project 2ae7dc7c0e1e41e5ab4643b41a291248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:23.185530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.185530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fd33fdb-3a2f-46a5-91a7-85979a130d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.189151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:23.195760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1019/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:22 2022] DELETE /identity/v3/projects/2ae7dc7c0e1e41e5ab4643b41a291248 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:23.196858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.198404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4ffa-c3a9-4c6d-a1d3-718431a85e75 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.198879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4ffa-c3a9-4c6d-a1d3-718431a85e75 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.199356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4ffa-c3a9-4c6d-a1d3-718431a85e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.229021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650f6cb-c6b3-41c9-9c9c-e2af279033ac service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:23.290322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c8ab4ffa-c3a9-4c6d-a1d3-718431a85e75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:23.293138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8ab4ffa-c3a9-4c6d-a1d3-718431a85e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.397616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:23.399050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.399331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.399839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] PATH_INFO: `/v3/users/54bb9e01043646d0bd8de49a0f5a5717` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.401657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bb9e01043646d0bd8de49a0f5a5717)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.404418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:23.487703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1020/2010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:23.505841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.507227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.508289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.546224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bb9e01043646d0bd8de49a0f5a5717'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.548157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bb9e01043646d0bd8de49a0f5a5717'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.566199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bb9e01043646d0bd8de49a0f5a5717'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.585262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:23.591188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.594965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bb9e01043646d0bd8de49a0f5a5717'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.596341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bb9e01043646d0bd8de49a0f5a5717'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.613065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1021/2011] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:23.614743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:23.618676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.638463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777727e-af76-4017-b9ef-380d44ad1ff6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:23.645704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 991/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:23 2022] DELETE /identity/v3/users/54bb9e01043646d0bd8de49a0f5a5717 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:23.646800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:23.661328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:23.662555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.675034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.675034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] PATH_INFO: `/v3/projects/c397d557139743a4acd2953a2a4f2580` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.680784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c397d557139743a4acd2953a2a4f2580)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.685544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:23.710922 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:23.737779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6f8d-cce2-4d5a-9598-d3af892baea3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:23.754309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:23.754957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.755227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.755502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.756190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:23.756561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.759395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e976348-656a-45e8-806c-2fb03c3ab5f8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:23.778981 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 992/2013] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:23.780677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.780864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.781123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.805304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:23.806672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.812160 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:23.838446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c397d557139743a4acd2953a2a4f2580', 'request_id': 'req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.854473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c397d557139743a4acd2953a2a4f2580', 'request_id': 'req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.869228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c397d557139743a4acd2953a2a4f2580', 'request_id': 'req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.894816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] The token cache is being invalidate because project c397d557139743a4acd2953a2a4f2580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:23.895090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.895804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:23.901638 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1022/2014] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:23 2022] DELETE /identity/v3/projects/c397d557139743a4acd2953a2a4f2580 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:23.903894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:23.907379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.908417 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 993/2015] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:23.910011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:23.912394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:23.932656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba3451-6b4f-40ba-a161-c81c8fc3043f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:23.940115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:23.941299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.941858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.942397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] PATH_INFO: `/v3/users/54074b03ef5a46cba0c2cfbcf27ce059` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.944825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8552f9-c48d-4570-a8ac-13e7fa15efb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:23.945159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=54074b03ef5a46cba0c2cfbcf27ce059)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.947713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:23.955263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:23.956640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:23.957164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:23.957941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:23.959104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:23.963934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.030624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1023/2016] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:23 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:24.032401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.035554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.055536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54074b03ef5a46cba0c2cfbcf27ce059'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:24.056433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54074b03ef5a46cba0c2cfbcf27ce059'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:24.068785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54074b03ef5a46cba0c2cfbcf27ce059'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:24.090464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54074b03ef5a46cba0c2cfbcf27ce059'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:24.092067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54074b03ef5a46cba0c2cfbcf27ce059'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:24.134365 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 994/2017] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:23 2022] DELETE /identity/v3/users/54074b03ef5a46cba0c2cfbcf27ce059 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:24.135711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.142661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.177602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cdc91-250f-4c4d-9d5b-6b62064137e0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.291279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.292545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.293085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.294427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.297474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.450267 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:24.484534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.492341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.514661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e736b9b-b470-4662-8500-2242d7f63bcd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.529363 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1024/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:24.536364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.539599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.540716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.542095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.543682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.548179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.629268 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 995/2019] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:24 2022] POST /identity/v3/users => generated 295 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:24.634338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.648974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d17150-488a-45d5-992b-8641a008787d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.657574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.659328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.660270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.660998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.662501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.665166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.683768 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1025/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:24.688793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.721578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc1c0-ed09-46ba-833c-57a5eac6700d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.737206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.738311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.738747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.739180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.740190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.743899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ceb05-39c0-4562-aeea-917ee8d753d0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.769910 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 996/2021] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:24.771777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.792254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9a061-f2a8-457a-b06a-aabfae12a18a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:24.800604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:24.801460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.802033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.802608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] PATH_INFO: `/v3/projects/947078a0b0d444e68636195c31315fb7/users/1534110b9d464b72a7062fad6a67e884/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.807884 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:24.853302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=947078a0b0d444e68636195c31315fb7, user_id=1534110b9d464b72a7062fad6a67e884, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:24.858366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:24.889089 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1026/2022] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:24 2022] PUT /identity/v3/projects/947078a0b0d444e68636195c31315fb7/users/1534110b9d464b72a7062fad6a67e884/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:24.908530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:24.909348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:24.910207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:24.954757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:24.956796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:24.968169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] MFA Rules not processed for user `1534110b9d464b72a7062fad6a67e884`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:24.969815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.093668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598178c-ce88-4750-9aa5-73d29a20a5cc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.101323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.102299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.102736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.103945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] PATH_INFO: `/v3/projects/7458a233fead489c98113f8bda5056aa` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.105672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7458a233fead489c98113f8bda5056aa)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.107850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.132939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 997/2023] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:25.140589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.154861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785da80-a362-4a62-98ab-9a444783c5ea None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.164164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.165024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.167268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.169538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.171055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.184803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.210732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7458a233fead489c98113f8bda5056aa', 'request_id': 'req-8348b728-dffa-49ab-aef1-bd1e323a5683'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.219659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7458a233fead489c98113f8bda5056aa', 'request_id': 'req-8348b728-dffa-49ab-aef1-bd1e323a5683'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.246837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7458a233fead489c98113f8bda5056aa', 'request_id': 'req-8348b728-dffa-49ab-aef1-bd1e323a5683'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.261074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 998/2024] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:25 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:25.263040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.267588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.269546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] The token cache is being invalidate because project 7458a233fead489c98113f8bda5056aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:25.269877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.270664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.277443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1027/2025] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:24 2022] DELETE /identity/v3/projects/7458a233fead489c98113f8bda5056aa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:25.277443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.280826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.448112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b728-dffa-49ab-aef1-bd1e323a5683 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.483080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ffb27-670e-4f0d-99fd-efabf4c03ecc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.492683 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:25.495990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.497583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.497986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.498267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] PATH_INFO: `/v3/projects/7688235e54844aa4885b5b11b02bd716` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.501169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7688235e54844aa4885b5b11b02bd716)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.508558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.647130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.648153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.648408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.648659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.649892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.653072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ccf56-edde-4eca-bec2-35616d890daa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.670042 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:25.682978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7688235e54844aa4885b5b11b02bd716', 'request_id': 'req-66ddabb0-bb5f-47a5-b35e-dce6517048ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.693184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7688235e54844aa4885b5b11b02bd716', 'request_id': 'req-66ddabb0-bb5f-47a5-b35e-dce6517048ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.700338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1028/2026] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:25 2022] POST /identity/v3/users => generated 301 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:25.702705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.702996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.703524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.714675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7688235e54844aa4885b5b11b02bd716', 'request_id': 'req-66ddabb0-bb5f-47a5-b35e-dce6517048ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.734615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:25.737888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.748534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] The token cache is being invalidate because project 7688235e54844aa4885b5b11b02bd716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:25.748852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.749652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:25.751525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 999/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:25 2022] DELETE /identity/v3/projects/7688235e54844aa4885b5b11b02bd716 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:25.752127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.753701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.873594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddabb0-bb5f-47a5-b35e-dce6517048ab admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.882492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.883640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.884272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.884852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.886182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.889054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.905854 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1000/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:25.907883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.912867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:25.917023 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1029/2029] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:25.930775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:25.936217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95138d-acb2-4d71-9863-0e53053416c0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.942452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.943070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.943494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.943888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] PATH_INFO: `/v3/users/bb679d9d32c441bbb114e13d3dd8f208` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:25.946172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb679d9d32c441bbb114e13d3dd8f208)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:25.950119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:25.952084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3006bc-ac38-4e97-b8a6-a79605f848ef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:25.966386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:25.967170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:25.967461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:25.968624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] PATH_INFO: `/v3/projects/f45c94bb302c43b7aa75a762159c2185/users/769e7f1b122447a28db5a376a5c11793/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.012409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45c94bb302c43b7aa75a762159c2185, user_id=769e7f1b122447a28db5a376a5c11793, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.028336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542bf29-16f0-4bfa-b306-ba871a171ea8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.063779 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1030/2030] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:25 2022] PUT /identity/v3/projects/f45c94bb302c43b7aa75a762159c2185/users/769e7f1b122447a28db5a376a5c11793/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:26.064682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb679d9d32c441bbb114e13d3dd8f208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:26.068433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb679d9d32c441bbb114e13d3dd8f208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:26.070871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.071233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.071481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.092117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb679d9d32c441bbb114e13d3dd8f208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:26.139578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb679d9d32c441bbb114e13d3dd8f208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:26.142225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb679d9d32c441bbb114e13d3dd8f208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:26.144929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:26.151252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.194041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1001/2031] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:25 2022] DELETE /identity/v3/users/bb679d9d32c441bbb114e13d3dd8f208 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:26.195686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.203423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.295673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1031/2032] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:26.300057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.311174 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:26.321236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d577-d4b7-47f3-af1f-0601940fa74b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.391062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b2f2-b015-42c0-97bc-2027817e6596 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.397574 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:26.416495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.417689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.417689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.417920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.418568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.424887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.446949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1002/2033] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:26.448090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.463338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299735b-9292-4336-9023-ea8c9ef3655c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.471091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.472821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.473122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.473631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] PATH_INFO: `/v3/projects/f45c94bb302c43b7aa75a762159c2185/users/769e7f1b122447a28db5a376a5c11793/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.477288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45c94bb302c43b7aa75a762159c2185, user_id=769e7f1b122447a28db5a376a5c11793, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.481347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.483783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.485976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.487724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.488818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.490012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:26.490646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.493824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd3cb-0ee8-43ab-b2c5-0a976eb6cfdd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.514441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1003/2034] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:26 2022] PUT /identity/v3/projects/f45c94bb302c43b7aa75a762159c2185/users/769e7f1b122447a28db5a376a5c11793/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:26.518972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.521808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1032/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:01:26.528733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.530374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.531348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.590655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] MFA Rules not processed for user `769e7f1b122447a28db5a376a5c11793`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:26.593035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.690790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a830-5364-4df9-8e73-210115e05793 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.715211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.717514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.718094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.718736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.721666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:26.729170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:26.754115 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1033/2036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:26.779428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.782904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:26.855939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1004/2037] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:26.861846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:26.983592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887780-a33a-4a45-a15a-40db1787e7fd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.985243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92be10-5a47-42cb-99ce-28e4b39e3e2d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:26.996576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:26.997004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:26.997628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:26.998117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:26.999062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.002736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.034445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1005/2038] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:26 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:27.035502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.038598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:27.055081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cdb0d-70e3-4667-abfb-5644bc7070f5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.061238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.062136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.062420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.062847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] PATH_INFO: `/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.064289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f6cbbc798e4ba3be5ec506dcecc072)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.066451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.086102 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:27.118919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.119723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.120138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.120500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.131245 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:27.169213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f6cbbc798e4ba3be5ec506dcecc072', 'request_id': 'req-75517564-d6d2-45af-a95f-8fcbabe3814a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:27.179967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f6cbbc798e4ba3be5ec506dcecc072', 'request_id': 'req-75517564-d6d2-45af-a95f-8fcbabe3814a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:27.192764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f6cbbc798e4ba3be5ec506dcecc072', 'request_id': 'req-75517564-d6d2-45af-a95f-8fcbabe3814a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:27.249296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] The token cache is being invalidate because project e0f6cbbc798e4ba3be5ec506dcecc072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:27.250682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:27.266256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:27.269749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1006/2039] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:27 2022] DELETE /identity/v3/projects/e0f6cbbc798e4ba3be5ec506dcecc072 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:27.275618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.285352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:27.289745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.293305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371891a7-e99b-46f5-aabe-417f03354bab service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.321653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1034/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:27.324375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.324873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.325355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.364700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:27.373641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:27.474105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75517564-d6d2-45af-a95f-8fcbabe3814a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.484371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.485442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.485954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.486438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.487644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.492044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac76db-3819-4703-8410-cb64cd245f62 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.520929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1035/2041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:27.522414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1007/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:27.529544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.533288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.533972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.534599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.555372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eca120-73b8-49a8-be95-15b1b5b97bf6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.567534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.571306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.571833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.572203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.573141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.574905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.577425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:27.579007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:27.606966 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1008/2043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:27.607939 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1036/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:27.608864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.609586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.628725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3ca7e-949b-436d-bc49-d8d1919043a3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.634565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4009e-e70b-4428-999a-ed6c4c02c341 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.643701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.645157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.647825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.648463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.649074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.649453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] PATH_INFO: `/v3/projects/6b3e90256e814bb9ab1e25b7a1f6a30e/users/9c9e29782e034096a25a72eff7337607/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.651578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.651578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.653341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:27.653791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.656394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.687897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3e90256e814bb9ab1e25b7a1f6a30e, user_id=9c9e29782e034096a25a72eff7337607, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.698573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00bf7-c353-462b-9a81-1f7017785016 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:27.700087 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1037/2045] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:27.700516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:27.732505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce697da-09be-4674-ad7a-3ef285341bf5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:27.741798 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1009/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:27 2022] PUT /identity/v3/projects/6b3e90256e814bb9ab1e25b7a1f6a30e/users/9c9e29782e034096a25a72eff7337607/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:27.760857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.761338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.762061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.870518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] MFA Rules not processed for user `9c9e29782e034096a25a72eff7337607`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:27.872472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:27.919099 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:27.947873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:27.948051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:27.948284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:27.948872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:27.951031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:27.954038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.030274 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1010/2047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:28.036883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.054827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859c75-e815-4265-8467-6d89361ca88b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.061540 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1038/2048] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:27 2022] POST /identity/v3/projects => generated 377 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:28.066341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.066998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.067276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.067544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.068132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.068374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.072555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.088629 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:28.127233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1011/2049] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:28 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:28.128829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.218996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833a4f-4d8b-429c-aa63-3deb83d4dc6a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.269951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360e78-bc84-42a2-9816-72462624e578 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.294277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.295388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.295847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.296344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.297588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.301457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.307909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.308499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.308781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.309051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.309745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.312451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.343402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1039/2050] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:28 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:28.347729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.363713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63adb-2534-4171-8a6d-cbaa62880344 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.372458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.373240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.374487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.374487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.374929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.376903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.379608 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1012/2051] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:28 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:28.384333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.391719 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1040/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:28.399429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.413060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701d03-6f72-4d0b-9948-09a6f475f71b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.415203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b3f3-4e40-433a-8b25-a003b584fa5c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.423895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.424132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.424588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.424887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.425139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.426050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.426161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.426680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.427180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.427761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.428941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.432124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.445479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1041/2053] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:28.457502 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1013/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:28.457720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.460334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.474605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68fde-4b1e-468b-beba-ed64f0992846 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.480692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.481524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.481954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.482131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] PATH_INFO: `/v3/projects/56f622f71d6749ceab4ac71e80902f47/users/90e14a719e7b46dfbe2f2fd3473180c5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.490069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6df4-67b0-48bf-be0a-9c4ba6235139 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:28.503147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f622f71d6749ceab4ac71e80902f47, user_id=90e14a719e7b46dfbe2f2fd3473180c5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.515260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f0ff-caeb-475f-96eb-eee48b73112d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.531765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:28.543389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.543389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.543389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] PATH_INFO: `/v3/projects/ec02d0555d3747c8bcfef870ff8e413c/users/029589b1b2a64b828dcb33ca06ea5bda/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.554550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1042/2055] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:28 2022] PUT /identity/v3/projects/56f622f71d6749ceab4ac71e80902f47/users/90e14a719e7b46dfbe2f2fd3473180c5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:28.577760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:28.578164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:28.579021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:28.586508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec02d0555d3747c8bcfef870ff8e413c, user_id=029589b1b2a64b828dcb33ca06ea5bda, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:28.595624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:28.688366 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1014/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:28 2022] PUT /identity/v3/projects/ec02d0555d3747c8bcfef870ff8e413c/users/029589b1b2a64b828dcb33ca06ea5bda/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:28.691119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:28.762521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] MFA Rules not processed for user `90e14a719e7b46dfbe2f2fd3473180c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:28.768067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:28.922135 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:29.002116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff510-4206-421a-81d9-6977f5b531ae admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:29.016991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:29.019509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:29.020067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:29.020566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:29.022419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:29.025704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13413-8bf7-41e5-9265-1c9c45a8d26a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:29.077861 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1043/2057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:29.078145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1015/2058] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:29.084212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:29.125940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b92ee-3d68-4437-b56c-68ad25a0f471 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:29.138204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:29.139547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:29.140049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:29.140534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] PATH_INFO: `/v3/projects/ec02d0555d3747c8bcfef870ff8e413c/users/029589b1b2a64b828dcb33ca06ea5bda/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:29.150206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec02d0555d3747c8bcfef870ff8e413c, user_id=029589b1b2a64b828dcb33ca06ea5bda, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:29.156940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:29.225458 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1044/2059] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:29 2022] PUT /identity/v3/projects/ec02d0555d3747c8bcfef870ff8e413c/users/029589b1b2a64b828dcb33ca06ea5bda/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:29.241372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:29.245045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:29.245971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:29.322742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] MFA Rules not processed for user `029589b1b2a64b828dcb33ca06ea5bda`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:29.342931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:29.435481 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:29.565750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1016/2060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:29.791003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:29.793863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:29.924530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:29.925169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:30.050141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada42c-69e0-49ed-ab72-a3903bef69c1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:30.065305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509da23-418c-46d4-a445-18030f60470d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:30.068772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509da23-418c-46d4-a445-18030f60470d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:30.069176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509da23-418c-46d4-a445-18030f60470d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:30.069627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509da23-418c-46d4-a445-18030f60470d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:30.159274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf498d-9e32-45a6-bd2a-a74828297464 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:30.179201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:30.180414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:30.180995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:30.183475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] PATH_INFO: `/v3/users/1534110b9d464b72a7062fad6a67e884` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:30.185872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1534110b9d464b72a7062fad6a67e884)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:30.190078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:30.277105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509da23-418c-46d4-a445-18030f60470d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:30.282590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509da23-418c-46d4-a445-18030f60470d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:30.311832 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1045/2061] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:30.366836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1534110b9d464b72a7062fad6a67e884'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:30.367263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509da23-418c-46d4-a445-18030f60470d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:30.369885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1534110b9d464b72a7062fad6a67e884'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:30.383969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509da23-418c-46d4-a445-18030f60470d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:30.396250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1534110b9d464b72a7062fad6a67e884'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:30.405801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:30.406550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:30.406838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:30.407114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:30.411002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:30.423299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1534110b9d464b72a7062fad6a67e884'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:30.424348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1534110b9d464b72a7062fad6a67e884'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:30.435048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:30.440703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3c8fe-eaa9-41c3-bab4-46691bf1f5d6 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:30.456218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1046/2062] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:30.462861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1017/2063] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:29 2022] DELETE /identity/v3/users/1534110b9d464b72a7062fad6a67e884 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:30.468729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:30.469264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:30.469924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:30.501198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:30.502499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:30.557675 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:30.756808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1047/2064] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:30.768861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:30.771771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:30.794217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:30.795794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:30.949380 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:30.972196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e1e5-3e57-4428-8d3e-e7280220073c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:30.985394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:30.989611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:30.990468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:30.991742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:31.007985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840a8e-109d-436e-948f-18b563551a86 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:31.015303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:31.016298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:31.016650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:31.017319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:31.020576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:31.027346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:31.045083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7b4f6-027c-4431-a7ad-203e7e60f93f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:31.090950 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1018/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:31.092605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:31.092899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:31.093177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:31.212315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:31.224671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:31.279784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:31.286020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:31.335427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1048/2066] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:31.484336 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1019/2067] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:31.510292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:31.513066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:31.697761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:31.701114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:31.749993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7cb35-53e8-404a-bd98-a94ee29033a3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:31.757312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:31.758714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:31.759175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:31.759589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] PATH_INFO: `/v3/projects/947078a0b0d444e68636195c31315fb7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:31.761850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=947078a0b0d444e68636195c31315fb7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:31.765899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:31.787713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54814-0650-418d-884b-3d883a228a88 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:31.817002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:31.818562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:31.818750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:31.822710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:31.859596 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:31.876433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:31.881452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:31.928319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1049/2068] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:32.013591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947078a0b0d444e68636195c31315fb7', 'request_id': 'req-94f3a869-553d-4da5-b3d4-dce2f9fda40a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.052059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947078a0b0d444e68636195c31315fb7', 'request_id': 'req-94f3a869-553d-4da5-b3d4-dce2f9fda40a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.068254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947078a0b0d444e68636195c31315fb7', 'request_id': 'req-94f3a869-553d-4da5-b3d4-dce2f9fda40a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.122948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] The token cache is being invalidate because project 947078a0b0d444e68636195c31315fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:32.123312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.127245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94f3a869-553d-4da5-b3d4-dce2f9fda40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.137167 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1020/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:31 2022] DELETE /identity/v3/projects/947078a0b0d444e68636195c31315fb7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:32.142838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:32.191314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa94c-cdef-4d16-aa93-66683ec393ef service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:32.373303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95045cb-4c40-49bd-a35c-b903828825b9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:32.373662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95045cb-4c40-49bd-a35c-b903828825b9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:32.373946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95045cb-4c40-49bd-a35c-b903828825b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:32.430738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:32.431906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:32.432332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:32.432950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] PATH_INFO: `/v3/users/769e7f1b122447a28db5a376a5c11793` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:32.434482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] RBAC: Authorizing `identity:delete_user(user_id=769e7f1b122447a28db5a376a5c11793)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:32.437021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:32.440518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e95045cb-4c40-49bd-a35c-b903828825b9 None None] MFA Rules not processed for user `90e14a719e7b46dfbe2f2fd3473180c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:32.442080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e95045cb-4c40-49bd-a35c-b903828825b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:32.530656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769e7f1b122447a28db5a376a5c11793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.549139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769e7f1b122447a28db5a376a5c11793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.574632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769e7f1b122447a28db5a376a5c11793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.575795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769e7f1b122447a28db5a376a5c11793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.579008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769e7f1b122447a28db5a376a5c11793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:32.625294 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1050/2070] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:32 2022] DELETE /identity/v3/users/769e7f1b122447a28db5a376a5c11793 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:32.659871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1021/2071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:33.001176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:33.003762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:33.135098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eae6-2982-4fc1-b010-236548db44de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:33.142692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:33.143624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:33.144159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:33.144619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] PATH_INFO: `/v3/users/549ac14b43eb4f0d85c9d9e975515df1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:33.146424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549ac14b43eb4f0d85c9d9e975515df1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:33.150367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:33.174721 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:33.241936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549ac14b43eb4f0d85c9d9e975515df1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:33.260426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549ac14b43eb4f0d85c9d9e975515df1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:33.297420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549ac14b43eb4f0d85c9d9e975515df1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:33.298601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549ac14b43eb4f0d85c9d9e975515df1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:33.299600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549ac14b43eb4f0d85c9d9e975515df1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:33.343050 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1051/2072] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:32 2022] DELETE /identity/v3/users/549ac14b43eb4f0d85c9d9e975515df1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:33.344838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:33.345677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:33.345677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:33.370875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:33.373095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:33.395615 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:33.486830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1022/2073] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:33.499733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:33.501247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:33.574892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade14-dc79-4198-9ac1-30e94d140bc9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:33.578714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:33.579345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:33.579621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:33.579925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:33.590605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:33.592098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:33.604354 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1052/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:33.809013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:33.810758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:33.835191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996f59-7e82-4c50-8c5c-811c4ec59b3c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:33.836425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:33.838225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:33.855490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:33.856739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:33.856739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:33.856739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] PATH_INFO: `/v3/projects/f45c94bb302c43b7aa75a762159c2185` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:33.858101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45c94bb302c43b7aa75a762159c2185)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:33.861087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:33.864168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3915b-2e5a-4889-baac-f1b9c0b84b12 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:33.887862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:33.888518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:33.889055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:33.889384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] PATH_INFO: `/v3/projects/7b3b7f9e3f494890ac14e46a66585d0d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:33.891700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3b7f9e3f494890ac14e46a66585d0d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:33.895465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.007093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3b7f9e3f494890ac14e46a66585d0d', 'request_id': 'req-9ff4b236-8203-48f2-b956-be0dbd78ffec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.007523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45c94bb302c43b7aa75a762159c2185', 'request_id': 'req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.015416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3b7f9e3f494890ac14e46a66585d0d', 'request_id': 'req-9ff4b236-8203-48f2-b956-be0dbd78ffec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.023740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3b7f9e3f494890ac14e46a66585d0d', 'request_id': 'req-9ff4b236-8203-48f2-b956-be0dbd78ffec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.036176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45c94bb302c43b7aa75a762159c2185', 'request_id': 'req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.055443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45c94bb302c43b7aa75a762159c2185', 'request_id': 'req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.058124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] The token cache is being invalidate because project 7b3b7f9e3f494890ac14e46a66585d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:34.058801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.060319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ff4b236-8203-48f2-b956-be0dbd78ffec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.067909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1053/2075] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:33 2022] DELETE /identity/v3/projects/7b3b7f9e3f494890ac14e46a66585d0d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:34.069914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76492d-809c-4086-93c7-3a06fa64646a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.070320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76492d-809c-4086-93c7-3a06fa64646a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.071457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76492d-809c-4086-93c7-3a06fa64646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.074258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] The token cache is being invalidate because project f45c94bb302c43b7aa75a762159c2185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:34.074564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.075693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.083673 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1023/2076] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:33 2022] DELETE /identity/v3/projects/f45c94bb302c43b7aa75a762159c2185 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:34.083673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.086103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.111146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ee76492d-809c-4086-93c7-3a06fa64646a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:34.113762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee76492d-809c-4086-93c7-3a06fa64646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.143574 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:34.188135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324d04a-3d14-4c34-9d26-dd7ce7a0a110 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:34.217473 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1054/2077] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:34.219868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.219868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.219868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.253069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:34.255800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.321591 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:34.354655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:34.354655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.354655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.354655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] PATH_INFO: `/v3/users/0d35a97419384c60a5fbcb76bd593f7f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.358316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d35a97419384c60a5fbcb76bd593f7f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:34.358316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.413346 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1055/2078] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:34.414297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.416004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.464136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d35a97419384c60a5fbcb76bd593f7f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.465090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d35a97419384c60a5fbcb76bd593f7f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.490057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d35a97419384c60a5fbcb76bd593f7f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.568218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d35a97419384c60a5fbcb76bd593f7f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.569292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-33e36332-1633-48a0-88a0-b36c0603e12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d35a97419384c60a5fbcb76bd593f7f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.586797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb9b63-e4d4-4951-a1f7-3d7ef93534cc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:34.600290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:34.602139 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1024/2079] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:34 2022] DELETE /identity/v3/users/0d35a97419384c60a5fbcb76bd593f7f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:34.603242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.603786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.604362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.604613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.604769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.609181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.613312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.657596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:34.659674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:34.661022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.661468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.685307 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1056/2080] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:34.687050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.689627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.748096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dee31-974a-4f13-894d-b0dde8640714 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:34.751243 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1025/2081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:34.758462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.764246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:34.765131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.765890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.766362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] PATH_INFO: `/v3/users/9c9e29782e034096a25a72eff7337607` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.768989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9e29782e034096a25a72eff7337607)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:34.772503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.773771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ce47f-d6ee-49cb-aa33-e672d5eed124 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:34.781848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:34.782966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.783636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.784416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.785435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:34.785860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:34.788953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.806736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1026/2082] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:34.813723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.830806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d146e0-46b9-477b-a6a2-bbd17bcf7d40 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:34.839120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:34.840242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:34.840904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:34.841468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:34.842406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:34.844641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:34.875174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9e29782e034096a25a72eff7337607'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.878660 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:34.886712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1027/2083] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:34 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:01:34.888449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9e29782e034096a25a72eff7337607'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.893949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.926433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9e29782e034096a25a72eff7337607'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.927527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9e29782e034096a25a72eff7337607'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.928209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9e29782e034096a25a72eff7337607'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:34.956661 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1057/2084] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:34 2022] DELETE /identity/v3/users/9c9e29782e034096a25a72eff7337607 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:34.958436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:34.961555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:34.974740 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:35.012910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f85d-0279-46af-9c5a-a9370ce37cf9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.075278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d8c3-65d0-42ae-9450-452f9d939b05 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.101983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.102788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.103112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.104653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] PATH_INFO: `/v3/users/90e14a719e7b46dfbe2f2fd3473180c5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.119169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e14a719e7b46dfbe2f2fd3473180c5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.124295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.137607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.139164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.139693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.140529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.141970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.148311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a58829-3a8c-4151-99ee-60402983017d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.202567 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1028/2085] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:34 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:35.204542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.204838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.205116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.213661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e14a719e7b46dfbe2f2fd3473180c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.225589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e14a719e7b46dfbe2f2fd3473180c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.231508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:35.234713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.258834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1029/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:35.258834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.266899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e14a719e7b46dfbe2f2fd3473180c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.267778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e14a719e7b46dfbe2f2fd3473180c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.269011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.270153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e14a719e7b46dfbe2f2fd3473180c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.285933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb0de-b7a9-4f62-8321-5da9f50b9b1d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.292836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.294037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.294433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.294640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.295673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.297665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.314879 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1058/2087] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:34 2022] DELETE /identity/v3/users/90e14a719e7b46dfbe2f2fd3473180c5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:35.314879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.314879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.319195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1030/2088] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:35.320283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.329229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.353967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b16e8-94ce-4c91-a99b-d0723a8c5b0a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.398506 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:35.409050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c421-8c31-4445-8c66-ddf9222d4f8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.420867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.422662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.422992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.423297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.431080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.464201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.464961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.465340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.465804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] PATH_INFO: `/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.468208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ff735d40ae4e7c8001fe1e726b8884)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.474163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.529063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.531924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9f8f-ef3a-4a3a-97e1-e31af6fdd45d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.547593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1059/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:35.549712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a30b7-9257-477b-b03d-e4b727d72123 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.550217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a30b7-9257-477b-b03d-e4b727d72123 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.550689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a30b7-9257-477b-b03d-e4b727d72123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.566869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ff735d40ae4e7c8001fe1e726b8884', 'request_id': 'req-af0940e9-da09-47b1-a242-57f66e0e34ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.577714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ff735d40ae4e7c8001fe1e726b8884', 'request_id': 'req-af0940e9-da09-47b1-a242-57f66e0e34ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.580704 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:35.589508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ff735d40ae4e7c8001fe1e726b8884', 'request_id': 'req-af0940e9-da09-47b1-a242-57f66e0e34ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.597259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1a9a30b7-9257-477b-b03d-e4b727d72123 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:35.599022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1a9a30b7-9257-477b-b03d-e4b727d72123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.617358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] The token cache is being invalidate because project a8ff735d40ae4e7c8001fe1e726b8884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:35.617743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.618894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:35.620826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1031/2090] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:35 2022] DELETE /identity/v3/projects/a8ff735d40ae4e7c8001fe1e726b8884 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:35.621714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.623423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.686791 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1060/2091] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:35.689311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.689311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.689311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.718747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:35.720118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.742775 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1061/2092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:35.743865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.745328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.786856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0940e9-da09-47b1-a242-57f66e0e34ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.798578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.799681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.800423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.801041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.802401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.807108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51860-a177-4e96-8ede-905f815bff81 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.846117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1032/2093] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:35.850792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.852335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.853067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.870814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258cfe1-109a-426f-991b-d75712f3e013 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.883593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:35.884271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:35.884567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:35.884842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:35.906427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:35.910558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:35.915568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:35.919591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:35.944442 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1062/2094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:35.946077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.955265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1033/2095] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:35.964843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:35.987329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a96d9-3026-4819-a069-dfb86e150d34 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:35.992211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124018c-fc38-4e2a-8fca-efc1b5c849fe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.014476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.014476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.014476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.014476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.015051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:36.015051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.015051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.023721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.025428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.027552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.028344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] PATH_INFO: `/v3/projects/a19dc2a3a3ec4ef8a891b04514d93020/users/6195ad47d7424153aaa5fe7656453781/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.055534 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1034/2096] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:36.063649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.073375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19dc2a3a3ec4ef8a891b04514d93020, user_id=6195ad47d7424153aaa5fe7656453781, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.082518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078c63-4ea0-4558-b593-50fd01995721 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.089282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.090088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.090579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.091069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.091931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.094115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.096406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496fed-635b-4ca9-8c22-1d1c4fa52ad7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.152519 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1063/2097] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:35 2022] PUT /identity/v3/projects/a19dc2a3a3ec4ef8a891b04514d93020/users/6195ad47d7424153aaa5fe7656453781/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:36.172705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.173517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.176900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.177110 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1035/2098] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:36 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:36.178864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.223871 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:36.251440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] MFA Rules not processed for user `6195ad47d7424153aaa5fe7656453781`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:36.253210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:36.481206 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1064/2099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:36.483995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.492213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:36.500502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cf5f4-7190-43f2-8c48-95ad976547eb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.518216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.523148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.524532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.525040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.527969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.541712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.552771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776090-3ef6-4e2f-a112-ffabd2f323d4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.574989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.575660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.576222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.576504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] PATH_INFO: `/v3/projects/6b3e90256e814bb9ab1e25b7a1f6a30e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.579146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3e90256e814bb9ab1e25b7a1f6a30e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.581257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.623775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1036/2100] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:36 2022] POST /identity/v3/users => generated 297 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:36.625350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.658475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abb7d1-57b4-43b1-97ae-250b932d210a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.678238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.679776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.680436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.680952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.682487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.687179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.727338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'request_id': 'req-026a1ef8-204a-4058-ac8b-a941564c946c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:36.736778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'request_id': 'req-026a1ef8-204a-4058-ac8b-a941564c946c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:36.752373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'request_id': 'req-026a1ef8-204a-4058-ac8b-a941564c946c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:36.769830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1037/2101] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:36 2022] POST /identity/v3/projects => generated 395 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:36.771059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] The token cache is being invalidate because project 6b3e90256e814bb9ab1e25b7a1f6a30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:36.771537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:36.772568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:36.772796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.776083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1065/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:36 2022] DELETE /identity/v3/projects/6b3e90256e814bb9ab1e25b7a1f6a30e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:36.777297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.779549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:36.780544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:36.799762 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:36.936069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a1ef8-204a-4058-ac8b-a941564c946c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.944236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.944236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.944236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.944236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.944730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed27ca-d48c-41b1-9f44-4aa04ba76c2c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:36.945835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.949731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.955549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:36.956768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:36.957383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:36.957985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:36.959927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:36.962813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:36.983560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1066/2103] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:36 2022] POST /identity/v3/users => generated 304 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:36.984861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.988090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:36.992600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1038/2104] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:36.994338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:36.997956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.009495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba607e-9761-413f-b346-ec49896211f2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.022542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6beb4b-93b6-4f2c-9937-7a41937ef8b8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.028595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.029263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.029577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.029856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] PATH_INFO: `/v3/users/029589b1b2a64b828dcb33ca06ea5bda` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.033474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.033980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029589b1b2a64b828dcb33ca06ea5bda)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:37.035121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.035853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.036597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] PATH_INFO: `/v3/projects/56f622f71d6749ceab4ac71e80902f47` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.038804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:37.044214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f622f71d6749ceab4ac71e80902f47)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:37.048426 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:37.055165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:37.170014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029589b1b2a64b828dcb33ca06ea5bda'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.190432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029589b1b2a64b828dcb33ca06ea5bda'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.204982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f622f71d6749ceab4ac71e80902f47', 'request_id': 'req-d05d59d3-07f5-45d0-a543-a67720e51576'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.227061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029589b1b2a64b828dcb33ca06ea5bda'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.228708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029589b1b2a64b828dcb33ca06ea5bda'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.238931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029589b1b2a64b828dcb33ca06ea5bda'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.242624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f622f71d6749ceab4ac71e80902f47', 'request_id': 'req-d05d59d3-07f5-45d0-a543-a67720e51576'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.270332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f622f71d6749ceab4ac71e80902f47', 'request_id': 'req-d05d59d3-07f5-45d0-a543-a67720e51576'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.281924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1067/2105] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:36 2022] DELETE /identity/v3/users/029589b1b2a64b828dcb33ca06ea5bda => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:37.284644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:37.289476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.327850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] The token cache is being invalidate because project 56f622f71d6749ceab4ac71e80902f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:37.328378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.330846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:37.339613 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1039/2106] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:36 2022] DELETE /identity/v3/projects/56f622f71d6749ceab4ac71e80902f47 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:37.341288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:37.344417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.486602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbce6-5333-4168-b5c9-41a180090fc7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.504876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.507616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.508155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.508606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.510662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:37.526433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6abe31-cf69-414f-a187-6269add61b7a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:37.539843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d59d3-07f5-45d0-a543-a67720e51576 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.551893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.553174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.554041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.554551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.555747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:37.560662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463aaf-9c61-4ba2-96f4-09a5a1ca73fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:37.567814 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1068/2107] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:37.575468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995f0a-d0c9-4e8b-9de5-d3f9841978ae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.576114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995f0a-d0c9-4e8b-9de5-d3f9841978ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.581073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995f0a-d0c9-4e8b-9de5-d3f9841978ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.618405 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1040/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:37.620903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.622222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.622716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.679708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c5995f0a-d0c9-4e8b-9de5-d3f9841978ae None None] MFA Rules not processed for user `2eddf0cd4fb54de2ab7f26843380a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:37.682364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c5995f0a-d0c9-4e8b-9de5-d3f9841978ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.682705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:37.691851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.729688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1041/2109] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:37.732224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:37.737283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.799533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc4d6-d54e-4eed-a262-c09cc62ebf75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.819579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.820428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.820818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.821201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] PATH_INFO: `/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4/users/0967fa161aad41dd9269896e0ab92a76/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.837187 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:37.842873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4dae8cb20843b1b9fc985ab75171e4, user_id=0967fa161aad41dd9269896e0ab92a76, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:37.846719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:37.877397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1042/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:37 2022] PUT /identity/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4/users/0967fa161aad41dd9269896e0ab92a76/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:37.878698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:37.883704 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1069/2111] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:37.887502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.888316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.889280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:37.953425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:37.957676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.975516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9148-0af2-4667-883f-9a112b1fc739 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:37.977564 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1070/2112] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:37.980523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:37.984656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:37.986863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:37.987561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:37.987889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:37.988185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] PATH_INFO: `/v3/projects/4ea70b1c1150462fb7ad97fa83ef8060/users/54541ffbbb8d4f24a054d1d7a80f7152/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.025777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea70b1c1150462fb7ad97fa83ef8060, user_id=54541ffbbb8d4f24a054d1d7a80f7152, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.029089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.037005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56bb9d-c001-4a62-b174-569ba903fa37 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:38.049788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1043/2113] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:37 2022] PUT /identity/v3/projects/4ea70b1c1150462fb7ad97fa83ef8060/users/54541ffbbb8d4f24a054d1d7a80f7152/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:38.050880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:38.073862 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:38.159269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b57ab-656d-43df-a891-f9d0bb8f7fdf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:38.168437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:38.169393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.169984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.170624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.171575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.174235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.187834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1044/2114] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:38.189177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:38.202010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d8f5-ee14-49d9-a113-739cd468e38c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:38.209936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:38.210823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.211208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.211599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.212514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:38.212934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.215117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a422df-fe09-49cc-836d-3b2f941f8e17 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.230630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1045/2115] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:38.235935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:38.236298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.236498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.237008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.237185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.237697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.238281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] PATH_INFO: `/v3/users/a86f4e46084b4343b80d07e1ebffb237` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.242088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86f4e46084b4343b80d07e1ebffb237)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.246306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.303269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] MFA Rules not processed for user `54541ffbbb8d4f24a054d1d7a80f7152`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:38.306422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:38.347226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86f4e46084b4343b80d07e1ebffb237'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:38.382446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86f4e46084b4343b80d07e1ebffb237'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:38.406770 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:38.413280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86f4e46084b4343b80d07e1ebffb237'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:38.414203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86f4e46084b4343b80d07e1ebffb237'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:38.414862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86f4e46084b4343b80d07e1ebffb237'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:38.450960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1071/2116] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:37 2022] DELETE /identity/v3/users/a86f4e46084b4343b80d07e1ebffb237 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:38.451797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:38.457558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:38.467094 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1046/2117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:38.480726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:38.484981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:38.523490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64de88-b4ac-48ab-a33b-0318a7bb486a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:38.578253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee5b2-e590-4574-9e5e-11254f92c029 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:38.597595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:38.598515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.599015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.599463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] PATH_INFO: `/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4/users/0967fa161aad41dd9269896e0ab92a76/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.625979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4dae8cb20843b1b9fc985ab75171e4, user_id=0967fa161aad41dd9269896e0ab92a76, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.641222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.728670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1072/2118] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:38 2022] PUT /identity/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4/users/0967fa161aad41dd9269896e0ab92a76/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:38.731108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:38.740610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:38.749648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:38.750287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.750588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.750847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.751573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:38.754064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85ca3f-386c-4c0f-b717-f9cb96e7426c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:38.797903 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1047/2119] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:38 2022] POST /identity/v3/projects => generated 373 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:38.800173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:38.801036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:38.802088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:38.872681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:38.878410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:38.902852 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:38.997023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7602-10ae-418f-a232-d85919dcff16 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.139772 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1048/2120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:39.141654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.161496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.171922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.172991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.173569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.174043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] PATH_INFO: `/v3/projects/ec02d0555d3747c8bcfef870ff8e413c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.177137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec02d0555d3747c8bcfef870ff8e413c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.180130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.217761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa555c-81b2-40b0-a02d-a15bad9dc2fd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.228683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.230445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.231312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.231795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.233228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.238835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.280036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec02d0555d3747c8bcfef870ff8e413c', 'request_id': 'req-79f1235d-e588-4c8f-8113-4986197428db'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.288710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec02d0555d3747c8bcfef870ff8e413c', 'request_id': 'req-79f1235d-e588-4c8f-8113-4986197428db'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.307265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec02d0555d3747c8bcfef870ff8e413c', 'request_id': 'req-79f1235d-e588-4c8f-8113-4986197428db'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.328604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] The token cache is being invalidate because project ec02d0555d3747c8bcfef870ff8e413c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:39.329340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.330113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79f1235d-e588-4c8f-8113-4986197428db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.332425 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1073/2121] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:38 2022] DELETE /identity/v3/projects/ec02d0555d3747c8bcfef870ff8e413c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:39.333518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.333849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.334622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.340152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1049/2122] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:39 2022] POST /identity/v3/projects => generated 391 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:39.342290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.345968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.375067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] MFA Rules not processed for user `0967fa161aad41dd9269896e0ab92a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:39.376848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.477454 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:39.481969 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:39.506989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1074/2123] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:39.509159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.515199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.523054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cdc5-2498-43f2-8bbc-24cdd650ba79 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.531988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.532621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.532897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.533278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.534254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.537947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.565966 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1050/2124] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:39 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:39.568010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.570539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.585157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f4f6-a993-435c-8812-6c9518c41ea7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.591352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.591994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.592282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.592556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] PATH_INFO: `/v3/users/725bbefab51841029b79a380ca8b54da` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.594557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725bbefab51841029b79a380ca8b54da)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.596744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.616538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923d665-be04-4ef4-a65f-efbaac1cb3c0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.623435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.624231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.624516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.624793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.626789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.644527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.646206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc576-389e-4ccb-a3b0-e3f2d3222165 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.658695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1075/2125] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:39.660053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.660351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.660705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.676680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725bbefab51841029b79a380ca8b54da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.678208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725bbefab51841029b79a380ca8b54da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.695123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:39.697094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.706454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725bbefab51841029b79a380ca8b54da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.720283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1076/2126] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:39.721194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.723666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.745078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725bbefab51841029b79a380ca8b54da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.747446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725bbefab51841029b79a380ca8b54da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:39.757966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cf0b-d303-47e6-ad8b-b3c0becf17d6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.775296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.776625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.778119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.779086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.780744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.781986 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1051/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:39 2022] DELETE /identity/v3/users/725bbefab51841029b79a380ca8b54da => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:39.783054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.784628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.791893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:39.839624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1077/2128] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:39 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:39.841235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:39.845618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.878667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993dff-19f4-43c9-b59f-0045385c018d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.921316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621134-2557-47b1-a52a-b66cd8672153 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:39.931777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.933115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.934052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.934697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.939793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:39.987535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:39.988480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:39.988750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:39.989600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:39.990861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:39.993093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995120-802d-4485-a45c-c0aa5c76e85e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.009909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1078/2129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:40.009909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300801-b025-4637-9da4-160d28668a1b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.009909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300801-b025-4637-9da4-160d28668a1b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.009909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300801-b025-4637-9da4-160d28668a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.040923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-99300801-b025-4637-9da4-160d28668a1b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:40.042637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99300801-b025-4637-9da4-160d28668a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.054315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1079/2130] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:40.059648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.059946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.060220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.071099 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:40.087058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:40.089604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.103194 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1080/2131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:40.106830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.122114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.123832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.127654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96cab-1260-4505-8571-269eb2d211f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.134118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.135208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.135721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.136113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.137010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.137467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1052/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:40.138362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.139950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.152224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14df31d-7678-43c8-9fd4-ecd608a3277c service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.159186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.159988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.160238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.161861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.161861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.163264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.177764 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1053/2133] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:40.179040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.190693 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1081/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:40.192366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.198171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.200049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74be99c-1221-4767-ae90-680a555ba04d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.207661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.211605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.212410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.213100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.214229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:40.215138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.216980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.242052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34938-63c4-4eb2-96e6-13bd7392f56e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.249179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1054/2135] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:40.249179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.250953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.252090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.252331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.252692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.252980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] PATH_INFO: `/v3/projects/76e2bd25bf09473c9a209cc718dec687` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.254976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e2bd25bf09473c9a209cc718dec687)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.259454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.349126 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:40.393653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b07bfc-4f4b-4e62-80df-4d3476aa0a61 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.401253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e2bd25bf09473c9a209cc718dec687', 'request_id': 'req-b4792d30-3416-4a44-b3e8-e0b2b790c923'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.434703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e2bd25bf09473c9a209cc718dec687', 'request_id': 'req-b4792d30-3416-4a44-b3e8-e0b2b790c923'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.448370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e2bd25bf09473c9a209cc718dec687', 'request_id': 'req-b4792d30-3416-4a44-b3e8-e0b2b790c923'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.484869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] The token cache is being invalidate because project 76e2bd25bf09473c9a209cc718dec687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:40.485575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.486874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.490155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1082/2136] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:40 2022] DELETE /identity/v3/projects/76e2bd25bf09473c9a209cc718dec687 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:40.491990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.495555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.532809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.532809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.532809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.532809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.533506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.639388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4792d30-3416-4a44-b3e8-e0b2b790c923 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.650613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.651788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.652344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.652584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] PATH_INFO: `/v3/projects/adf199769d374f4a8de93bc25408c83a/users/170ea9ab3d444c28bdd566817773f3c9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.679054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf199769d374f4a8de93bc25408c83a, user_id=170ea9ab3d444c28bdd566817773f3c9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.682766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.694304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.696555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.715246 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1083/2137] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:40 2022] PUT /identity/v3/projects/adf199769d374f4a8de93bc25408c83a/users/170ea9ab3d444c28bdd566817773f3c9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:40.715246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.715715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1055/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:40.716397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:40.718843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.724302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:40.739306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1d9b-08a6-4f34-8da6-0a08afbd72c2 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.784553 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:40.837713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.838518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.838988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.839657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] PATH_INFO: `/v3/users/6195ad47d7424153aaa5fe7656453781` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.853943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6195ad47d7424153aaa5fe7656453781)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.860999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.901823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f8ba-a669-4d5f-b035-6f6a95623cef admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:40.920849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:40.922584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:40.923431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:40.926338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] PATH_INFO: `/v3/projects/7222c94675e14a4381e48c17b360a351/users/e860f05decda4dd9a319ea6efba0a1ca/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:40.939722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6195ad47d7424153aaa5fe7656453781'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.941257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6195ad47d7424153aaa5fe7656453781'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.962781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7222c94675e14a4381e48c17b360a351, user_id=e860f05decda4dd9a319ea6efba0a1ca, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:40.969054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:40.971441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6195ad47d7424153aaa5fe7656453781'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:40.999878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6195ad47d7424153aaa5fe7656453781'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.000747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1084/2139] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:40 2022] PUT /identity/v3/projects/7222c94675e14a4381e48c17b360a351/users/e860f05decda4dd9a319ea6efba0a1ca/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:41.001757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6195ad47d7424153aaa5fe7656453781'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.002350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.007703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.042614 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1056/2140] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:40 2022] DELETE /identity/v3/users/6195ad47d7424153aaa5fe7656453781 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:41.043692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.046293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.103127 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:41.165197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239249e-c70b-44a0-979d-5df356c088e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.177491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff36e7d-c973-421a-b34f-7becf9d7ed11 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.181948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.183522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.184072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.184252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.184625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.184906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] PATH_INFO: `/v3/users/2dbda9f37d5c4ab880e9511f12bdc086` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.185531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.186294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.186781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbda9f37d5c4ab880e9511f12bdc086)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.189013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.190437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.196927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1dbd-a5b1-48a7-9af8-b9a323cee3b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.241651 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1085/2141] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:41 2022] POST /identity/v3/projects => generated 391 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:41.241651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4172da-07a7-4ed7-a346-708371e7fb6f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.241651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4172da-07a7-4ed7-a346-708371e7fb6f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.241998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4172da-07a7-4ed7-a346-708371e7fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.265765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbda9f37d5c4ab880e9511f12bdc086'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.267218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbda9f37d5c4ab880e9511f12bdc086'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.270586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c4172da-07a7-4ed7-a346-708371e7fb6f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:41.271057 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:41.272138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c4172da-07a7-4ed7-a346-708371e7fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.288847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbda9f37d5c4ab880e9511f12bdc086'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.311721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbda9f37d5c4ab880e9511f12bdc086'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.312918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbda9f37d5c4ab880e9511f12bdc086'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.338377 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1057/2142] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:41 2022] DELETE /identity/v3/users/2dbda9f37d5c4ab880e9511f12bdc086 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:41.340757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.344148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.408803 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1086/2143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:41.410503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.410848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.411595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.437560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:41.439027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.499201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6940f7-aa82-4714-b950-88a126834531 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.513259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.515669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.515669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.515669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.516951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.518908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.538890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1058/2144] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:41.538890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.538890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.558312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3100-7ded-4d1d-8d89-49e93c664fbc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.564421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.565449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.565717 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1087/2145] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:41.566793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.567321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] PATH_INFO: `/v3/projects/92c7bea122934e44b7908c805f431e0a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.567446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.569060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c7bea122934e44b7908c805f431e0a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.569955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.571927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.601375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2c76-1537-40b0-978f-0d80b40276f8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.620647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.622513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.623166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.623679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.624596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.627605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.662896 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1088/2146] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:41 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:41.664860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.667582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.671919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c7bea122934e44b7908c805f431e0a', 'request_id': 'req-6ed2d768-e420-48a3-a909-672db681d2b1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.682145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c7bea122934e44b7908c805f431e0a', 'request_id': 'req-6ed2d768-e420-48a3-a909-672db681d2b1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.690650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c7bea122934e44b7908c805f431e0a', 'request_id': 'req-6ed2d768-e420-48a3-a909-672db681d2b1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.711360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] The token cache is being invalidate because project 92c7bea122934e44b7908c805f431e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:41.711741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.712704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:41.715522 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1059/2147] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:41 2022] DELETE /identity/v3/projects/92c7bea122934e44b7908c805f431e0a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:41.716541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.719499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.786312 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:41.820090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccbf13-ccb1-4d62-a563-cc1fb912b615 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.821280 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:41.862326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d768-e420-48a3-a909-672db681d2b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:41.870143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.880739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.882672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.884181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] PATH_INFO: `/v3/projects/7222c94675e14a4381e48c17b360a351/users/e860f05decda4dd9a319ea6efba0a1ca/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.887445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7222c94675e14a4381e48c17b360a351, user_id=e860f05decda4dd9a319ea6efba0a1ca, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.891514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.909547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1060/2148] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:41 2022] PUT /identity/v3/projects/7222c94675e14a4381e48c17b360a351/users/e860f05decda4dd9a319ea6efba0a1ca/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:41.910585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.913128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.917088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:41.917789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:41.918075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:41.918656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:41.920582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.947403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:41.949249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:41.969319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1089/2149] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:41.970269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:41.971687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:41.987361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf314-1e17-43e9-a751-cf6904e3810d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.002542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8dd3a-7e6d-463d-90f3-76e989f82de1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.008599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.009595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.010055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.010520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.012674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.077171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.078192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.078492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.079156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.080125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.081845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.094424 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1090/2150] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:42.098472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:42.100728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.104288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.105798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.116426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab87f-be9c-49a4-a426-1f5cad269b3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.118254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1061/2151] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:42.119023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:42.120616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.137154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a206110-8724-47b1-9611-4264807b2148 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.138272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.139310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.139593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.139867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] PATH_INFO: `/v3/users/7b488e3b4e064b559907146f62175f37` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.143142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b488e3b4e064b559907146f62175f37)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.147357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.148310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.148607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.148863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] PATH_INFO: `/v3/projects/cce574297d2a41358efbef3d79964980` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.150175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce574297d2a41358efbef3d79964980)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.151828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.152450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.229589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce574297d2a41358efbef3d79964980', 'request_id': 'req-07a9ef24-494d-4098-a071-2e9af81b7e82'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.241980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce574297d2a41358efbef3d79964980', 'request_id': 'req-07a9ef24-494d-4098-a071-2e9af81b7e82'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.252121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce574297d2a41358efbef3d79964980', 'request_id': 'req-07a9ef24-494d-4098-a071-2e9af81b7e82'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.261910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b488e3b4e064b559907146f62175f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.278664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b488e3b4e064b559907146f62175f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.280792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] The token cache is being invalidate because project cce574297d2a41358efbef3d79964980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:42.281145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.281998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07a9ef24-494d-4098-a071-2e9af81b7e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.288585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1062/2152] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:42 2022] DELETE /identity/v3/projects/cce574297d2a41358efbef3d79964980 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:42.288585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d256-7ba8-4b3d-92da-a8727b630a80 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.288585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d256-7ba8-4b3d-92da-a8727b630a80 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.288585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d256-7ba8-4b3d-92da-a8727b630a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.309221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b488e3b4e064b559907146f62175f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.312679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b488e3b4e064b559907146f62175f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.314263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b488e3b4e064b559907146f62175f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:42.326850 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:42.351076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-88e7d256-7ba8-4b3d-92da-a8727b630a80 None None] MFA Rules not processed for user `e860f05decda4dd9a319ea6efba0a1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:42.353155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88e7d256-7ba8-4b3d-92da-a8727b630a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.375305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1091/2153] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:42 2022] DELETE /identity/v3/users/7b488e3b4e064b559907146f62175f37 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:42.380020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:42.402683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.434782 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:42.493441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1063/2154] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:42.493441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.493441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.493441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.527307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:42.528861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.574317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ac3c9-1634-4b79-8d6f-8158320fad8a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.586684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.587564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.588024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.588464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.589395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.592086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dc8e2-e606-4742-bfef-4f9505a6f72b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.616361 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1092/2155] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:42.620999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.620999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.621821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.665199 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1064/2156] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:42.666937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:42.691139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae20b2-3e66-435f-ac1d-09577a512e18 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:42.700979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:42.701678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] MFA Rules not processed for user `54541ffbbb8d4f24a054d1d7a80f7152`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:42.702198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.702696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.703176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] PATH_INFO: `/v3/projects/9d23fa7f49774253bbd383006204b043/users/247005eefb314b679f4fdd16768fd990/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.703574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.741706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d23fa7f49774253bbd383006204b043, user_id=247005eefb314b679f4fdd16768fd990, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:42.747995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ae98b-f64a-4976-a1b0-c89e122a10c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:42.815675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1065/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:42 2022] PUT /identity/v3/projects/9d23fa7f49774253bbd383006204b043/users/247005eefb314b679f4fdd16768fd990/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:42.824774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444245d-7839-450e-8187-a0fd165c4a60 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:42.825515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444245d-7839-450e-8187-a0fd165c4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:42.825802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444245d-7839-450e-8187-a0fd165c4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:42.882133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1444245d-7839-450e-8187-a0fd165c4a60 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:42.886156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1444245d-7839-450e-8187-a0fd165c4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.902063 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1093/2158] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:42.903889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:42.911549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:42.958292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e43142-b2ef-45dc-bc52-91691fc39e53 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.120561 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1066/2159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:43.122559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.124735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.125019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.131015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.132589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.133052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.133530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] PATH_INFO: `/v3/projects/a19dc2a3a3ec4ef8a891b04514d93020` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.134946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19dc2a3a3ec4ef8a891b04514d93020)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.137667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.178291 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:43.182346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] MFA Rules not processed for user `247005eefb314b679f4fdd16768fd990`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:43.185376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.208913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19dc2a3a3ec4ef8a891b04514d93020', 'request_id': 'req-f4876f76-2699-4f7b-8ed5-c17f9399c489'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.215133 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:43.222812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19dc2a3a3ec4ef8a891b04514d93020', 'request_id': 'req-f4876f76-2699-4f7b-8ed5-c17f9399c489'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.235605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19dc2a3a3ec4ef8a891b04514d93020', 'request_id': 'req-f4876f76-2699-4f7b-8ed5-c17f9399c489'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.281821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] The token cache is being invalidate because project a19dc2a3a3ec4ef8a891b04514d93020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:43.282143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.282932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.284967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1094/2160] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:42 2022] DELETE /identity/v3/projects/a19dc2a3a3ec4ef8a891b04514d93020 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:43.286196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.293165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.347541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1067/2161] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:43.355345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.357787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.409559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4876f76-2699-4f7b-8ed5-c17f9399c489 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.423122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.424908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.425623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.426324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.430424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.494304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f66c-78a8-4596-ba7b-8e9af8df8574 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.500763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.500763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.501093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.501380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] PATH_INFO: `/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.504847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7a84df4fc24fc4898dfb1a0aef9b92)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.510467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.568927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.572376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.598615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7a84df4fc24fc4898dfb1a0aef9b92', 'request_id': 'req-5a2707bf-112f-4693-bb2c-67868915aa3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.602932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1095/2162] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:43.603624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.606696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.608069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7a84df4fc24fc4898dfb1a0aef9b92', 'request_id': 'req-5a2707bf-112f-4693-bb2c-67868915aa3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.618011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7a84df4fc24fc4898dfb1a0aef9b92', 'request_id': 'req-5a2707bf-112f-4693-bb2c-67868915aa3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.651307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] The token cache is being invalidate because project 0f7a84df4fc24fc4898dfb1a0aef9b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:43.651704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.652868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.659998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1068/2163] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:43 2022] DELETE /identity/v3/projects/0f7a84df4fc24fc4898dfb1a0aef9b92 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:43.660267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7914554-e1b9-41d3-9919-21ea0f513e79 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.660457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.660457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.716764 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:43.761944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2707bf-112f-4693-bb2c-67868915aa3c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.767430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.768315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.768789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.769173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] PATH_INFO: `/v3/users/0967fa161aad41dd9269896e0ab92a76` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.770706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0967fa161aad41dd9269896e0ab92a76)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.773674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.820452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.821339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.821883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.822263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.823156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:43.823709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.827128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.848155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1096/2164] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:43.848155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.850040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.854043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0967fa161aad41dd9269896e0ab92a76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.855490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0967fa161aad41dd9269896e0ab92a76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.865143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0967fa161aad41dd9269896e0ab92a76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.867499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011af3c-2ef6-48a0-9c6d-12385aacd68f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:43.873815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:43.874684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.875098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.875501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.876268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:43.878484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:43.884189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0967fa161aad41dd9269896e0ab92a76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.884944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1956f4ea-0a10-44d6-ab7e-42ba9b8ca249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0967fa161aad41dd9269896e0ab92a76'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:43.891442 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:43.910393 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1069/2165] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:43 2022] DELETE /identity/v3/users/0967fa161aad41dd9269896e0ab92a76 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:43.915299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:43.915684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:43.916009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:43.937003 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1097/2166] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:43 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:43.939187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:43.945296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:43.948752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:43.950148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:44.116172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1070/2167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:44.117257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.129636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:44.145932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3de30f-9bb4-4e3f-b97e-c3b439138e5f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.151775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.152420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.152750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.153049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.153904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.157213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022689f-7a91-4528-bf46-35e4acbef352 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.197008 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1071/2168] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:44 2022] POST /identity/v3/users => generated 303 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:44.210141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.216613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.217876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.275692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:44.277330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:44.289583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1072/2169] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:44.291189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.293739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83448-1f34-420d-a97f-98f47766cfc5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.307688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.308784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.310288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.310850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.313753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.319183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.321267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dceaf5-265f-4398-9105-3308bb8b8936 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.337049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.338174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.340119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.340819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.343607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.350031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.386498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1073/2170] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:44.390757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.407829 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1098/2171] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:43 2022] POST /identity/v3/projects => generated 387 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:44.417358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.442812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889af7d9-037e-473a-aafd-c6807c37941c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.488352 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:44.641107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339dea3-7983-4058-9b3f-ea96dd727a18 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.657962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.658951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.659254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.659527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] PATH_INFO: `/v3/projects/88349c2d730a430f8ae0db8e58067bce/users/469238a8747940b181fb26ebac94c99d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.661703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.662522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.662700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.662937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.663621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:44.663929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.665953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.700875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1074/2172] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:44.702020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.711955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88349c2d730a430f8ae0db8e58067bce, user_id=469238a8747940b181fb26ebac94c99d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.715491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.728951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e07f-fbe2-4a83-9133-f9332861f856 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.739331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.739972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.740516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.740894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.741457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.745896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:44.750401 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1099/2173] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:44 2022] PUT /identity/v3/projects/88349c2d730a430f8ae0db8e58067bce/users/469238a8747940b181fb26ebac94c99d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:44.759213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.766622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:44.803521 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1075/2174] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:44 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:44.803521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:44.819907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74561efc-cfe3-4af8-ab61-1e5df6fd05fc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.945228 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:44.971311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396a763-3e57-4dc3-b75d-bc62fdf56c61 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:44.983372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:44.984210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:44.984597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:44.984982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] PATH_INFO: `/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:44.987499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4dae8cb20843b1b9fc985ab75171e4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:44.991298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.003776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.004615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.004951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.005353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.007231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.009506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.074347 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1076/2175] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:45.075847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.084499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4dae8cb20843b1b9fc985ab75171e4', 'request_id': 'req-e04be3ee-766f-4b81-ab30-69f270517054'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:45.096423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4dae8cb20843b1b9fc985ab75171e4', 'request_id': 'req-e04be3ee-766f-4b81-ab30-69f270517054'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:45.107784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4dae8cb20843b1b9fc985ab75171e4', 'request_id': 'req-e04be3ee-766f-4b81-ab30-69f270517054'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:45.130070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] The token cache is being invalidate because project fc4dae8cb20843b1b9fc985ab75171e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:45.130409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:45.137294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:45.140563 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1100/2176] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:44 2022] DELETE /identity/v3/projects/fc4dae8cb20843b1b9fc985ab75171e4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:45.141698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.144621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.261771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac3f5-3ccc-426d-aa56-d69a4036b7ec admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.278345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.279004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.279313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.279588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.283510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.289290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.322826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1077/2177] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:45.323130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.328008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.353777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04be3ee-766f-4b81-ab30-69f270517054 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.362013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb69ba-8efd-46a8-865d-dde6b8a1893a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.367564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.368225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.368515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.368822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.369550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.375294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ca150-4999-4697-9ef1-cc012f768d08 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.379121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.379804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.380248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.381816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.383461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.390331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.414605 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1101/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:45.418280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.418510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.418767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.440043 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:45.455090 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1078/2179] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:45 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:45.456406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.461743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.473463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:45.476448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.491652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c762-fe60-4d79-9166-e85112f57d7d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.513452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1102/2180] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:45.513452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.514971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.514971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.514971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.514971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] PATH_INFO: `/v3/projects/88349c2d730a430f8ae0db8e58067bce/users/469238a8747940b181fb26ebac94c99d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.522046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88349c2d730a430f8ae0db8e58067bce, user_id=469238a8747940b181fb26ebac94c99d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.525030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.542441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11913e63-2b8e-416b-8865-e47de25ac6a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.547084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1079/2181] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:45 2022] PUT /identity/v3/projects/88349c2d730a430f8ae0db8e58067bce/users/469238a8747940b181fb26ebac94c99d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:45.548755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.656221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07042df-3c7d-41f1-a449-444eedfb5dc0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.674720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.675711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.676004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.676330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.677039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.678978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6353993-7be3-4944-962c-fac1392582c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.707663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1080/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:45.710001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b781-d4b0-4a44-816c-a5c6a646746a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.710302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b781-d4b0-4a44-816c-a5c6a646746a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.710582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b781-d4b0-4a44-816c-a5c6a646746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.793350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b474b781-d4b0-4a44-816c-a5c6a646746a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:45.793350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b474b781-d4b0-4a44-816c-a5c6a646746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.829734 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1081/2183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:45.831410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.831753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.832017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.850877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.853014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.853245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.853638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.855559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.859993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.896968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1103/2184] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:45.896968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:45.933763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] MFA Rules not processed for user `469238a8747940b181fb26ebac94c99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:45.934054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2393ae-d700-46ef-85aa-365a7936c78a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:45.938453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:45.947350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448679-469e-4528-8087-39de483a381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:45.948519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448679-469e-4528-8087-39de483a381e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:45.949168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448679-469e-4528-8087-39de483a381e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:45.949808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448679-469e-4528-8087-39de483a381e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:45.952705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448679-469e-4528-8087-39de483a381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:45.956475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448679-469e-4528-8087-39de483a381e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:45.995324 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1104/2185] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:45.997125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448679-469e-4528-8087-39de483a381e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:46.037763 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:46.057731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448679-469e-4528-8087-39de483a381e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:46.067435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:46.068623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:46.069127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:46.069881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:46.071257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:46.071801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:46.075650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:46.124357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1105/2186] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:46.126754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:46.151732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed85b9-2d49-44cb-9285-05c4743c7d3c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:46.161836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:46.163382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:46.163963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:46.164494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] PATH_INFO: `/v3/projects/c5ad59aa24a04640b6b79966d1eef329/users/7f4c38fddc7e427ca24266939aa67d13/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:46.229075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ad59aa24a04640b6b79966d1eef329, user_id=7f4c38fddc7e427ca24266939aa67d13, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:46.233455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1082/2187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:46.235117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:46.235941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:46.269754 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1106/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:46 2022] PUT /identity/v3/projects/c5ad59aa24a04640b6b79966d1eef329/users/7f4c38fddc7e427ca24266939aa67d13/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:46.270890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:46.288888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86549b-6f1b-40a8-9043-f9daa838cd78 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:46.499839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:46.502688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077a424-a257-46cf-a431-89a55c686930 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:46.511111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:46.511736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:46.513460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] PATH_INFO: `/v3/projects/81ae1333727f4b3f93a5a473981243b4/users/eb6ccf9572bb43fe90785249bb9ea41f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:46.518546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:46.520948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:46.523364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:46.524295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:46.529239 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:46.555484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:46.568223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268a0f5-ac15-4da6-81da-0a1e20fb75d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:46.586415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ae1333727f4b3f93a5a473981243b4, user_id=eb6ccf9572bb43fe90785249bb9ea41f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:46.605516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:46.672370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1083/2189] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:46 2022] PUT /identity/v3/projects/81ae1333727f4b3f93a5a473981243b4/users/eb6ccf9572bb43fe90785249bb9ea41f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:46.678256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:46.686031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:46.703176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1107/2190] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:46.707721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17965f0-4331-4ee6-85f6-7b4f095a91a9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:46.713597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17965f0-4331-4ee6-85f6-7b4f095a91a9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:46.714364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17965f0-4331-4ee6-85f6-7b4f095a91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:46.823230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d17965f0-4331-4ee6-85f6-7b4f095a91a9 None None] MFA Rules not processed for user `7f4c38fddc7e427ca24266939aa67d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:46.826244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d17965f0-4331-4ee6-85f6-7b4f095a91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:47.098091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af716b-ae76-4ad2-a94e-1c8151a366f6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:47.118608 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1108/2191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:47.123939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:47.126658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:47.127260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:47.246078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] MFA Rules not processed for user `eb6ccf9572bb43fe90785249bb9ea41f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:47.248146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:47.361692 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:47.429641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:47.430396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:47.430866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:47.431546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:47.486954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1109/2192] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:47.492466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:47.675943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:47.683409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:47.697440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a8239-9b47-4b2d-8f49-0633522c9d04 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:47.716781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:47.717939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:47.718440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:47.719526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:47.723944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:47.730014 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1084/2193] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 1056 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:47.734219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:47.737922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:47.776930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a6b4c-2840-4bd0-a313-bd93592b9f6f service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:47.803259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:47.804379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:47.804886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:47.806243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:47.806611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:47.820993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:47.821288 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1110/2194] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:47 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:47.821288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:47.863291 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:47.874387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddcac1-2fd6-4047-aa28-23195d7789e1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:47.905133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:47.918643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:47.919909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:47.920778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:47.928803 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1085/2195] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:47.930382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:47.934006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:47.949813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.089668 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1111/2196] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:47 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:48.094932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.266952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3d5fb-1969-4f83-a516-c18e33a73b35 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.389916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25152a38-151d-4438-929e-4577eba7e465 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.419714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.420932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.421568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.422133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.423449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.436139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.494223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.495527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.496142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.496728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.498187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.501650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.505116 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1112/2197] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:48 2022] POST /identity/v3/users => generated 300 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:48.512786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.534678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1086/2198] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 604 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:48.535381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.546224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b374-87de-476b-aacb-bab6043df823 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.566619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6556cb-435a-4d3b-bd27-c2ea95e52f1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.570316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.570971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.571256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.571550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.575257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.577310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.595294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.596557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.597208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.598689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] PATH_INFO: `/v3/users/247005eefb314b679f4fdd16768fd990` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.600485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247005eefb314b679f4fdd16768fd990)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.603982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.634983 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1113/2199] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:48 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:48.635550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.664281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f26d-5923-4a74-98c9-aaf80828ae68 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.696448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.697503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.698083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.698489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.699753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.704270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.716560 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:48.749237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1114/2200] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:48.751072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.765890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11814e6c-7caa-4a4a-97d7-6e3a6972714f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.772922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.773945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.774229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.774500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.775684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.777775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.790611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247005eefb314b679f4fdd16768fd990'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:48.795024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247005eefb314b679f4fdd16768fd990'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:48.796815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1115/2201] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:48.797852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.801378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:48.820965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247005eefb314b679f4fdd16768fd990'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:48.827636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6e26-2f8c-4c87-b0dc-488046d0159d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.847287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.847942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.848225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.848503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.849301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.854797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:48.878077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247005eefb314b679f4fdd16768fd990'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:48.878593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1116/2202] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:48.879433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.880560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247005eefb314b679f4fdd16768fd990'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:48.881593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:48.900337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d208c-e3d1-41f1-b4ed-ac4fc99a6ace admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:48.907910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:48.908776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:48.909085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:48.909593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] PATH_INFO: `/v3/projects/e88f6308d9e74f85b6294da59421e875/users/062cf999a8f24d179d6d0fa0784035eb/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:48.937970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1087/2203] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:48 2022] DELETE /identity/v3/users/247005eefb314b679f4fdd16768fd990 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:48.940201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:48.943830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:48.945151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88f6308d9e74f85b6294da59421e875, user_id=062cf999a8f24d179d6d0fa0784035eb, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:48.948645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:49.002209 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:49.009182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1117/2204] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:48 2022] PUT /identity/v3/projects/e88f6308d9e74f85b6294da59421e875/users/062cf999a8f24d179d6d0fa0784035eb/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:49.009182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:49.155951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275e2c-65c9-49d0-bb54-14043980e735 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:49.192057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ffe4-e9d1-4756-9c4c-3363e0316034 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:49.213580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:49.214921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.215113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.215343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] PATH_INFO: `/v3/projects/ea34cf39b5ce406e9459536d9f36900c/users/7e2bc0d9b71d4b1d8304be398c20d326/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.257189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea34cf39b5ce406e9459536d9f36900c, user_id=7e2bc0d9b71d4b1d8304be398c20d326, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:49.260435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f42a0-d947-4083-a865-8c9c28862cc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:49.289070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1118/2205] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:49 2022] PUT /identity/v3/projects/ea34cf39b5ce406e9459536d9f36900c/users/7e2bc0d9b71d4b1d8304be398c20d326/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:49.291599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.292137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.292624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.293305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:49.294166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.294434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.294719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] PATH_INFO: `/v3/projects/065df012fefb435e9a3329b6b1b51b4a/users/f8c135c37b804252a8275d28972d8c31/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.331028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065df012fefb435e9a3329b6b1b51b4a, user_id=f8c135c37b804252a8275d28972d8c31, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:49.338606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:49.343925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:49.345197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:49.364151 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1088/2206] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:48 2022] PUT /identity/v3/projects/065df012fefb435e9a3329b6b1b51b4a/users/f8c135c37b804252a8275d28972d8c31/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:49.366730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:49.572515 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1119/2207] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:49.572515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:49.596131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7f4da-1ef8-4ccb-895e-e1c4c4ceee0a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:49.604921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b87a9-b8c8-4aa4-94b5-0c580dd25315 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:49.616289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:49.618640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.619201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.619699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.620999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:49.625266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c587-04f0-42ac-ae03-41d7b251d502 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:49.630420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:49.631514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.632378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.632975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.637396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:49.650974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:49.666730 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1120/2208] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:49.667341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.667819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.668262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.690902 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1089/2209] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:49.707358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:49.713061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:49.789553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] MFA Rules not processed for user `f8c135c37b804252a8275d28972d8c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:49.795907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:49.826499 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:49.855003 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:49.936257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbf5a-325e-4476-9aa9-947a4e79735b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:49.948131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:49.955021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:49.957793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:49.958280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:49.978864 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1121/2210] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:49.989582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:50.005464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:50.012972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:50.043466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1bd84-9e63-4be9-8cf0-1c07095e18ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:50.063769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1090/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:50.064901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:50.067631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:50.080556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.081068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.081580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] PATH_INFO: `/v3/projects/ea34cf39b5ce406e9459536d9f36900c/users/7e2bc0d9b71d4b1d8304be398c20d326/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.086897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea34cf39b5ce406e9459536d9f36900c, user_id=7e2bc0d9b71d4b1d8304be398c20d326, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:50.098172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:50.105253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2e16-d932-4816-85b0-6d1653b2abae service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:50.118005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:50.118727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.119014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.119265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] PATH_INFO: `/v3/projects/e88f6308d9e74f85b6294da59421e875/users/062cf999a8f24d179d6d0fa0784035eb/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.128703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88f6308d9e74f85b6294da59421e875, user_id=062cf999a8f24d179d6d0fa0784035eb, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:50.148928 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1122/2212] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:49 2022] PUT /identity/v3/projects/ea34cf39b5ce406e9459536d9f36900c/users/7e2bc0d9b71d4b1d8304be398c20d326/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:50.150721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:50.153132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63266-56c4-4d4d-9d7a-368ef066ed6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:50.209815 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1091/2213] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:50 2022] PUT /identity/v3/projects/e88f6308d9e74f85b6294da59421e875/users/062cf999a8f24d179d6d0fa0784035eb/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:50.213457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.217666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.219167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.308673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ae84-6095-4ada-9b9a-704570b94de4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:50.339909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] MFA Rules not processed for user `7e2bc0d9b71d4b1d8304be398c20d326`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:50.343229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:50.520905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:50.524401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.524791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.525174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.527056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:50.533685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6df7b-e1d3-4894-b70a-bdb4efd79bf1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:50.648053 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1123/2214] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:50 2022] POST /identity/v3/projects => generated 387 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:50.651000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.651635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.652245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.664375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1092/2215] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:50.666095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:50.691814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5505e-7bc3-4590-90da-5aaba345dc68 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:50.716641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] MFA Rules not processed for user `062cf999a8f24d179d6d0fa0784035eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:50.722268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:50.800829 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:50.971831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:50.972972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:50.973505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:50.973980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:50.975891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:50.983753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.002548 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1124/2216] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:51.047472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.050025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:51.080253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1093/2217] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:50 2022] POST /identity/v3/users => generated 300 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:51.081973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.121247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd8179-7e25-468e-9e36-da11efe4fd3f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.150203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.151266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.151759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.152245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.153615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:51.156766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.210909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1094/2218] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:51.213249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.246489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2c5a8-facd-48a6-8e89-0714b1d44f46 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.284133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.286105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.286105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.286372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] PATH_INFO: `/v3/projects/07de72db09664c1fa135a784f54b3cab/users/09a8ec918453488f85edc4a79af2b11d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.363757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07de72db09664c1fa135a784f54b3cab, user_id=09a8ec918453488f85edc4a79af2b11d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:51.368076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f118173-f913-4dc3-87ac-93c2b0b2db40 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.370230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.392872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.394940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.395661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.396163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.399796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:51.438717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1095/2219] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:51 2022] PUT /identity/v3/projects/07de72db09664c1fa135a784f54b3cab/users/09a8ec918453488f85edc4a79af2b11d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:51.440313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.454012 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:51.563788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:51.566270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.584141 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1125/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:51.628595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.647793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de11a-ec5f-4482-a6c0-28e44cdd9734 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.661152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.662456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ee69b-74d2-43a5-a88b-46494b6bb9eb service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.663701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.664212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.664776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.666414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:51.670446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.690931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.691658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.691949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.692222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] PATH_INFO: `/v3/users/eb6ccf9572bb43fe90785249bb9ea41f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.699709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6ccf9572bb43fe90785249bb9ea41f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:51.701343 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1096/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:51.703428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.709904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:51.842395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6ccf9572bb43fe90785249bb9ea41f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:51.848226 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:51.872785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6ccf9572bb43fe90785249bb9ea41f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:51.878750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed743f2-6614-4cad-9c15-9248c822d31c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:51.888697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:51.889719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:51.890005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:51.890270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:51.912278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6ccf9572bb43fe90785249bb9ea41f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:51.913346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6ccf9572bb43fe90785249bb9ea41f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:51.914085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6ccf9572bb43fe90785249bb9ea41f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:51.964739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1126/2222] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:51 2022] DELETE /identity/v3/users/eb6ccf9572bb43fe90785249bb9ea41f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:51.965670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:51.967277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:52.003514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:52.005358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b5d1-4ad7-49b9-8fd5-84f355bb1c98 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:52.049016 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1097/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:52.054695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4028-373f-479c-b979-e236254a30be None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:52.055001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4028-373f-479c-b979-e236254a30be None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:52.055345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4028-373f-479c-b979-e236254a30be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:52.117451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d20e4028-373f-479c-b979-e236254a30be None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:52.118335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d20e4028-373f-479c-b979-e236254a30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:52.166252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30c91a-53ab-4c0f-961d-98797ab50034 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:52.181968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:52.182686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:52.183140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:52.183453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] PATH_INFO: `/v3/projects/07de72db09664c1fa135a784f54b3cab/users/09a8ec918453488f85edc4a79af2b11d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:52.189758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07de72db09664c1fa135a784f54b3cab, user_id=09a8ec918453488f85edc4a79af2b11d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:52.192779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87554a-a42c-4ff3-89f1-1d7bdf4c7a51 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:52.206550 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:52.239268 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1127/2224] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:51 2022] PUT /identity/v3/projects/07de72db09664c1fa135a784f54b3cab/users/09a8ec918453488f85edc4a79af2b11d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:52.248548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24320444-3aa9-4f6f-8320-b914e05c0803 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:52.250437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24320444-3aa9-4f6f-8320-b914e05c0803 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:52.251327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24320444-3aa9-4f6f-8320-b914e05c0803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:52.313283 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1098/2225] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:52.380050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4028-373f-479c-b979-e236254a30be None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:52.383118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d20e4028-373f-479c-b979-e236254a30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:52.450808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-24320444-3aa9-4f6f-8320-b914e05c0803 None None] MFA Rules not processed for user `09a8ec918453488f85edc4a79af2b11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:52.455092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24320444-3aa9-4f6f-8320-b914e05c0803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:52.580419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4028-373f-479c-b979-e236254a30be None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:52.752525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1128/2226] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:52.754194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:52.754496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:52.754776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:52.793255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:52.794354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:52.794866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:52.795351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:52.830966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] MFA Rules not processed for user `f8c135c37b804252a8275d28972d8c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:52.835658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:53.005348 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:53.062590 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1129/2227] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:53.101092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:53.106121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:53.135532 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1099/2228] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:53.519368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:53.522092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:53.765746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564e21-1c43-42be-b70f-296ffc11d7a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:53.776086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:53.776750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:53.777037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:53.777312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:53.785056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:53.802646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:53.804585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:53.821022 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1130/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:01:53.856626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:53.859496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:53.927276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d819e-97b4-410b-90e0-77e26a977040 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:53.961421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:53.963413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:53.972552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:53.973094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:53.978658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:54.101454 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:54.184218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:54.186817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1dad9-ca8c-433d-8536-b48e84aacf88 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:54.203516 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1100/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:54.929043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:54.931344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:54.962675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521628-e5bf-4644-8b70-7d96bcf433aa service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:54.977306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:54.981107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:54.981820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:54.982310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] PATH_INFO: `/v3/projects/9d23fa7f49774253bbd383006204b043` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:54.987442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d23fa7f49774253bbd383006204b043)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:54.995468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:55.002408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:55.003048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:55.003381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:55.141390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] MFA Rules not processed for user `170ea9ab3d444c28bdd566817773f3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:55.151646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:55.152549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d23fa7f49774253bbd383006204b043', 'request_id': 'req-e28b1477-e583-4144-b8a9-4380e77e3c66'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.177584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d23fa7f49774253bbd383006204b043', 'request_id': 'req-e28b1477-e583-4144-b8a9-4380e77e3c66'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.217312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d23fa7f49774253bbd383006204b043', 'request_id': 'req-e28b1477-e583-4144-b8a9-4380e77e3c66'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.260685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] The token cache is being invalidate because project 9d23fa7f49774253bbd383006204b043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:55.261577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.265633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.278444 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1131/2231] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:54 2022] DELETE /identity/v3/projects/9d23fa7f49774253bbd383006204b043 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:01:55.282787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:55.286220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:55.410181 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1101/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:55.505163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1477-e583-4144-b8a9-4380e77e3c66 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:55.533106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:55.534172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:55.534689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:55.535064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] PATH_INFO: `/v3/users/469238a8747940b181fb26ebac94c99d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:55.539418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469238a8747940b181fb26ebac94c99d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:55.542423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:55.545932 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:55.623825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:55.625585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:55.688293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469238a8747940b181fb26ebac94c99d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.707265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469238a8747940b181fb26ebac94c99d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.790433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469238a8747940b181fb26ebac94c99d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.792209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469238a8747940b181fb26ebac94c99d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.793778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edba03-0047-4949-9c61-dae449f35d61 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:55.793934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469238a8747940b181fb26ebac94c99d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:55.801607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:55.803238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:55.804373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:55.804373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:55.810405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:55.837011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:55.845274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1132/2233] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:55 2022] DELETE /identity/v3/users/469238a8747940b181fb26ebac94c99d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:55.852011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:55.856608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:55.856934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:55.885607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1102/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:56.093188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695944a-32b4-4bec-846a-54dd5e8bc231 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:56.106102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:56.106842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:56.107129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:56.107410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] PATH_INFO: `/v3/projects/81ae1333727f4b3f93a5a473981243b4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:56.108703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ae1333727f4b3f93a5a473981243b4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:56.111146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:56.260373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ae1333727f4b3f93a5a473981243b4', 'request_id': 'req-7b15653b-a62b-4cbf-a96a-7b471b89b24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.276470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ae1333727f4b3f93a5a473981243b4', 'request_id': 'req-7b15653b-a62b-4cbf-a96a-7b471b89b24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.298788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ae1333727f4b3f93a5a473981243b4', 'request_id': 'req-7b15653b-a62b-4cbf-a96a-7b471b89b24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.347693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] The token cache is being invalidate because project 81ae1333727f4b3f93a5a473981243b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:56.348592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.351687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.354743 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1133/2235] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:55 2022] DELETE /identity/v3/projects/81ae1333727f4b3f93a5a473981243b4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:56.359608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:56.379211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6645c-fde0-4c7d-a96b-f7d2534dda70 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:56.513832 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:56.533233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:56.534158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:56.534779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:56.535204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] PATH_INFO: `/v3/users/7e2bc0d9b71d4b1d8304be398c20d326` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:56.537265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2bc0d9b71d4b1d8304be398c20d326)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:56.540392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:56.681724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:56.687711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:56.691546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2bc0d9b71d4b1d8304be398c20d326'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.694176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2bc0d9b71d4b1d8304be398c20d326'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.732740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15653b-a62b-4cbf-a96a-7b471b89b24a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:56.740269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2bc0d9b71d4b1d8304be398c20d326'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.740816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:56.741811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:56.742601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:56.742961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] PATH_INFO: `/v3/projects/88349c2d730a430f8ae0db8e58067bce` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:56.744645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88349c2d730a430f8ae0db8e58067bce)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:56.748143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:56.752443 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:56.782715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2bc0d9b71d4b1d8304be398c20d326'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.784453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0209d44-72d4-40af-9632-0cde859e4801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2bc0d9b71d4b1d8304be398c20d326'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.832396 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1103/2236] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:01:56 2022] DELETE /identity/v3/users/7e2bc0d9b71d4b1d8304be398c20d326 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:56.927599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88349c2d730a430f8ae0db8e58067bce', 'request_id': 'req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.938241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88349c2d730a430f8ae0db8e58067bce', 'request_id': 'req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:56.953795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88349c2d730a430f8ae0db8e58067bce', 'request_id': 'req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.001813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] The token cache is being invalidate because project 88349c2d730a430f8ae0db8e58067bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:57.002220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.008044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b7c7876a-b9cc-485f-9b20-ea8a0e1a1904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.011527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1134/2237] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:56 2022] DELETE /identity/v3/projects/88349c2d730a430f8ae0db8e58067bce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:57.019934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.020227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.020687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.076396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:57.082285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.286821 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1104/2238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:57.295791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.297234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.297950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.311273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:57.314835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.372757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:57.378011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162241-4abe-4ff5-b14f-29ed1a52baa8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:57.379716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.401362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:57.401731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1135/2239] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:57.403020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.406053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.406545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] PATH_INFO: `/v3/projects/ea34cf39b5ce406e9459536d9f36900c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.408465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea34cf39b5ce406e9459536d9f36900c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:57.408813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:57.421070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:57.436669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64113f-c8f8-47f9-a00a-b3d098176785 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:57.448612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:57.450535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.453238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.453699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.454572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:57.455007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:57.460664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:57.496939 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1136/2240] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:57.498554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:57.512539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7b85-bbea-41a8-838d-15c0edc046a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:57.541822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea34cf39b5ce406e9459536d9f36900c', 'request_id': 'req-9cd6c137-123e-46df-ab48-89f0f4809185'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.559897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea34cf39b5ce406e9459536d9f36900c', 'request_id': 'req-9cd6c137-123e-46df-ab48-89f0f4809185'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.577008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea34cf39b5ce406e9459536d9f36900c', 'request_id': 'req-9cd6c137-123e-46df-ab48-89f0f4809185'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.585102 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:57.624936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] The token cache is being invalidate because project ea34cf39b5ce406e9459536d9f36900c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:01:57.625520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.626807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9cd6c137-123e-46df-ab48-89f0f4809185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:01:57.640236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:57.641035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.641508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.642821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.643336 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1105/2241] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:01:57 2022] DELETE /identity/v3/projects/ea34cf39b5ce406e9459536d9f36900c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:57.644704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:57.648265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:57.651993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5a05-2f0a-40e6-bde8-c01db653e5af None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.652466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5a05-2f0a-40e6-bde8-c01db653e5af None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.653208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5a05-2f0a-40e6-bde8-c01db653e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.724875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-76ac5a05-2f0a-40e6-bde8-c01db653e5af None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:57.728073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-76ac5a05-2f0a-40e6-bde8-c01db653e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.750367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1137/2242] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:57.753999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:57.759079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.764585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1106/2243] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:01:57.779129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.779456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.779733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.838801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:57.840194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:57.927962 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:57.938939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2a47-121d-425d-8e87-f5d63b07249a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:57.957508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:57.960657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:57.961380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:57.962570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:57.964085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:57.969978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.024757 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1107/2244] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:58.026365 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1138/2245] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:57 2022] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:01:58.030312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.031709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.055284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca25672-3883-41c0-838e-d8d084dfd682 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.058039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af1fea-f3ac-41bf-a1bc-6b3fa3484c51 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.070910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.072351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.072654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.073343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.074088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.074597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.075160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.075733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.076415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.077051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:01:58.077677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.081115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.082844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.109792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1139/2246] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:58.116454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.123205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1108/2247] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:01:58.132474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.153695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c20039-03c1-4669-849a-07e7226789a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.171735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e4d3-81f0-464c-b387-d45a63f309ad admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.176499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.177714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.178236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.182626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.183914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.184167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.184568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.184821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.185115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.186238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.187879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.191828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.228982 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1140/2248] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:58.235597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.255080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896a11f-513c-4d93-ae8d-94059b5e5ad8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.267101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.268924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.269945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.270824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] PATH_INFO: `/v3/projects/ce74d459ddb341569f42818c99cbfcaa/users/fe77600029ff40f8b738c097bf184495/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.296900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1109/2249] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:58 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:58.299362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce74d459ddb341569f42818c99cbfcaa, user_id=fe77600029ff40f8b738c097bf184495, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.302711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.303836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7466d-05ec-4957-b8cd-1e5cad555855 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.338244 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1141/2250] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:58 2022] PUT /identity/v3/projects/ce74d459ddb341569f42818c99cbfcaa/users/fe77600029ff40f8b738c097bf184495/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:58.341142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.341661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.342698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.398682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:58.403185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:58.544099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb91bf-443b-4d5d-a514-3d739742e203 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.651060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1142/2251] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:58.670228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.672462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:58.700017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.700958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.701481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.702329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.703219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.708128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.723478 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:58.766516 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1110/2252] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:58 2022] POST /identity/v3/users => generated 297 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:58.769756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.790777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbcf60-1ffa-4118-a426-24d9e8bfe4b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.796513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.797240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.797569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.797952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.799802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.801911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.818323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1111/2253] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:58.827417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.842793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa7579-7304-488e-acd8-b19197abb104 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.849679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331d4e-068d-4623-9456-c756a14fd3fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.854778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.855382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.857326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.858652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.863255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.866059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.866923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.867740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.869574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.873947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79a2f4-5fb6-4062-8fd7-861e438c868c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.882386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.884054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:58.908183 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1143/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:58.909680 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1112/2255] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:01:58.913753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:58.925516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f1cab-10a8-4473-8a95-234b53599b6d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:58.938890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:58.939698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:58.940064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:58.949605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170/users/0b7b5f495d0642e7a9a22d36fd047d80/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:58.975202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fad5b693b748178d29d74b8db37170, user_id=0b7b5f495d0642e7a9a22d36fd047d80, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:58.981298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:59.006266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1144/2256] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:01:58 2022] PUT /identity/v3/projects/57fad5b693b748178d29d74b8db37170/users/0b7b5f495d0642e7a9a22d36fd047d80/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:01:59.029551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:59.030058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:59.031113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:59.151646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] MFA Rules not processed for user `0b7b5f495d0642e7a9a22d36fd047d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:01:59.157785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:01:59.452467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1113/2257] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:01:59.460192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:59.526249 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:59.611498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d1fab-a17a-46e7-acb2-81e46859b17b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:59.624477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:59.626436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:59.627160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:59.627681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:59.630458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:59.634249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:59.717596 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1145/2258] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:01:59 2022] POST /identity/v3/projects => generated 391 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:01:59.720415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:59.743175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5a086-b382-4605-9746-093e89f0ef75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:59.903199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:59.904049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:59.905449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:59.905449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:59.905449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:59.909804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:01:59.953461 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1114/2259] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:01:59 2022] POST /identity/v3/users => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:01:59.954752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:01:59.984138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269861a-aa27-4bd4-8bec-8a65cf0999e4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:01:59.991797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:01:59.992620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:01:59.992947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:01:59.993235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:01:59.993954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:01:59.996229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:00.013132 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1146/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:00.020637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:00.045170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab10a-e77c-4418-bbb6-aa559cc56816 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:00.058197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:00.059631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:00.063045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:00.063045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] PATH_INFO: `/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e/users/b7e34e5ca888434db19d7ab9139a30f7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:00.098040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d06f64c93c49af8d1e9d9c6cb46d4e, user_id=b7e34e5ca888434db19d7ab9139a30f7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:00.104782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:00.167302 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1115/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:00 2022] PUT /identity/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e/users/b7e34e5ca888434db19d7ab9139a30f7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:00.174028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:00.212176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5e67-7964-4b2a-a0d6-eab553a430d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:00.395868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:00.399718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:00.401617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:00.404550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:00.409196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:00.416917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1725d-a224-4e80-a7d5-3b271ad31f36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:00.480306 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1147/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:00.482373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:00.530625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb540-8dcc-4a52-8fd4-d70fdcda8095 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:00.551651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:00.556959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:00.560280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:00.560919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] PATH_INFO: `/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e/users/b7e34e5ca888434db19d7ab9139a30f7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:00.576231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d06f64c93c49af8d1e9d9c6cb46d4e, user_id=b7e34e5ca888434db19d7ab9139a30f7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:00.603109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:00.660766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1116/2263] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:00 2022] PUT /identity/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e/users/b7e34e5ca888434db19d7ab9139a30f7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:00.675738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:00.676052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:00.676673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:00.765451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] MFA Rules not processed for user `b7e34e5ca888434db19d7ab9139a30f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:00.768882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:00.881178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1148/2264] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:00.886185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:00.945187 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:01.205371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7d26-6816-4885-af71-bcc56a0b3855 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:01.215951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:01.217188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.217777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.218448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.220401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:01.226246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:01.319068 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1117/2265] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:00 2022] POST /identity/v3/projects => generated 395 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:01.324570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:01.351948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c13374-7f7e-4aae-a757-d8d6b9b4f49f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:01.395584 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:01.508620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:01.509446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.509857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.510236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.511016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:01.513585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:01.553254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1149/2266] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:01 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:01.557964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:01.587194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0232-497b-4e9f-8bde-0d652d5d5a23 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:01.616026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:01.619785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.620329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.620798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.636861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:01.638937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:01.674165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1118/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:01.674346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:01.693853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e45586-85ad-4f53-a4c9-f12adefbf74d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:01.711839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:01.712483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.712767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.713048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.713756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:01.715479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444be3-35d7-45a3-9312-9f5f77e53ce5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:01.748201 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1150/2268] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:01.752521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:01.768819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64cde3-d603-43fa-b389-bb7a438d9696 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:01.777701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:01.778831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.780541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.783625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] PATH_INFO: `/v3/projects/192c948ab03344b6b2b723333916a7d5/users/6c4dce30309342c39bd6adf91ea75069/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.821438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=192c948ab03344b6b2b723333916a7d5, user_id=6c4dce30309342c39bd6adf91ea75069, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:01.830037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:01.878975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1119/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:01 2022] PUT /identity/v3/projects/192c948ab03344b6b2b723333916a7d5/users/6c4dce30309342c39bd6adf91ea75069/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:01.887313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:01.890469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:01.890469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:01.966301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] MFA Rules not processed for user `6c4dce30309342c39bd6adf91ea75069`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:01.967603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:02.140686 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1151/2270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:03.263010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:03.265997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:03.480194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca914-6211-42c6-be58-b620b6cc7c2b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:03.493363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:03.494178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:03.494466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:03.494739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:03.646546 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:03.688369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:03.690581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07b0d-f2dd-48a7-87fa-01891fd48a19 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:03.709463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1120/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:05.062446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:05.064840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:05.078716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.079316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.079316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.081104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1121/2272] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:05.095452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:05.129285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:05.153031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cedbe-2cb0-43be-a6fe-f5a0a1d1dc8f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:05.173681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:05.174670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.175124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.175597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.177620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:05.180469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fcce8-8344-44fa-b915-4ae1a72a20be tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:05.182652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1122/2273] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:05 2022] GET /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 393 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:05.201164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323367d1-3a79-4c4f-b335-f2636394e91a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:05.222526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:05.223222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.223506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.224575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] PATH_INFO: `/v3/users/7f4c38fddc7e427ca24266939aa67d13` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.230117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4c38fddc7e427ca24266939aa67d13)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:05.232148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:05.307414 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:05.351024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4c38fddc7e427ca24266939aa67d13'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:05.378523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4c38fddc7e427ca24266939aa67d13'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:05.431470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4c38fddc7e427ca24266939aa67d13'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:05.433951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4c38fddc7e427ca24266939aa67d13'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:05.437331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4c38fddc7e427ca24266939aa67d13'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:05.470657 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1152/2274] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:05 2022] DELETE /identity/v3/users/7f4c38fddc7e427ca24266939aa67d13 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:05.471399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02267f5-63bf-472c-a6c7-722c5870364c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.471694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02267f5-63bf-472c-a6c7-722c5870364c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.471968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02267f5-63bf-472c-a6c7-722c5870364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.511311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c02267f5-63bf-472c-a6c7-722c5870364c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:05.512663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c02267f5-63bf-472c-a6c7-722c5870364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:05.689583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1123/2275] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:05.762224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:05.765319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:05.901392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5c480-d2e0-48b4-bf8e-1932cd74200e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:05.913814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:05.914469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.914751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.915030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.939100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:05.940779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db086d9e-c568-4707-b6c9-6d486b02115f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:05.947054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:05.947414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:05.947591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:05.950223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1124/2276] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:05.957679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:05.960045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:05.973489 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1153/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:06.109914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:06.114168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:06.298111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094594f-aa73-4d3e-8f4a-9284fddc221e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:06.310575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:06.311297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:06.311591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:06.311872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:06.313207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:06.315490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:06.331665 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1125/2278] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:05 2022] GET /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 393 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:06.441673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612468-6679-436e-a149-c6cbff25b3fc None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:06.442257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612468-6679-436e-a149-c6cbff25b3fc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:06.442257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612468-6679-436e-a149-c6cbff25b3fc None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:06.445953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1154/2279] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:06.454287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:06.456635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:06.489258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:06.511050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa42e7-bca7-4a31-8a9a-46388d479fd6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:06.527096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:06.528256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:06.528997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:06.529776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:06.533562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:06.536273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:06.539596 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1126/2280] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:06 2022] GET /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 393 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:07.607122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:07.607674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:07.607674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:07.668564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] MFA Rules not processed for user `fe77600029ff40f8b738c097bf184495`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:07.669926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:07.782174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1155/2281] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:07.788972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:07.792325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:07.812736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825792d-3d39-47db-ba27-186024295def tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:07.818902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:07.819810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:07.820273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:07.820539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:07.821368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:07.823576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:07.844576 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:07.881454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1127/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:07 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:07.883411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:07.900350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bef32-31b8-4e49-ba98-c74669fc1e9b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:07.959492 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:08.016270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:08.019007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:08.042049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.045818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.046591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.047146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.050975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.057203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:08.144519 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1156/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:07 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:08.146366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:08.294232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd802ca-217d-4267-aa8d-73dce83ea204 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:08.307905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.309179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.312950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.313268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] PATH_INFO: `/v3/projects/c5ad59aa24a04640b6b79966d1eef329` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.322366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ad59aa24a04640b6b79966d1eef329)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.326660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:08.342189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08139dff-834b-48fa-b8d7-c708c60e7ae1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:08.359184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.360587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.363170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.365201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.369631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:08.473739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ad59aa24a04640b6b79966d1eef329', 'request_id': 'req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.486938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ad59aa24a04640b6b79966d1eef329', 'request_id': 'req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.501681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ad59aa24a04640b6b79966d1eef329', 'request_id': 'req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.523624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] The token cache is being invalidate because project c5ad59aa24a04640b6b79966d1eef329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:08.524690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.525815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.533139 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1128/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:08 2022] DELETE /identity/v3/projects/c5ad59aa24a04640b6b79966d1eef329 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:08.533139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:08.536840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:08.591177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.592829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:08.644465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1157/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:08.646912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:08.673992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc69c6-ce72-47bc-b49f-cfadabccdf9b service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:08.742893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f770da-f6e9-4e97-af86-a1f0cc080a6f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:08.765820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.769125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.771586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.772636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.775640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.782614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:08.834252 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1129/2286] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:08.837148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:08.852684 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:08.867682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.869723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.872824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.873306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] PATH_INFO: `/v3/users/062cf999a8f24d179d6d0fa0784035eb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.878423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062cf999a8f24d179d6d0fa0784035eb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.881433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:08.882849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b4ff-e627-4671-85f1-dcdb5e3c20cf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:08.897448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:08.897993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:08.898355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:08.899185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] PATH_INFO: `/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c/users/d7f26fd1f30840e9b538809926776cd6/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:08.959975 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:08.974992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d97288012aa41b3bd2bf891ffb18e0c, user_id=d7f26fd1f30840e9b538809926776cd6, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:08.991380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062cf999a8f24d179d6d0fa0784035eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:08.995901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:09.014851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062cf999a8f24d179d6d0fa0784035eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:09.042741 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1130/2287] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:08 2022] PUT /identity/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c/users/d7f26fd1f30840e9b538809926776cd6/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:09.046910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:09.047707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062cf999a8f24d179d6d0fa0784035eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:09.049050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062cf999a8f24d179d6d0fa0784035eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:09.087160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062cf999a8f24d179d6d0fa0784035eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:09.122770 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1158/2288] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:08 2022] DELETE /identity/v3/users/062cf999a8f24d179d6d0fa0784035eb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:09.264786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9e23-6df2-4006-b392-6c40baa959bd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:09.367926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:09.368755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:09.369048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:09.369319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:09.370053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:09.371834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:09.397787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:09.399452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:09.401817 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1131/2289] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:09.417566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7076-7f2f-401a-93c1-b2339c0f8ce6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:09.433335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:09.434088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:09.434374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:09.434666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] PATH_INFO: `/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c/users/d7f26fd1f30840e9b538809926776cd6/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:09.444285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d97288012aa41b3bd2bf891ffb18e0c, user_id=d7f26fd1f30840e9b538809926776cd6, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:09.452402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199ae39-fb23-42e7-9053-6b08a17e75e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:09.493970 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1159/2290] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:09 2022] PUT /identity/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c/users/d7f26fd1f30840e9b538809926776cd6/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:10.120715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:10.123934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:10.197897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc4a3-d66f-4f82-947a-e4bb8095571e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:10.382890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:10.391004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:10.391004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:10.391004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] PATH_INFO: `/v3/projects/e88f6308d9e74f85b6294da59421e875` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:10.391741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88f6308d9e74f85b6294da59421e875)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:10.393427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:10.479064 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:10.495029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88f6308d9e74f85b6294da59421e875', 'request_id': 'req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:10.507480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88f6308d9e74f85b6294da59421e875', 'request_id': 'req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:10.521540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88f6308d9e74f85b6294da59421e875', 'request_id': 'req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:10.562060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] The token cache is being invalidate because project e88f6308d9e74f85b6294da59421e875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:10.562715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:10.563933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a5b5bda-8eb4-4536-b573-59fb0e364dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:10.565928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1132/2291] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:10 2022] DELETE /identity/v3/projects/e88f6308d9e74f85b6294da59421e875 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:10.570950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:10.574100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:10.574628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:10.613397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:10.616743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:10.789098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1160/2292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:10.798321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:10.798622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:10.798970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:10.828561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:10.830656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:10.845684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1133/2293] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:10.847222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:10.875888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff674d-acba-47d1-8e86-ca9880dbc533 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:10.894103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:10.894921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:10.895268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:10.895600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:10.901591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:10.902939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:10.906353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:10.930524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1161/2294] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:10.935068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:10.946711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6991-6eaf-443f-aed8-6f8969a99a4c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:10.951820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:10.952503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:10.952789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:10.953062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:10.954317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:10.956360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:11.033556 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1134/2295] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:10 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:11.036147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:11.062000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2faeb4-fcd6-4053-af60-0c80c953a1cc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:11.304697 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:11.353133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:11.357780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:11.359080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:11.360511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:11.367529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:11.374746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:11.459625 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1162/2296] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:11 2022] POST /identity/v3/users => generated 286 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:11.474123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:11.501055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3df65-1f7a-4669-91df-2eb8118ed237 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:11.510592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:11.511744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:11.512535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:11.513281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:11.515564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:11.519628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:11.551141 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1135/2297] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:11.557567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:11.586852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64d51-5d4e-497a-98b3-121ff7a95c2b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:11.596181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:11.597370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:11.598067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:11.598961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:11.601156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:11.613188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213a26-5f9f-4ed6-b7a6-6ebffcdf2542 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:11.649148 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1163/2298] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:11.656006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:11.676345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd908-cbb3-40b8-a601-efc9195c3a21 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:11.692051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:11.702294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:11.705891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:11.708358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] PATH_INFO: `/v3/projects/e42263190a6541e9806a02c6a522085a/users/6d4fa722f4b14ded9815ad596531951c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:11.786158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42263190a6541e9806a02c6a522085a, user_id=6d4fa722f4b14ded9815ad596531951c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:11.790814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:11.827517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1136/2299] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:11 2022] PUT /identity/v3/projects/e42263190a6541e9806a02c6a522085a/users/6d4fa722f4b14ded9815ad596531951c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:11.860546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:11.861968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:11.862561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:11.920982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] MFA Rules not processed for user `6d4fa722f4b14ded9815ad596531951c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:11.923144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:12.143976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1164/2300] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:12.149703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:12.399702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843630c2-141b-4715-9c3e-91825588451b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:12.451946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:12.452976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:12.453494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:12.454190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:12.455167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:12.459302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:12.572379 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1137/2301] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:12 2022] POST /identity/v3/projects => generated 373 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:12.573330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:12.610042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe8e8-8d46-40fd-949a-1edc1be39fdb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:12.726716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:12.727611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:12.727992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:12.729134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:12.729998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:12.732449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:12.797254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1165/2302] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:12 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:12.803939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:12.832136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b41fc-815c-4f19-8e1a-bd31d6acb1e1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:12.844916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:12.846419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:12.847413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:12.848433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:12.851621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:12.872321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:12.928373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:12.929272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1138/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:12.973913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849691a-f5cc-4167-940f-a5fdeeb135f3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:12.997445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:12.997445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:12.997445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:12.997445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] PATH_INFO: `/v3/projects/6c9fd28816a843f1b094e585fb555257/users/ee0a7f375b5a4f77b11955dfd8bd4487/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:13.064952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9fd28816a843f1b094e585fb555257, user_id=ee0a7f375b5a4f77b11955dfd8bd4487, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:13.068167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:13.118401 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1166/2304] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:12 2022] PUT /identity/v3/projects/6c9fd28816a843f1b094e585fb555257/users/ee0a7f375b5a4f77b11955dfd8bd4487/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:13.123280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:13.144398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bbfbe-1b6e-470a-928e-d09e157a3f3e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:13.222074 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:13.304934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:13.306886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:13.309423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:13.310438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:13.312214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:13.318905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4817-1cee-4daa-b4bc-0629e724fb5f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:13.350082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:13.350738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1139/2305] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:13.364557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038415f4-8e67-433c-8535-7a173f36c24a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:13.371569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:13.372290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:13.372576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:13.372857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] PATH_INFO: `/v3/projects/6c9fd28816a843f1b094e585fb555257/users/ee0a7f375b5a4f77b11955dfd8bd4487/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:13.375937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9fd28816a843f1b094e585fb555257, user_id=ee0a7f375b5a4f77b11955dfd8bd4487, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:13.379132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:13.397462 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1167/2306] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:13 2022] PUT /identity/v3/projects/6c9fd28816a843f1b094e585fb555257/users/ee0a7f375b5a4f77b11955dfd8bd4487/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:13.409769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:13.413443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:13.413930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:13.460737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] MFA Rules not processed for user `ee0a7f375b5a4f77b11955dfd8bd4487`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:13.464204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:13.585729 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1140/2307] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:14.703973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:14.706302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:14.737799 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:14.850484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5bdfc-2fb5-485a-a717-72fab476d21a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:14.856783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:14.857500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:14.857759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:14.858036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:14.915405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:14.917074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:14.925348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:14.929135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:14.962593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1168/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:14.986322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ee8d3-ee08-485c-a4b6-47a5b270e7c0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:15.003495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:15.004168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:15.004446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:15.004715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:15.008731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:15.062468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:15.085780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e851be-e5ff-49ef-8aec-ccc416787913 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:15.106633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:15.107233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:15.107515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:15.107794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:15.111112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:15.156141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:15.158157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa605-5873-4ec9-9117-56408804ba93 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:15.204348 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1141/2309] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:15.283037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:15.284874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfe99-d326-466c-866c-39928907c0d6 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:15.303020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1169/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:15.351663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684d03-a2df-4efc-ae1b-d2cfb2f90ab9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:15.352281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684d03-a2df-4efc-ae1b-d2cfb2f90ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:15.354307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684d03-a2df-4efc-ae1b-d2cfb2f90ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:15.419789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-97684d03-a2df-4efc-ae1b-d2cfb2f90ab9 None None] MFA Rules not processed for user `54541ffbbb8d4f24a054d1d7a80f7152`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:15.422964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-97684d03-a2df-4efc-ae1b-d2cfb2f90ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:15.750794 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:15.782536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1142/2311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:19.296766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8546d-541a-499d-8a3a-2bef0ef8c275 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:19.297314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8546d-541a-499d-8a3a-2bef0ef8c275 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:19.297650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8546d-541a-499d-8a3a-2bef0ef8c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:19.309501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9785-13b3-436b-9cbd-684a33dac697 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:19.310028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9785-13b3-436b-9cbd-684a33dac697 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:19.310227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9785-13b3-436b-9cbd-684a33dac697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:19.372856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fbee9785-13b3-436b-9cbd-684a33dac697 None None] MFA Rules not processed for user `98ed412afded46c49d993a2749e42c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:19.374183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fbee9785-13b3-436b-9cbd-684a33dac697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:19.405637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-57f8546d-541a-499d-8a3a-2bef0ef8c275 None None] MFA Rules not processed for user `d7f26fd1f30840e9b538809926776cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:19.406922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57f8546d-541a-499d-8a3a-2bef0ef8c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:19.542233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1143/2312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:19.548898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:19.548999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:19.549253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:19.558944 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1144/2313] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:19.558944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:19.615633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:19.617527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:19.629630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1170/2314] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:19.651105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf33c-b827-4f7b-8f93-083af49255f4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:19.653934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf33c-b827-4f7b-8f93-083af49255f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:19.654642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf33c-b827-4f7b-8f93-083af49255f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:19.688130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-177cf33c-b827-4f7b-8f93-083af49255f4 None None] MFA Rules not processed for user `fe77600029ff40f8b738c097bf184495`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:19.690019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-177cf33c-b827-4f7b-8f93-083af49255f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:19.711184 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:19.758985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5532b-6ccd-4598-b324-81e1e45a5985 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:19.768723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:19.770067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:19.770351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:19.771232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:19.772719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:19.775465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:19.778959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1145/2315] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:19 2022] GET /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 393 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:19.812740 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1171/2316] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:20.734865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:20.749030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3b32-2df9-49ea-8042-c23a32224dfa tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:20.760626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:20.762460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:20.762939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:20.763212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:20.765420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:20.778430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:20.780348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f9063-b759-4faf-90e8-1dbf444abf3e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:20.792795 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1146/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:21.691734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:21.693395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:21.693395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:21.695811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1172/2318] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:21.706100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e053c-3e79-4a78-a5e6-c30630f31f48 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:21.706482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e053c-3e79-4a78-a5e6-c30630f31f48 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:21.707178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e053c-3e79-4a78-a5e6-c30630f31f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:21.773750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-357e053c-3e79-4a78-a5e6-c30630f31f48 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:21.776678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-357e053c-3e79-4a78-a5e6-c30630f31f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:21.889559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1147/2319] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:21.937030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:21.943380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:21.967575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921e736-b1b3-45b2-a656-2c0ee07c5cca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:21.981472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:21.982690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:21.982818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:21.982987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:22.001582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:22.008979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:22.045551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1173/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:23.804951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d911-520c-4cf5-8b20-55e1574d1052 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:23.806304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d911-520c-4cf5-8b20-55e1574d1052 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:23.806673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d911-520c-4cf5-8b20-55e1574d1052 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:23.808683 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1148/2321] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:23.816995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:23.849639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:23.891438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24abd-e66a-4da7-b84d-a1ca4fae6cd3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:23.907616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:23.912818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:23.919818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:23.920586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:23.924453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:23.927079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:23.937897 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1174/2322] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:23 2022] GET /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 393 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:25.217916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129d911-520c-4cf5-8b20-55e1574d1052 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:25.400265 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:25.499596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129d911-520c-4cf5-8b20-55e1574d1052 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:25.512019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954461-142b-478f-a445-86091567abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:25.512711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954461-142b-478f-a445-86091567abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:25.513054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954461-142b-478f-a445-86091567abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:25.513334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954461-142b-478f-a445-86091567abac admin admin] PATH_INFO: `/v3/users/6d4fa722f4b14ded9815ad596531951c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:25.520004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954461-142b-478f-a445-86091567abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4fa722f4b14ded9815ad596531951c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:25.523305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:25.526681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954461-142b-478f-a445-86091567abac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:25.552408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4473670-aad1-4db6-b269-9b6e5cb165c5 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:25.572475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:25.573113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:25.573395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:25.573692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:25.588060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:25.712592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b8954461-142b-478f-a445-86091567abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4fa722f4b14ded9815ad596531951c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:25.713985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b8954461-142b-478f-a445-86091567abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4fa722f4b14ded9815ad596531951c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:25.753271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b8954461-142b-478f-a445-86091567abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4fa722f4b14ded9815ad596531951c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:25.784184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:25.786580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b8b8a-9892-4415-a5cc-a0528a2e581f service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:25.795478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b8954461-142b-478f-a445-86091567abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4fa722f4b14ded9815ad596531951c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:25.796305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b8954461-142b-478f-a445-86091567abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4fa722f4b14ded9815ad596531951c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:25.823717 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1175/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:25.831024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1149/2324] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:25 2022] DELETE /identity/v3/users/6d4fa722f4b14ded9815ad596531951c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:25.832656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:25.833811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:25.834092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:25.889061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:25.890619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:26.045234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1176/2325] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:26.066576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954461-142b-478f-a445-86091567abac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:26.071404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b8954461-142b-478f-a445-86091567abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:26.204347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954461-142b-478f-a445-86091567abac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:26.214714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:26.216516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:26.229316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:26.229926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:26.290711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:26.292202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:26.320082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1150/2326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:26.806505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:26.808951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:26.834058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c64a0-c5c8-4818-800a-9abf1a37dbeb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:26.843186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:26.844367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:26.845192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:26.845997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] PATH_INFO: `/v3/projects/e42263190a6541e9806a02c6a522085a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:26.849464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42263190a6541e9806a02c6a522085a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:26.854188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:26.928073 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:26.955515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42263190a6541e9806a02c6a522085a', 'request_id': 'req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:26.969962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42263190a6541e9806a02c6a522085a', 'request_id': 'req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:26.985370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42263190a6541e9806a02c6a522085a', 'request_id': 'req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.010938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] The token cache is being invalidate because project e42263190a6541e9806a02c6a522085a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:27.011467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.013448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df627b5-1b37-4b81-8d1c-bb14ee682b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.017323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1177/2327] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:26 2022] DELETE /identity/v3/projects/e42263190a6541e9806a02c6a522085a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:27.022110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:27.040798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed13f-89ce-4c6a-93f0-fb0f3c30cfcb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:27.144153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:27.146097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:27.146634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:27.147176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] PATH_INFO: `/v3/users/ee0a7f375b5a4f77b11955dfd8bd4487` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:27.148960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0a7f375b5a4f77b11955dfd8bd4487)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:27.154784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:27.158977 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:27.283243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0a7f375b5a4f77b11955dfd8bd4487'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.283818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0a7f375b5a4f77b11955dfd8bd4487'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.300850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0a7f375b5a4f77b11955dfd8bd4487'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.318998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0a7f375b5a4f77b11955dfd8bd4487'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.320563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0a7f375b5a4f77b11955dfd8bd4487'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:27.344567 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1151/2328] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:27 2022] DELETE /identity/v3/users/ee0a7f375b5a4f77b11955dfd8bd4487 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:27.573787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08db6-5235-4085-9cc0-d12aa937bd10 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:27.574474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08db6-5235-4085-9cc0-d12aa937bd10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:27.574848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08db6-5235-4085-9cc0-d12aa937bd10 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:27.576334 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1178/2329] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:27.588635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:27.594015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:27.891649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:27.897007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:28.084452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:28.085519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:28.086125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:28.113324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] MFA Rules not processed for user `f8c135c37b804252a8275d28972d8c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:28.115977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:28.205147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58413a4-5179-4837-b482-c754eaa217b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:28.230164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e34e5ca888434db19d7ab9139a30f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:28.230965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:28.231285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:28.231690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] PATH_INFO: `/v3/projects/192c948ab03344b6b2b723333916a7d5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:28.233764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorizing `identity:get_project(project_id=192c948ab03344b6b2b723333916a7d5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:28.238868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94a6c-0e85-4c03-864e-7afbef7d492e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:28.257639 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1179/2330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:28.259669 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1152/2331] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:27 2022] GET /identity/v3/projects/192c948ab03344b6b2b723333916a7d5 => generated 395 bytes in 672 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:28.832629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:28.836838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:29.165312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089e71d-a53b-44fa-9059-56f52ec74596 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:29.202362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:29.203376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:29.203868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:29.213889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] PATH_INFO: `/v3/projects/6c9fd28816a843f1b094e585fb555257` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:29.217106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9fd28816a843f1b094e585fb555257)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:29.221096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:29.407770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9fd28816a843f1b094e585fb555257', 'request_id': 'req-83e5d86f-cc41-4b07-9855-3dea5ddd93da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:29.448668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9fd28816a843f1b094e585fb555257', 'request_id': 'req-83e5d86f-cc41-4b07-9855-3dea5ddd93da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:29.468282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9fd28816a843f1b094e585fb555257', 'request_id': 'req-83e5d86f-cc41-4b07-9855-3dea5ddd93da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:29.475351 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:29.552412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] The token cache is being invalidate because project 6c9fd28816a843f1b094e585fb555257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:29.553795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:29.555420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83e5d86f-cc41-4b07-9855-3dea5ddd93da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:29.568350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1180/2332] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:28 2022] DELETE /identity/v3/projects/6c9fd28816a843f1b094e585fb555257 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:29.571009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:29.573551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:29.574340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:29.672615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:29.675239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:29.695883 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:29.903446 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1153/2333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:29.911497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:29.911965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:29.912403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:29.958621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:29.961185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:29.981047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:29.992328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1181/2334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:30.000002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099e8ff-8b0b-4632-902b-ad3910d42748 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.008600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.009648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.010150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.010791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.012020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:30.012821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.016350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.081869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:30.089737 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1154/2335] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:30.101661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2079-6297-47b3-8f95-f63e98245940 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.121608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.124653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.125613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.126418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.133861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.146430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.200428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:30.214611 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1182/2336] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:30 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:30.227024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa0927-8389-4933-8d42-91d18f94c73a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.421772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.423361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.423361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.423929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.424797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.427288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.474756 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1155/2337] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:30 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:30.479187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:30.493441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b58e3-1548-4453-98d3-2a559c1298d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.499477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.500492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.500873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.501224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.502163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.504433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.523171 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1183/2338] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:30.525012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:30.541291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685465-6a48-4621-83a7-b08bdf2a8e1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.570825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.571844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.573155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.573626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.574529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.578202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed96c5-d9ab-4d6e-9f38-75b37662d6fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.620832 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1156/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:30.625310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:30.641076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59890cc-30e3-4800-9905-69390c9a7d01 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:30.655242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:30.656110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.656453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.656796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] PATH_INFO: `/v3/projects/b3c4b33490944982805caacf19fac329/users/b837dd692d2c4cf0ae6106c1459f4914/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.741145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c4b33490944982805caacf19fac329, user_id=b837dd692d2c4cf0ae6106c1459f4914, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:30.744178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:30.808709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1184/2340] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:30 2022] PUT /identity/v3/projects/b3c4b33490944982805caacf19fac329/users/b837dd692d2c4cf0ae6106c1459f4914/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:30.812502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:30.813858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:30.814220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:30.901915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] MFA Rules not processed for user `b837dd692d2c4cf0ae6106c1459f4914`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:30.904384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:31.034060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1157/2341] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:31.038752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:31.216646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809f95-db2d-4167-9877-f5c1a05ad7f3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:31.221936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:31.222722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:31.223000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:31.223791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:31.225315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:31.227852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:31.333853 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1185/2342] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:31 2022] POST /identity/v3/projects => generated 377 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:31.338994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:31.416837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90549e2-2498-4590-a1c2-5194ca6a232c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:31.465117 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:31.509960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:31.512678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:31.754720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:31.756938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:31.758259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:31.759128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:31.760405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:31.771251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:31.777793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e89e-260b-49ef-9f74-d121747ee871 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:31.805568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:31.806257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:31.806541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:31.813475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] PATH_INFO: `/v3/users/0b7b5f495d0642e7a9a22d36fd047d80` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:31.818551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7b5f495d0642e7a9a22d36fd047d80)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:31.820653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:31.877486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1158/2343] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:31 2022] POST /identity/v3/users => generated 295 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:31.881678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:31.897083 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=4,keystone:DELETE=2,keystone:SELECT=94 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:31.904514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf166f-7492-4fef-a926-51033fbae62c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:31.922725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:31.923453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:31.923740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:31.924015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:31.924705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:31.926698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:31.959538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1159/2344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:31.965379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:31.992489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171d5a-16c0-4cc7-8e17-3256a737bca9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:32.008506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:32.010825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.013500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.014205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] PATH_INFO: `/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac/users/f09382cdd438452ab095b3381c0b2dad/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.085996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a9a3fcc27f4156938ab4e3a3867dac, user_id=f09382cdd438452ab095b3381c0b2dad, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:32.127184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:32.138590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7b5f495d0642e7a9a22d36fd047d80'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:32.186075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7b5f495d0642e7a9a22d36fd047d80'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:32.194936 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1160/2345] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:31 2022] PUT /identity/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac/users/f09382cdd438452ab095b3381c0b2dad/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:32.212637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:32.254113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7b5f495d0642e7a9a22d36fd047d80'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:32.259841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7b5f495d0642e7a9a22d36fd047d80'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:32.261910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26ff4adc-a8d8-4c06-88e8-f1affa343596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7b5f495d0642e7a9a22d36fd047d80'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:32.307507 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1186/2346] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:31 2022] DELETE /identity/v3/users/0b7b5f495d0642e7a9a22d36fd047d80 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:32.310454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.312032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.314044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.400443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:32.401724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:32.469884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6b1a0-4329-4b8d-9132-122ccf152f4a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:32.581860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:32.582489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.583735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.584151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.585471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:32.587461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:32.592614 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1187/2347] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:32.603350 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1161/2348] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:32.604532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:32.606003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:32.614935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:32.620380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:32.633906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6806-35dc-4b03-9bcc-45f74c688399 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:32.643642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:32.644283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.644591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.645589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] PATH_INFO: `/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac/users/f09382cdd438452ab095b3381c0b2dad/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.649055 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:32.650231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a9a3fcc27f4156938ab4e3a3867dac, user_id=f09382cdd438452ab095b3381c0b2dad, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:32.653788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8314a-514d-4e6a-bd7c-0ebc82082266 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:32.682697 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1188/2349] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:32 2022] PUT /identity/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac/users/f09382cdd438452ab095b3381c0b2dad/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:32.695019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.695444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.695728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.764192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] MFA Rules not processed for user `f09382cdd438452ab095b3381c0b2dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:32.765642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:32.786274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150f31-b5e7-4b1d-a0be-0e243ccf4f98 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:32.901009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:32.902936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:32.903228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:32.903503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:32.931656 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1189/2350] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:33.007475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:33.009746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be70cd-ad47-4a45-8225-8ebd1c776a62 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:33.022993 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1162/2351] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:33.224086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:33.226483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:33.234771 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:33.405931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d391e5-4e36-436b-84b5-14200a6a0cb5 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:33.406220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d391e5-4e36-436b-84b5-14200a6a0cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:33.406501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d391e5-4e36-436b-84b5-14200a6a0cb5 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:33.409388 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1163/2352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:02:33.414512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6138-3e5c-4b8c-83c6-97c8e31f9248 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:33.427732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:33.428802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:33.429344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:33.429862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:33.441019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:33.444040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:33.457024 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1190/2353] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:33.500675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:33.500979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:33.501151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:33.519385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:33.521688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:33.562131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45bb1-4c52-409a-a3a4-e97075bdbe34 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:33.569862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:33.571219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:33.583688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:33.584346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:33.584655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:33.584939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] PATH_INFO: `/v3/users/170ea9ab3d444c28bdd566817773f3c9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:33.586995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170ea9ab3d444c28bdd566817773f3c9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:33.589679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:33.699067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170ea9ab3d444c28bdd566817773f3c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:33.715590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170ea9ab3d444c28bdd566817773f3c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:33.731713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1164/2354] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:33.748540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170ea9ab3d444c28bdd566817773f3c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:33.749588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170ea9ab3d444c28bdd566817773f3c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:33.750275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170ea9ab3d444c28bdd566817773f3c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:33.778525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:33.779027 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1191/2355] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:33 2022] DELETE /identity/v3/users/170ea9ab3d444c28bdd566817773f3c9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:33.779523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:33.798392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7003-f22e-49cc-93c1-0b8a35feaf94 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:33.816739 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:33.910053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:33.911090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:33.911580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:33.912218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:33.914747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:33.934908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:33.938727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:33.961353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1165/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:34.117287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:34.119340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:34.209276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:34.210800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:34.273288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cddb3-fa90-4038-b17a-769a4dc01578 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:34.294188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:34.295332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.296593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.298122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] PATH_INFO: `/v3/projects/57fad5b693b748178d29d74b8db37170` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.301140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fad5b693b748178d29d74b8db37170)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:34.306756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:34.313360 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:34.419729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff492-2757-4dfd-bebf-a4380e9c022f service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:34.443230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fad5b693b748178d29d74b8db37170', 'request_id': 'req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.458952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fad5b693b748178d29d74b8db37170', 'request_id': 'req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.478212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fad5b693b748178d29d74b8db37170', 'request_id': 'req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.500797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] The token cache is being invalidate because project 57fad5b693b748178d29d74b8db37170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:34.501099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.502474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.505538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:34.506831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.507115 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1192/2357] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:34 2022] DELETE /identity/v3/projects/57fad5b693b748178d29d74b8db37170 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:34.507868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.508569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] PATH_INFO: `/v3/projects/adf199769d374f4a8de93bc25408c83a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.511352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf199769d374f4a8de93bc25408c83a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:34.511644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:34.513613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:34.515311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:34.545096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ff9fc-ab36-4c3e-8e17-f4a01490021a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:34.560282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:34.561566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.562087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.563038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] PATH_INFO: `/v3/users/b7e34e5ca888434db19d7ab9139a30f7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.565039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e34e5ca888434db19d7ab9139a30f7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:34.569208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:34.603560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf199769d374f4a8de93bc25408c83a', 'request_id': 'req-45852b16-9927-4236-b6e5-45f3ebc6acd6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.606659 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:34.616759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf199769d374f4a8de93bc25408c83a', 'request_id': 'req-45852b16-9927-4236-b6e5-45f3ebc6acd6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.623865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf199769d374f4a8de93bc25408c83a', 'request_id': 'req-45852b16-9927-4236-b6e5-45f3ebc6acd6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.640486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] The token cache is being invalidate because project adf199769d374f4a8de93bc25408c83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:34.640760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e34e5ca888434db19d7ab9139a30f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.640993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.641591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45852b16-9927-4236-b6e5-45f3ebc6acd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.649582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1166/2358] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:34 2022] DELETE /identity/v3/projects/adf199769d374f4a8de93bc25408c83a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:34.651417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.651766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.652091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.657663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e34e5ca888434db19d7ab9139a30f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.690522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e34e5ca888434db19d7ab9139a30f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.691828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:34.692825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e34e5ca888434db19d7ab9139a30f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.693529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca081fe1-dc0c-40b9-ba31-541ed3236dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e34e5ca888434db19d7ab9139a30f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:34.700128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:34.720080 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1193/2359] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:34 2022] DELETE /identity/v3/users/b7e34e5ca888434db19d7ab9139a30f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:34.815760 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1167/2360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:34.824637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.825017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.825248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.850005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:34.851238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:34.936864 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1194/2361] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:34.938212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:34.949455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de297d7-efc3-4113-a68c-d1795be7ceba None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:34.954440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:34.954838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:34.955403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:34.955403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:34.956041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:34.956334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:34.958793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:34.975230 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1168/2362] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:34.976451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:34.984016 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:34.987776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fba6fd-bdf7-444e-9a41-fc060c61c86c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.002518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.003378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.003749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.004113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.005818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.008329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.050229 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1195/2363] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:34 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:35.054961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.070755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115701-2c84-4ef3-9d19-11bb367fe6ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.203097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.203544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.203826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.204271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.210053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.221947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.290433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1169/2364] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:35 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:35.295080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.312591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2c98-6f29-4d2d-8710-ddec43d0dc10 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.319795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.322529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:35.326289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.330069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.330693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.331359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.333020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.337638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.339391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f355e42-56ab-4bdb-8f78-3d741da88c3d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.345895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.346757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.347121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.347432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] PATH_INFO: `/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.349848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d06f64c93c49af8d1e9d9c6cb46d4e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.352407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.367141 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1196/2365] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:35.371209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.398790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279354e9-6a35-451f-9933-dd081aa2fa3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.416863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.420777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.421501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.421992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.422978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.424918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.431295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'request_id': 'req-841e3183-ab83-4344-996a-bc9df79b4198'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.436228 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:35.446005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'request_id': 'req-841e3183-ab83-4344-996a-bc9df79b4198'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.454530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d06f64c93c49af8d1e9d9c6cb46d4e', 'request_id': 'req-841e3183-ab83-4344-996a-bc9df79b4198'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.463058 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1197/2366] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:35.464571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.466968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:35.481769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] The token cache is being invalidate because project 46d06f64c93c49af8d1e9d9c6cb46d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:35.482110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.482830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.484731 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1170/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:35 2022] DELETE /identity/v3/projects/46d06f64c93c49af8d1e9d9c6cb46d4e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:35.485810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cb4fd-a145-46d8-a1dc-4804383ef6f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.485945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.488413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:35.581501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.584384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.585294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.586049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] PATH_INFO: `/v3/users/b837dd692d2c4cf0ae6106c1459f4914` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.588781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b837dd692d2c4cf0ae6106c1459f4914)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.588956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3183-ab83-4344-996a-bc9df79b4198 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.592374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.594829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.595698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.596050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.596395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] PATH_INFO: `/v3/projects/298a602ff055472e9ac0f14f846f8160/users/5bfdfd44cd064a3f88e8a5c2a3b09307/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.628074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298a602ff055472e9ac0f14f846f8160, user_id=5bfdfd44cd064a3f88e8a5c2a3b09307, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.632403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.657458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1171/2368] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:35 2022] PUT /identity/v3/projects/298a602ff055472e9ac0f14f846f8160/users/5bfdfd44cd064a3f88e8a5c2a3b09307/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:35.657458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:35.667970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:35.700180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b837dd692d2c4cf0ae6106c1459f4914'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.718974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b837dd692d2c4cf0ae6106c1459f4914'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.742891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b837dd692d2c4cf0ae6106c1459f4914'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.745684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b837dd692d2c4cf0ae6106c1459f4914'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.747595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ab9886c-6be5-45a2-95bc-6859be03963b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b837dd692d2c4cf0ae6106c1459f4914'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.768350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1198/2369] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:35 2022] DELETE /identity/v3/users/b837dd692d2c4cf0ae6106c1459f4914 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:35.770921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95bef-146c-4ea3-9a4e-98c6add1d07d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.771919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95bef-146c-4ea3-9a4e-98c6add1d07d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.772247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95bef-146c-4ea3-9a4e-98c6add1d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.774913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2445-0e05-4ceb-aa56-e855d2f82ee8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:35.807135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cdf95bef-146c-4ea3-9a4e-98c6add1d07d None None] MFA Rules not processed for user `5bfdfd44cd064a3f88e8a5c2a3b09307`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:35.808431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cdf95bef-146c-4ea3-9a4e-98c6add1d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:35.842166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:35.842935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.843334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.844092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] PATH_INFO: `/v3/users/6c4dce30309342c39bd6adf91ea75069` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.845909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4dce30309342c39bd6adf91ea75069)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:35.848055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:35.870723 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:35.880981 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:35.974384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4dce30309342c39bd6adf91ea75069'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.976406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1199/2370] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:35.976919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4dce30309342c39bd6adf91ea75069'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:35.988981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:35.989265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:35.989594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:35.997569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4dce30309342c39bd6adf91ea75069'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:36.027134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4dce30309342c39bd6adf91ea75069'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:36.029797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4dce30309342c39bd6adf91ea75069'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:36.032984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:36.034317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:36.055242 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1200/2371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:36.056228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:36.061318 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1172/2372] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:35 2022] DELETE /identity/v3/users/6c4dce30309342c39bd6adf91ea75069 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:36.066956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:36.072475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:36.075053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:36.176995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d4782-3ae5-4439-bc18-5b514c0e1622 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:36.206760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a891e-83ca-4a43-92ca-9e710b9d047f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:36.224103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:36.225156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:36.225649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:36.226107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:36.248672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:36.249809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:36.250278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:36.251516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:36.254463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:36.333712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:36.335776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:36.353225 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1173/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:36.354478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:36.357482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4735-6b49-49e2-9724-3e105b4b642e service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:36.368657 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1201/2374] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:37.142889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.144391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.158102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5bc5-8308-4758-857c-07744acffc9e service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:37.163778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:37.164441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.164723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.165021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] PATH_INFO: `/v3/projects/192c948ab03344b6b2b723333916a7d5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.166284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] RBAC: Authorizing `identity:delete_project(project_id=192c948ab03344b6b2b723333916a7d5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:37.168274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:37.232133 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:37.253049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192c948ab03344b6b2b723333916a7d5', 'request_id': 'req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.269725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192c948ab03344b6b2b723333916a7d5', 'request_id': 'req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.286507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192c948ab03344b6b2b723333916a7d5', 'request_id': 'req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.304482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] The token cache is being invalidate because project 192c948ab03344b6b2b723333916a7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:37.305717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.306649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.308784 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1174/2375] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:37 2022] DELETE /identity/v3/projects/192c948ab03344b6b2b723333916a7d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:37.315050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f6c9-800a-44b3-8d24-9a44f94875cb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.315853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f6c9-800a-44b3-8d24-9a44f94875cb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.315853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f6c9-800a-44b3-8d24-9a44f94875cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.337828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c0a4f6c9-800a-44b3-8d24-9a44f94875cb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:37.339348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0a4f6c9-800a-44b3-8d24-9a44f94875cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.374619 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:37.418697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.420253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.485941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1202/2376] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:37.495466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.495763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.496218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.522233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:37.523462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.533741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1203/2377] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:37.538746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.546576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbfaa-49ea-4c9f-8e8f-95d3021c095d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:37.548078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21583fb-fa81-48b1-b375-eb68e301c9c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:37.552767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:37.553690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.554073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.554356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] PATH_INFO: `/v3/projects/b3c4b33490944982805caacf19fac329` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.554654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:37.555359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.555561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c4b33490944982805caacf19fac329)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:37.555734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.556121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.556857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:37.557225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:37.557890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:37.559017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:37.578525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1204/2378] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:02:37.580018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.607438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d234a-7e8f-4e74-a78f-f1676dca230e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:37.622400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:37.623206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.623815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.630747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.632308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:37.636195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c604-1343-4935-bdb4-204d7ba837e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:37.669517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c4b33490944982805caacf19fac329', 'request_id': 'req-49705dee-15ce-406e-aad0-e75de10e42d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.687321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1205/2379] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:37 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:37.687321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.687321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.687321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.688986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c4b33490944982805caacf19fac329', 'request_id': 'req-49705dee-15ce-406e-aad0-e75de10e42d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.703228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c4b33490944982805caacf19fac329', 'request_id': 'req-49705dee-15ce-406e-aad0-e75de10e42d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.708920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:37.710670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.725606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] The token cache is being invalidate because project b3c4b33490944982805caacf19fac329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:37.726150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.727138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:37.729588 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1175/2380] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:37 2022] DELETE /identity/v3/projects/b3c4b33490944982805caacf19fac329 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:37.730991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.732703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.806078 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:37.833527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705dee-15ce-406e-aad0-e75de10e42d6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:37.869162 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1206/2381] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:37.872980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:37.890616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:37.977517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:37.978633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:37.979155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:37.979477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:37.981295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:37.993001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.029134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1176/2382] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:37 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:38.033145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.049970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619ccca-0563-409b-a0e9-ab0f82b76549 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.056122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.056802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.057943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.058230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] PATH_INFO: `/v3/users/f09382cdd438452ab095b3381c0b2dad` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.059409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09382cdd438452ab095b3381c0b2dad)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.059714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e217-f2c3-4f5f-b0a8-7b3bddc133a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.062051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.065770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.066322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.066604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.067918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.068654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.070426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.083332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1177/2383] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:38.087503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.099547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662bd67-4502-46f2-9b4d-ff54436dbbcd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.109665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.110290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.111052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.111052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.111460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.113084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.119412 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:38.132384 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1178/2384] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:38.132384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.138899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.144829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09382cdd438452ab095b3381c0b2dad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.159967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09382cdd438452ab095b3381c0b2dad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.180152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09382cdd438452ab095b3381c0b2dad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.181325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09382cdd438452ab095b3381c0b2dad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.182066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09382cdd438452ab095b3381c0b2dad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.203131 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1207/2385] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:37 2022] DELETE /identity/v3/users/f09382cdd438452ab095b3381c0b2dad => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:38.203131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.203131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.265856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69b343-a665-4444-a6bb-7dbda4cc2269 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.277320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14e74-2d2b-4447-84bf-c2281fa44e16 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.283360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.284047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.284331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.284603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] PATH_INFO: `/v3/projects/79e048ceb3b94914b1c30609b2ef3b59/users/b20ae0370d8e4246a1d8a66da0fd70c9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.334185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e048ceb3b94914b1c30609b2ef3b59, user_id=b20ae0370d8e4246a1d8a66da0fd70c9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.338816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1191-1816-46fe-ba19-b3362c7bbf2e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.364740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.365350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1208/2386] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:38 2022] PUT /identity/v3/projects/79e048ceb3b94914b1c30609b2ef3b59/users/b20ae0370d8e4246a1d8a66da0fd70c9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:38.365491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.365765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.366039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.367901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.383493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.384724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.385261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.397256 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:38.436201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] MFA Rules not processed for user `b20ae0370d8e4246a1d8a66da0fd70c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:38.437723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.542716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1209/2387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:38.547586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.569666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.571567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.584978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1179/2388] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:38.617636 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:38.682810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.684630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.703745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2e609-c483-4c27-a82f-bcfdfafdd1c1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.709223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118ac1-727a-4e8f-b9b7-37521417123f service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.711623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.712329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.712687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.713756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.715193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.716244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.717024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.717979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.718103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.718198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] PATH_INFO: `/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.719234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a9a3fcc27f4156938ab4e3a3867dac)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.721937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:38.780398 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1210/2389] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:38 2022] POST /identity/v3/projects => generated 397 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:38.784455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:38.807239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a9a3fcc27f4156938ab4e3a3867dac', 'request_id': 'req-6fe37fc0-ba4f-426a-87be-0d7726d1646c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.819619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a9a3fcc27f4156938ab4e3a3867dac', 'request_id': 'req-6fe37fc0-ba4f-426a-87be-0d7726d1646c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.843746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a9a3fcc27f4156938ab4e3a3867dac', 'request_id': 'req-6fe37fc0-ba4f-426a-87be-0d7726d1646c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.865696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] The token cache is being invalidate because project 15a9a3fcc27f4156938ab4e3a3867dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:38.865990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.868080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6fe37fc0-ba4f-426a-87be-0d7726d1646c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:38.872760 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1180/2390] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:38 2022] DELETE /identity/v3/projects/15a9a3fcc27f4156938ab4e3a3867dac => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:38.878055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fcb3-7e16-40e8-933e-c717b512d49a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.878521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fcb3-7e16-40e8-933e-c717b512d49a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.878977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fcb3-7e16-40e8-933e-c717b512d49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.887663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172997df-5b49-440c-8016-f00c1ba3d573 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:38.915639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-91c3fcb3-7e16-40e8-933e-c717b512d49a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:38.917559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-91c3fcb3-7e16-40e8-933e-c717b512d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:38.962354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:38.962987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:38.963272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:38.963549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:38.964194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:38.966571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.025327 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1211/2391] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:38 2022] POST /identity/v3/users => generated 305 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:39.033517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.039425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:39.077650 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1181/2392] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:39.087642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ccaf-6e72-4439-8120-ffbcb300e279 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.087888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.088300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.088659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.095174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.095654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.095940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.096221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.097031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.098892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.121296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1212/2393] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:39.126122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.129021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:39.131383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:39.138764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761b6c-d275-4e61-8556-bb592d4c7abe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.141829 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1182/2394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:39.146188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.147811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.148541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.148832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.149108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] PATH_INFO: `/v3/projects/28ec6c075ebb4622888dac66ae31b7a5/users/272f6348db5a4e48b676a28fb4a269e3/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.159099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2df53-4d3c-4eea-bcb0-f7517e888970 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.165286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.166190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.166573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.166917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.167654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:39.168029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.170429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.170802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ec6c075ebb4622888dac66ae31b7a5, user_id=272f6348db5a4e48b676a28fb4a269e3, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.194589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.217978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1183/2395] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:39.220478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.230649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1213/2396] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:39 2022] PUT /identity/v3/projects/28ec6c075ebb4622888dac66ae31b7a5/users/272f6348db5a4e48b676a28fb4a269e3/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:39.234675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.248294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0715-195d-4e0d-a3e4-e87cce6ac64b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.285450 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.292411 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.348235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.349141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.349514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.349860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.350581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.352784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.358433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb14-c6f4-41fc-84b2-f8547d62b8b2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.364410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.365426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.365780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.366156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.366914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.368645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.384479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1214/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:39.386390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.394690 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1184/2398] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:39 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:39.400912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.413473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a985d8-57f8-48d3-8a3c-955aa3d88dfd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.534719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde499cc-ba62-47b3-bfdd-94e70d0433e3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.543643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.544272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.544443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.544610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.544893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] PATH_INFO: `/v3/projects/28ec6c075ebb4622888dac66ae31b7a5/users/272f6348db5a4e48b676a28fb4a269e3/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.545651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.546255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.546701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.547012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ec6c075ebb4622888dac66ae31b7a5, user_id=272f6348db5a4e48b676a28fb4a269e3, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.547736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.550023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.550158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784259-dc8f-488a-a0ae-43e7a1bd2c8f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.563596 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1215/2399] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:39 2022] PUT /identity/v3/projects/28ec6c075ebb4622888dac66ae31b7a5/users/272f6348db5a4e48b676a28fb4a269e3/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:39.575617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.575904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.576234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.585584 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1185/2400] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:39 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:39.590339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.608180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eedb-9ed2-4a1c-adf6-cbbad11d780b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.608432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] MFA Rules not processed for user `272f6348db5a4e48b676a28fb4a269e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:39.609754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:39.698689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.699214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.699494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.699768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.700477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.702202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.711695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1216/2401] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:39.724124 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1186/2402] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:39.725080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.741193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.743424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:39.751506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02973e15-ef35-414c-b6d1-bdc3ba20cacc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.757815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.758447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.758726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.759006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.759664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.761290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.772529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1217/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:39.776435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:39.789505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b0ad-dc59-4304-b528-f7ef28c04148 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.791696 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.795210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.796057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.796393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.797657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] PATH_INFO: `/v3/projects/e4b95b77de95427bb8312c7c78a64fe6/users/f19d70a9f79e4de9828b6884d0bb8359/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.821426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b95b77de95427bb8312c7c78a64fe6, user_id=f19d70a9f79e4de9828b6884d0bb8359, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:39.825378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fec2e-5d37-4f58-8d5a-7845110178bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:39.830410 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.853457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1218/2404] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:39 2022] PUT /identity/v3/projects/e4b95b77de95427bb8312c7c78a64fe6/users/f19d70a9f79e4de9828b6884d0bb8359/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:39.853785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875789bc-34f2-4d7a-adf5-6302d7300872 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:39.866918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.867450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.867902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.915888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] MFA Rules not processed for user `f19d70a9f79e4de9828b6884d0bb8359`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:39.918907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:39.956057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:39.956588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:39.956867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:39.958476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:39.960640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.025699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1219/2405] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:40.030441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.045653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.047273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.058353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1187/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:40.128548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.130663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.140926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8655e74-d37b-4b39-897f-7071999abe93 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.147052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.147510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.147637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263f2a-9d5f-4c20-bd63-884d9aecd0a7 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.147794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.148065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.148698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.150665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd1ee-e7d8-48c5-a64d-ffac84915da7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.153531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.154207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.154527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.154802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.183026 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1220/2407] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:40 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:40.183026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.183026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.183026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.207259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:40.209260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.237032 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:40.241339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.243928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.260469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1188/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:40.261974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.279473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41a807-b091-4215-bead-f50c7ed7932e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.283550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1221/2409] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:40.297750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.300281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.332072 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:40.389027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.389027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.389027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.389027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.390039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.390309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.407266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086a082-a5f6-45d6-85e0-2d6effa80a36 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.413772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.414467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.414769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.415152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.417440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1189/2410] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:40 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:40.420511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.425058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.427111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.434008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa03b4-b90a-4803-a9ce-77cd7ea04e31 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.437795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1222/2411] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.439118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.439845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.440255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.440538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.441253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.443735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.460345 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1190/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:40.465999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.492069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.492172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc3ed1-05ee-47ff-b06e-8412784d62bf service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.497633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.498375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.498659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.498941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] PATH_INFO: `/v3/projects/f9f2cfe1161a44a39289ff888117564e/users/27e661fc24f142b9a1953464473d3f7b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.518642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f2cfe1161a44a39289ff888117564e, user_id=27e661fc24f142b9a1953464473d3f7b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.523124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.524785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840eded-856e-4f29-bfe2-8ffb5d9ebd63 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.537577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.540298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.540792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.541463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] PATH_INFO: `/v3/users/b20ae0370d8e4246a1d8a66da0fd70c9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.544087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20ae0370d8e4246a1d8a66da0fd70c9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.548371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.549592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1223/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:40 2022] PUT /identity/v3/projects/f9f2cfe1161a44a39289ff888117564e/users/27e661fc24f142b9a1953464473d3f7b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:40.554737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.635190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20ae0370d8e4246a1d8a66da0fd70c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:40.636823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20ae0370d8e4246a1d8a66da0fd70c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:40.651472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20ae0370d8e4246a1d8a66da0fd70c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:40.676319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20ae0370d8e4246a1d8a66da0fd70c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:40.677660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7815e4bc-3941-4363-a21f-f73105295a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20ae0370d8e4246a1d8a66da0fd70c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:40.705551 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1191/2414] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:40 2022] DELETE /identity/v3/users/b20ae0370d8e4246a1d8a66da0fd70c9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:40.705720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64637-0139-4241-84a6-84a46ad6d752 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.708263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.708557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.708837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.733619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:40.734779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.774172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.775298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.776540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.779233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.780075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.781901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.797860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1224/2415] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:40.798548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.803178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.803572 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:40.817787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bda0-1713-4d49-bc2c-2358a6d795d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:40.824256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:40.827251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.827251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.827251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] PATH_INFO: `/v3/projects/f9f2cfe1161a44a39289ff888117564e/users/27e661fc24f142b9a1953464473d3f7b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.828512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f2cfe1161a44a39289ff888117564e, user_id=27e661fc24f142b9a1953464473d3f7b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:40.831442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533848fc-7a14-4da5-8a51-b413c25f727f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:40.843538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1192/2416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:40.845897 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1225/2417] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:40 2022] PUT /identity/v3/projects/f9f2cfe1161a44a39289ff888117564e/users/27e661fc24f142b9a1953464473d3f7b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:40.854996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:40.856092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:40.856387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:40.856696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:40.857747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.890901 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:40.907648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] MFA Rules not processed for user `27e661fc24f142b9a1953464473d3f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:40.909607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:40.964255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb96ec-36b3-45be-b595-3ae5de8fafd1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:41.054790 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1226/2418] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:41.063773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:41.064770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:41.065061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:41.068801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:41.165610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:41.167211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:41.183499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1193/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:41.637180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:41.638827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:41.832093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6577715-e5da-4019-b0e6-5158c01c48ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:41.841014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:41.841968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:41.844065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:41.844563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:41.882015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:41.886264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:41.918968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1227/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:41.996146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:41.999280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:42.021958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139b20a-7aff-47bb-b6c7-a0fde666c728 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:42.037049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:42.038618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:42.038920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:42.039559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] PATH_INFO: `/v3/projects/79e048ceb3b94914b1c30609b2ef3b59` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:42.041360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e048ceb3b94914b1c30609b2ef3b59)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:42.047638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:42.169147 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:42.181548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e048ceb3b94914b1c30609b2ef3b59', 'request_id': 'req-4da0866d-eec9-4cbc-b963-3f1d548358af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.194324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e048ceb3b94914b1c30609b2ef3b59', 'request_id': 'req-4da0866d-eec9-4cbc-b963-3f1d548358af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.210918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e048ceb3b94914b1c30609b2ef3b59', 'request_id': 'req-4da0866d-eec9-4cbc-b963-3f1d548358af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.237876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] The token cache is being invalidate because project 79e048ceb3b94914b1c30609b2ef3b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:42.239099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.240295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da0866d-eec9-4cbc-b963-3f1d548358af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.242849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1194/2421] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:41 2022] DELETE /identity/v3/projects/79e048ceb3b94914b1c30609b2ef3b59 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:42.246761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:42.266024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704910ee-0523-41ad-b992-fabc1f7cd52a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:42.397161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:42.398088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:42.398469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:42.398819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] PATH_INFO: `/v3/users/272f6348db5a4e48b676a28fb4a269e3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:42.400142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272f6348db5a4e48b676a28fb4a269e3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:42.402986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:42.449256 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:42.539371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272f6348db5a4e48b676a28fb4a269e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.557638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272f6348db5a4e48b676a28fb4a269e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.576635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272f6348db5a4e48b676a28fb4a269e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.578237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272f6348db5a4e48b676a28fb4a269e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.579272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272f6348db5a4e48b676a28fb4a269e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:42.621442 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1228/2422] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:42 2022] DELETE /identity/v3/users/272f6348db5a4e48b676a28fb4a269e3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:42.934972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:42.934972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:42.935294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:42.967587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:42.968853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.049731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:43.052676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.092579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1195/2423] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:43.132413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:43.136193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.189131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1dce-5977-4012-aa1f-09cd888a4de5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:43.200648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:43.201655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.202090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.202503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] PATH_INFO: `/v3/projects/28ec6c075ebb4622888dac66ae31b7a5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.204220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ec6c075ebb4622888dac66ae31b7a5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:43.207357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:43.330181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e7149-1139-4c3f-9e4f-99b1797dcca6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:43.333279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ec6c075ebb4622888dac66ae31b7a5', 'request_id': 'req-badd2745-b184-4cab-bdda-e7b283fb53c6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.351836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ec6c075ebb4622888dac66ae31b7a5', 'request_id': 'req-badd2745-b184-4cab-bdda-e7b283fb53c6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.372193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ec6c075ebb4622888dac66ae31b7a5', 'request_id': 'req-badd2745-b184-4cab-bdda-e7b283fb53c6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.401477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] The token cache is being invalidate because project 28ec6c075ebb4622888dac66ae31b7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:43.402035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.403022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.408767 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1229/2424] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:43 2022] DELETE /identity/v3/projects/28ec6c075ebb4622888dac66ae31b7a5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:43.408767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:43.408767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.457901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:43.459159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.459734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.460202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.463632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.493166 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:43.525350 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:43.575661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2745-b184-4cab-bdda-e7b283fb53c6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:43.592964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:43.595783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.596065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.596350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] PATH_INFO: `/v3/users/f19d70a9f79e4de9828b6884d0bb8359` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.607045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19d70a9f79e4de9828b6884d0bb8359)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:43.611674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:43.631285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:43.637009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3834-482c-472c-8e35-35d4e22a4a4a service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:43.656877 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1196/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:43.662900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a65c-0580-4bde-9640-fd0e223fcaf9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.662900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a65c-0580-4bde-9640-fd0e223fcaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.662900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a65c-0580-4bde-9640-fd0e223fcaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.726874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9c79a65c-0580-4bde-9640-fd0e223fcaf9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:43.730529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9c79a65c-0580-4bde-9640-fd0e223fcaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.740927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19d70a9f79e4de9828b6884d0bb8359'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.751449 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1197/2426] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:43.763037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.763391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.763614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.764054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19d70a9f79e4de9828b6884d0bb8359'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.799377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19d70a9f79e4de9828b6884d0bb8359'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.800511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19d70a9f79e4de9828b6884d0bb8359'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.803168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac462c65-c898-42a6-9b2e-69e21d5e1c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19d70a9f79e4de9828b6884d0bb8359'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:43.822550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1230/2427] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:43 2022] DELETE /identity/v3/users/f19d70a9f79e4de9828b6884d0bb8359 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:43.827337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:43.827732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:43.828253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:43.828783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:43.828994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.862867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:43.865340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:43.968462 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1231/2428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:43.986743 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1198/2429] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:43.991638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.007918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b031c47-7617-4033-bb42-dafb37390746 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.016010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.018948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:44.029771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.031449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.031799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.033169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.033924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:44.034235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.036600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.050296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1232/2430] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:02:44.055588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.087432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c5cb-500c-45a2-8029-c17e5caeb383 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.095828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.096657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.096944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.097223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.107176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.114691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.172236 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1233/2431] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:44 2022] POST /identity/v3/projects => generated 395 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:44.177744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.196613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2c10b-cb13-4a7c-afd5-c0ddb3299a3e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.241632 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:44.337715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c33f-1731-49de-90e7-40d8bd19ec31 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.352168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.352916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.353439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.354250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.354943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.359380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.373201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.374054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.374454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.374815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.398214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.399759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.417447 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1234/2432] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:44 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:44.421883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.427877 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1199/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:44.449463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6272-1ee3-48c8-aa81-564ee0ad7cd2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.456781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.458331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.458767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.459266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.461936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.464090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.480177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1235/2434] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:44.490926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.523026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd1e5-b4d2-475b-bb05-8dab136654f3 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.530671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.531619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.531889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.546155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.548252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.550188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b8b3-e026-48fb-a7ea-1d69a677f4d5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.590193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1200/2435] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:44.594234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.616170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8020f-8ef1-4182-b9bc-47c7ecb9e635 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.624345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.625265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.625759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.626105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] PATH_INFO: `/v3/projects/868947b52a1d48d6be6e81a2b8718441/users/545456a4a4e540be9138c47b0df77bbf/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.659718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868947b52a1d48d6be6e81a2b8718441, user_id=545456a4a4e540be9138c47b0df77bbf, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.664048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.687987 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1236/2436] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:44 2022] PUT /identity/v3/projects/868947b52a1d48d6be6e81a2b8718441/users/545456a4a4e540be9138c47b0df77bbf/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:44.690156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b99-a07d-4a2f-8b72-65a7d5ccdce8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.690600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b99-a07d-4a2f-8b72-65a7d5ccdce8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.691028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b99-a07d-4a2f-8b72-65a7d5ccdce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.715598 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:44.724503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-78406b99-a07d-4a2f-8b72-65a7d5ccdce8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:44.725996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78406b99-a07d-4a2f-8b72-65a7d5ccdce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:44.796916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1201/2437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:44.807875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:44.876164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6a4a-2419-4a44-9653-09398db3e1b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:44.881156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:44.881810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.882096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.882365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:44.892607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:44.894267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:44.905262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1237/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:44.993643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:44.994006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:44.994175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:45.013980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:45.015739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:45.047113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd3907-e3b3-48da-b8fc-57f676967e9f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:45.050295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] MFA Rules not processed for user `5bfdfd44cd064a3f88e8a5c2a3b09307`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:45.057059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:45.062243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:45.063034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:45.063498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:45.063888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] PATH_INFO: `/v3/projects/e4b95b77de95427bb8312c7c78a64fe6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:45.065642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b95b77de95427bb8312c7c78a64fe6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:45.068638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:45.199875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1202/2439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:45.200673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b95b77de95427bb8312c7c78a64fe6', 'request_id': 'req-c01aa4d9-335f-41bc-a801-0da517e2795f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.220715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b95b77de95427bb8312c7c78a64fe6', 'request_id': 'req-c01aa4d9-335f-41bc-a801-0da517e2795f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.232959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b95b77de95427bb8312c7c78a64fe6', 'request_id': 'req-c01aa4d9-335f-41bc-a801-0da517e2795f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.247846 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:45.268637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] The token cache is being invalidate because project e4b95b77de95427bb8312c7c78a64fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:45.268755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.272241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c01aa4d9-335f-41bc-a801-0da517e2795f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.279249 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1238/2440] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:45 2022] DELETE /identity/v3/projects/e4b95b77de95427bb8312c7c78a64fe6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:45.283435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:45.302979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0fe7-ed42-4535-bab2-4eb81256cf53 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:45.475939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:45.477811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:45.478264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:45.478822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] PATH_INFO: `/v3/users/27e661fc24f142b9a1953464473d3f7b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:45.480635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e661fc24f142b9a1953464473d3f7b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:45.483092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:45.559226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e661fc24f142b9a1953464473d3f7b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.560485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e661fc24f142b9a1953464473d3f7b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.570963 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:45.574014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e661fc24f142b9a1953464473d3f7b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.602309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e661fc24f142b9a1953464473d3f7b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.603568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e661fc24f142b9a1953464473d3f7b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:45.628210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1203/2441] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:45 2022] DELETE /identity/v3/users/27e661fc24f142b9a1953464473d3f7b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:45.833030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4363ee-8fd8-4981-927d-8cb31ceec73d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:45.833486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4363ee-8fd8-4981-927d-8cb31ceec73d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:45.834250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4363ee-8fd8-4981-927d-8cb31ceec73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:45.888085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ba4363ee-8fd8-4981-927d-8cb31ceec73d None None] MFA Rules not processed for user `5bfdfd44cd064a3f88e8a5c2a3b09307`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:45.891463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba4363ee-8fd8-4981-927d-8cb31ceec73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:45.968159 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1239/2442] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:46.238336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:46.240698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:46.383983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35a6f-eef5-4214-94c1-7b19cb3313b3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:46.411467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:46.412397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.412679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.412955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] PATH_INFO: `/v3/projects/f9f2cfe1161a44a39289ff888117564e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.418532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f2cfe1161a44a39289ff888117564e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:46.420568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:46.508882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f2cfe1161a44a39289ff888117564e', 'request_id': 'req-138420ed-1425-4b6e-8177-963c124cd7b7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:46.518847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f2cfe1161a44a39289ff888117564e', 'request_id': 'req-138420ed-1425-4b6e-8177-963c124cd7b7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:46.528935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f2cfe1161a44a39289ff888117564e', 'request_id': 'req-138420ed-1425-4b6e-8177-963c124cd7b7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:46.547263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] The token cache is being invalidate because project f9f2cfe1161a44a39289ff888117564e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:46.547825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:46.548620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-138420ed-1425-4b6e-8177-963c124cd7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:46.550410 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1204/2443] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:46 2022] DELETE /identity/v3/projects/f9f2cfe1161a44a39289ff888117564e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:46.556734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.557294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.557294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.595684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:46.596941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:46.716448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1240/2444] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:46.723557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.724094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.724529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.752412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:46.754260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:46.769587 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1205/2445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:46.771749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:46.789308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2af71-0ab5-4473-aa98-cacf4c72ee78 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:46.796166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:46.797132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.797616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.798123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.799152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:46.799669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:46.802197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:46.817730 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1241/2446] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:46.822719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:46.836063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5bb5-77ca-40af-aadd-a605aeed1e32 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:46.841946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:46.842966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.843325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.843600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.844436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:46.846415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:46.891294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1206/2447] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:46.891496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:46.906411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c94-994f-4558-a9ff-9d8d2d36d6ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:46.988615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:46.989816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:46.990372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:46.990743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:46.991568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:46.993665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.024039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1242/2448] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:46 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:02:47.027307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.042159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da7b9-9570-48c6-9c78-876223356262 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.048768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.049714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.050091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.051100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.051593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.053475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.070260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1207/2449] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:47.071749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.085467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51a24-2ac4-48b3-b379-ace494cae52a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.092820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.093640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.094029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.096482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.096482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.099050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0d614-942e-433f-ac3d-55b768f072bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.113461 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1243/2450] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:47.115799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.128244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbace262-29d7-45f0-971f-18773c789e59 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.134988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.135647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.135934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.136211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] PATH_INFO: `/v3/projects/bcca204614c54f31b17141af7adc3449/users/c24ca8da089e41dba706449b8a7a4e16/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.159606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcca204614c54f31b17141af7adc3449, user_id=c24ca8da089e41dba706449b8a7a4e16, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.163581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.185524 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:47.202839 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1208/2451] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:47 2022] PUT /identity/v3/projects/bcca204614c54f31b17141af7adc3449/users/c24ca8da089e41dba706449b8a7a4e16/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:47.213260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.217851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.218308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.246205 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:47.277516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] MFA Rules not processed for user `c24ca8da089e41dba706449b8a7a4e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:47.279668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:47.501561 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1244/2452] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:47.501748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.638707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09d31-72cf-450e-8bcc-4b62f20120a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.653685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.654320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.654597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.654870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.656561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.658837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.708493 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1209/2453] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:47 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:47.712285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.756910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e4217-694e-42d7-ac18-9174b0a52b62 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.888484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.889133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.889699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.890004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.890723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.892686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.948305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1245/2454] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:47 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:47.949726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:47.965603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e68d8-3073-49d1-bb9a-13b0595e8e89 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:47.977203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:47.978210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:47.978646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:47.980216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:47.981515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:47.984352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:47.999617 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1210/2455] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:48.003589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.018037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35c852-855a-4e36-ae42-3f7e8f07d73f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.023165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.023852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.024134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.024424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] PATH_INFO: `/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c/users/3d872db069b042c88c0d57195d0b3cb1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.045276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd514b50a7c49f0903f4d3f152e9c9c, user_id=3d872db069b042c88c0d57195d0b3cb1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.048493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.066398 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1246/2456] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:48 2022] PUT /identity/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c/users/3d872db069b042c88c0d57195d0b3cb1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:48.071126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.087066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1508b7-1924-4d76-8015-0e66290efbcc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.162203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.163244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.163835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.164435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.165245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.195700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2ae8f-2917-4822-b7d8-9e8886005f5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.211487 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1211/2457] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:48.216169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.232139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9bc1-1a33-414b-80a1-5efaf72c0be6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.239404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.240498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.241179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.241179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] PATH_INFO: `/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c/users/3d872db069b042c88c0d57195d0b3cb1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.245465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd514b50a7c49f0903f4d3f152e9c9c, user_id=3d872db069b042c88c0d57195d0b3cb1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.247356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.261321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1247/2458] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:48 2022] PUT /identity/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c/users/3d872db069b042c88c0d57195d0b3cb1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:48.273303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.273747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.274142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.325712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] MFA Rules not processed for user `3d872db069b042c88c0d57195d0b3cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:48.327307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:48.501992 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:48.525175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1212/2459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:48.532924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.557911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173616-aa47-4c4f-a80a-643af513e2ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.570605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.571251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.571538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.571814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.572489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:48.572799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.574479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.602901 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1248/2460] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:48.607067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.626122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa517147-1d2d-4ea7-9d3b-6c1f8bc9be3c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.643860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.650811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.650811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.651298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.652049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.654271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.706956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1213/2461] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:48 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:48.711494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:48.727759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72f1e9-e03d-440b-b63b-fc890b34583d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:48.814910 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:48.899147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:48.902659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:48.903660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:48.905230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:48.906058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:48.909085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:48.911209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d04bb-204b-4534-a372-f367287cee79 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:48.965992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1249/2462] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:49.943036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:49.951170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:50.338663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713294e-921e-4990-872a-1ee4e48e880a tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:50.364247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:50.365580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:50.366104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:50.366868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:50.412324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:50.416183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:50.448483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1214/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:50.470048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c610954-085d-4277-9fe0-123e61d13b63 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:50.470720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c610954-085d-4277-9fe0-123e61d13b63 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:50.470960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c610954-085d-4277-9fe0-123e61d13b63 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:50.475792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1250/2464] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:50.488121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:50.506573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:50.538802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fd3d-755d-4010-9d23-2ec4cc612c8e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:50.556951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:50.558243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:50.558449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:50.558797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:50.560506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a54f644625b4ca5bb1f6b39a051fe69)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:50.564696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:50.567226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1215/2465] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:50 2022] GET /identity/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69 => generated 369 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:51.557575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a44f5-0a2c-470d-b592-9c774f5d11ba None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:51.558178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a44f5-0a2c-470d-b592-9c774f5d11ba None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:51.558178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a44f5-0a2c-470d-b592-9c774f5d11ba None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:51.559654 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1251/2466] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:51.565859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:51.582502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:51.601452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554f41-06b2-41ee-be5e-ba3ec4d0203d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:51.631759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:51.632544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:51.633517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:51.633899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:51.635413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a54f644625b4ca5bb1f6b39a051fe69)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:51.638470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:51.654975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1216/2467] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:51 2022] GET /identity/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69 => generated 369 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:51.711321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a44f5-0a2c-470d-b592-9c774f5d11ba None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:51.746175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a44f5-0a2c-470d-b592-9c774f5d11ba None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:51.752746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:51.754509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:51.755042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:51.755509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:51.756339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:51.756797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:51.758779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:51.781098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:51.782777 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1252/2468] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:51.796628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21997777-54b3-496c-ae25-14992928466f tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:51.805626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:51.806548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:51.807000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:51.807522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:51.808377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:51.810612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:51.846955 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1217/2469] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:51 2022] POST /identity/v3/users => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:51.847774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:51.868075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6600044-fa09-442c-b35f-4ef2694f4972 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:51.881910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:51.883112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:51.884579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:51.885110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:51.886130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:51.886466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:51.889829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078973c-e61a-4458-b069-30a2316498fa tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:51.909387 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1253/2470] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:52.328736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:52.331442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:52.368617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:52.369453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:52.370143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:52.374645 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1254/2471] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:52.387995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:52.411300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:52.425288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98293874-b767-4648-82ef-23c1dbe13f06 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:52.433980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:52.434738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:52.435025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:52.435603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:52.436921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a54f644625b4ca5bb1f6b39a051fe69)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:52.453778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:52.471946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d00e0-6b57-4d4e-bbbf-27184041ac1e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:52.481362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:52.482390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1255/2472] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:52 2022] GET /identity/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69 => generated 369 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:02:52.482513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:52.482672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:52.483127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] PATH_INFO: `/v3/users/54541ffbbb8d4f24a054d1d7a80f7152` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:52.484535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54541ffbbb8d4f24a054d1d7a80f7152)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:52.487055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:52.492338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:52.495701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:52.526113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696da3b-5b6b-458e-89df-500e21decaf5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:52.534261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:52.536101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:52.536708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:52.537254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:52.539855 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:52.540122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:52.615694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54541ffbbb8d4f24a054d1d7a80f7152'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:52.617835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54541ffbbb8d4f24a054d1d7a80f7152'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:52.653846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54541ffbbb8d4f24a054d1d7a80f7152'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:52.687238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54541ffbbb8d4f24a054d1d7a80f7152'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:52.689559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72d52d09-8586-42a7-858b-af0fa0e6be3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54541ffbbb8d4f24a054d1d7a80f7152'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:52.728104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1218/2473] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:52 2022] DELETE /identity/v3/users/54541ffbbb8d4f24a054d1d7a80f7152 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:52.733005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b4dd-03f9-4a20-8e46-fdf7046b30fe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:52.733288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b4dd-03f9-4a20-8e46-fdf7046b30fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:52.733578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b4dd-03f9-4a20-8e46-fdf7046b30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:52.798396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c166b4dd-03f9-4a20-8e46-fdf7046b30fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:52.804171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c166b4dd-03f9-4a20-8e46-fdf7046b30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:52.806232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:52.809509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:52.831314 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1256/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:53.013039 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1219/2475] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:53.029092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:53.031108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:53.163649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a598-6ad9-403e-81bb-c1cdc3503dfa service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:53.251203 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:53.275170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:53.276297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:53.277513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:53.278015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:53.302168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:53.304270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:53.338237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1257/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:53.401835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf9bd-9d05-475f-98f5-d2a4911af2b9 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:53.402576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf9bd-9d05-475f-98f5-d2a4911af2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:53.403978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf9bd-9d05-475f-98f5-d2a4911af2b9 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:53.409998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1220/2477] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:02:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:53.419884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:02:53.421839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:53.577180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:53.578840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:53.704893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c28d-b345-4647-8d38-2b7b8ec4f51d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:53.714064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:53.714901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:53.715260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:53.715613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:53.717273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a54f644625b4ca5bb1f6b39a051fe69)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:53.720063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:53.724471 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1258/2478] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:02:53 2022] GET /identity/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69 => generated 369 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:53.773562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf9bd-9d05-475f-98f5-d2a4911af2b9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:53.803687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf9bd-9d05-475f-98f5-d2a4911af2b9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:53.820406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:53.821749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:53.822051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:53.822384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/users/0eb51a1967fa40c899f2551c8e3ff31b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:53.922939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0eb51a1967fa40c899f2551c8e3ff31b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:53.925890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:53.951429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:53.955330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:53.989125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbae251-6262-45c5-a723-ccb1a0d5d5c6 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:54.005367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:54.006562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:54.007010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:54.008692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] PATH_INFO: `/v3/projects/4ea70b1c1150462fb7ad97fa83ef8060` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:54.013975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea70b1c1150462fb7ad97fa83ef8060)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:54.019223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:54.058350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb51a1967fa40c899f2551c8e3ff31b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.060422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb51a1967fa40c899f2551c8e3ff31b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.079256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb51a1967fa40c899f2551c8e3ff31b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.122043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb51a1967fa40c899f2551c8e3ff31b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.124297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea70b1c1150462fb7ad97fa83ef8060', 'request_id': 'req-adb0cf49-fd7e-4240-8d61-ecfba700a343'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.124488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb51a1967fa40c899f2551c8e3ff31b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.138796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea70b1c1150462fb7ad97fa83ef8060', 'request_id': 'req-adb0cf49-fd7e-4240-8d61-ecfba700a343'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.153596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea70b1c1150462fb7ad97fa83ef8060', 'request_id': 'req-adb0cf49-fd7e-4240-8d61-ecfba700a343'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.155223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1221/2479] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:53 2022] DELETE /identity/v3/users/0eb51a1967fa40c899f2551c8e3ff31b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:54.164584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:54.168099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:54.177848 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:54.183814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] The token cache is being invalidate because project 4ea70b1c1150462fb7ad97fa83ef8060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:54.185578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.187165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.192260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1259/2480] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:53 2022] DELETE /identity/v3/projects/4ea70b1c1150462fb7ad97fa83ef8060 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:54.197524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:54.202875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:54.243895 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:54.360214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462253-628b-49e5-8307-db8ee7a0a03e tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:54.371841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d872db069b042c88c0d57195d0b3cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bd514b50a7c49f0903f4d3f152e9c9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:54.372675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:54.373143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:54.374497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] PATH_INFO: `/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:54.375996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a54f644625b4ca5bb1f6b39a051fe69)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:54.378445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:54.493156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a54f644625b4ca5bb1f6b39a051fe69', 'request_id': 'req-e8395a16-85d6-4fb6-9a93-5ae9578f3253'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.511549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a54f644625b4ca5bb1f6b39a051fe69', 'request_id': 'req-e8395a16-85d6-4fb6-9a93-5ae9578f3253'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.511952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0cf49-fd7e-4240-8d61-ecfba700a343 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:54.527897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a54f644625b4ca5bb1f6b39a051fe69', 'request_id': 'req-e8395a16-85d6-4fb6-9a93-5ae9578f3253'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.561118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] The token cache is being invalidate because project 0a54f644625b4ca5bb1f6b39a051fe69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:54.561872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.565793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.576606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1222/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:54 2022] DELETE /identity/v3/projects/0a54f644625b4ca5bb1f6b39a051fe69 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:54.578384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:54.585342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:54.694031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:54.694730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:54.695014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:54.695285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] PATH_INFO: `/v3/users/e860f05decda4dd9a319ea6efba0a1ca` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:54.697087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e860f05decda4dd9a319ea6efba0a1ca)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:54.699813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:54.782442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395a16-85d6-4fb6-9a93-5ae9578f3253 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:54.796493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:54.796493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:54.796493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:54.796493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] PATH_INFO: `/v3/users/c24ca8da089e41dba706449b8a7a4e16` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:54.801997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24ca8da089e41dba706449b8a7a4e16)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:54.806311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:54.810116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e860f05decda4dd9a319ea6efba0a1ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.828177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e860f05decda4dd9a319ea6efba0a1ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.848043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e860f05decda4dd9a319ea6efba0a1ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.848797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e860f05decda4dd9a319ea6efba0a1ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.849590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee014074-3d59-453c-b538-77f7ef4dc000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e860f05decda4dd9a319ea6efba0a1ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.903169 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1260/2482] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:54 2022] DELETE /identity/v3/users/e860f05decda4dd9a319ea6efba0a1ca => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:54.909938 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:54.940562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24ca8da089e41dba706449b8a7a4e16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.942381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24ca8da089e41dba706449b8a7a4e16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.969421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24ca8da089e41dba706449b8a7a4e16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.997978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24ca8da089e41dba706449b8a7a4e16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:54.999586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24ca8da089e41dba706449b8a7a4e16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:55.035013 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1223/2483] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:54 2022] DELETE /identity/v3/users/c24ca8da089e41dba706449b8a7a4e16 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:55.036824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:55.037324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:55.037439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:55.070804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:55.072265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:55.131186 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:55.237277 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1261/2484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:55.259381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:55.261721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:55.381820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8124be-2da4-4ad6-a754-88f98d0c50c9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:55.400701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:55.402366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:55.402689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:55.402959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:55.427466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:55.433851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:55.464102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1224/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:55.755080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:55.757226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:55.839463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:55.840971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:55.867127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7b2fe-58a8-416c-b39a-b9329a8fb502 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:55.872966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:55.873931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:55.874405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:55.875422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] PATH_INFO: `/v3/projects/7222c94675e14a4381e48c17b360a351` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:55.876948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7222c94675e14a4381e48c17b360a351)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:55.879224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:55.885800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25776603-0d8f-49a7-bba8-7af559ed85d5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:55.893888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:55.893888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:55.894209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:55.895536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:55.912713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:55.937641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:55.970519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22848329-8f76-4ef6-ae50-2d6569ab9b0f service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:55.979163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7222c94675e14a4381e48c17b360a351', 'request_id': 'req-ee1b340a-fc2a-4daf-a540-90a9c30e619a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:55.982989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1262/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:55.991894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7222c94675e14a4381e48c17b360a351', 'request_id': 'req-ee1b340a-fc2a-4daf-a540-90a9c30e619a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:56.005437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7222c94675e14a4381e48c17b360a351', 'request_id': 'req-ee1b340a-fc2a-4daf-a540-90a9c30e619a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:56.025707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] The token cache is being invalidate because project 7222c94675e14a4381e48c17b360a351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:56.026333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:56.027563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee1b340a-fc2a-4daf-a540-90a9c30e619a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:56.029842 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1225/2487] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:55 2022] DELETE /identity/v3/projects/7222c94675e14a4381e48c17b360a351 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:56.039136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.039643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.040141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.079138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:56.083874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:56.297941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.298180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1263/2488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:56.302397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.304052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.350359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:56.353971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:56.379960 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1226/2489] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:56.384360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:56.405166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e49dc-be2d-46fb-a6aa-e4b1bba2509f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:56.438407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:56.442402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.443060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.443557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.459953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:02:56.460997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:56.468468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:56.498868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1264/2490] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:02:56.503518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:56.522277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c948-b971-4662-8d72-6b675bfe6432 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:56.533188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:56.535541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.554011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.554421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.555129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:56.562994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:56.630644 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1227/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:56 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:56.634777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:56.651193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8814272-1434-4e99-9355-bfa308089a6a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:56.823278 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:56.840734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:56.842072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.842517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.843887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.844300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:56.846495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:56.886186 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1265/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:56 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:56.890499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:56.902858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8c8c-910e-476c-9f83-faf92497ae55 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:56.910552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:56.911387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.911821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.912190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.912962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:56.915864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:56.919571 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:56.934273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:56.948681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1228/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:56.951306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b0c7-ff7c-4f6b-a60e-2d47d06ebee8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:56.974939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:56.975289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:56.975577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:56.975849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:56.976506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:56.983362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865d47b-ab05-412f-832b-e13574adb2dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.012652 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1266/2494] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:02:57.017826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.032804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71b988-a807-4b49-8b88-5007707a2b61 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.040917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.041997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.042382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.043086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] PATH_INFO: `/v3/projects/24b28acf62d2465f8b45ad227b0f67ba/users/d4a0146643314178b28eb00cbbc60436/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.071020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b28acf62d2465f8b45ad227b0f67ba, user_id=d4a0146643314178b28eb00cbbc60436, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.078940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.117524 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1229/2495] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:57 2022] PUT /identity/v3/projects/24b28acf62d2465f8b45ad227b0f67ba/users/d4a0146643314178b28eb00cbbc60436/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:57.125380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.125961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.126176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.185888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] MFA Rules not processed for user `d4a0146643314178b28eb00cbbc60436`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:57.187285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:57.284598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1267/2496] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:57.290595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.358966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.360638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:57.435808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146ca1-0faf-44da-a7fa-fee0407a7a2d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.450203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.450849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.451137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.451421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.452070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.454088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.476208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9055-f69c-4024-b576-2f3e4c71133b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.482768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.483864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.484409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.485064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] PATH_INFO: `/v3/projects/bcca204614c54f31b17141af7adc3449` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.486670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcca204614c54f31b17141af7adc3449)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.489694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.521818 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1230/2497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:57 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:57.522889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.598694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcca204614c54f31b17141af7adc3449', 'request_id': 'req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:57.613015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcca204614c54f31b17141af7adc3449', 'request_id': 'req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:57.635712 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:57.640290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcca204614c54f31b17141af7adc3449', 'request_id': 'req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:57.669539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] The token cache is being invalidate because project bcca204614c54f31b17141af7adc3449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:57.671834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:57.675006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:57.677839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1268/2498] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:57 2022] DELETE /identity/v3/projects/bcca204614c54f31b17141af7adc3449 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:57.682858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.688101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:57.708225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098e22e-2a7c-4e7d-be08-a75f9855bfe8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.858677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.859323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.860768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.861058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.862305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.866737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.875668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb7cc-6bea-44a6-8881-b880f029ec1f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.890002 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:57.893482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.894194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.900750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.901147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] PATH_INFO: `/v3/users/3d872db069b042c88c0d57195d0b3cb1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.905779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d872db069b042c88c0d57195d0b3cb1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.911564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.915043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1231/2499] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:02:57 2022] POST /identity/v3/users => generated 296 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:02:57.919342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:57.922577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:57.940704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b060-98f6-42e8-abe9-38ba57ca18cf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:57.946825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:57.949316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:57.949975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:57.950408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:57.951342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:57.953648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:57.970229 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1232/2500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:57.982621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:58.006211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637af9c-4686-4750-90ff-d55a418d45f2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:58.020283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:58.020968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.021251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.021564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] PATH_INFO: `/v3/projects/3be2c45bf5e4480288d64235413f7547/users/5448ab39fbd8491698fa8a3777940155/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.027696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d872db069b042c88c0d57195d0b3cb1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:58.048852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be2c45bf5e4480288d64235413f7547, user_id=5448ab39fbd8491698fa8a3777940155, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:58.049080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d872db069b042c88c0d57195d0b3cb1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:58.053102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:58.071663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1233/2501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:57 2022] PUT /identity/v3/projects/3be2c45bf5e4480288d64235413f7547/users/5448ab39fbd8491698fa8a3777940155/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:58.077352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:58.112542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d872db069b042c88c0d57195d0b3cb1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:58.114800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d872db069b042c88c0d57195d0b3cb1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:58.116580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d872db069b042c88c0d57195d0b3cb1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:58.158560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1269/2502] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:02:57 2022] DELETE /identity/v3/users/3d872db069b042c88c0d57195d0b3cb1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:02:58.239832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c1d0-2b20-489a-9a85-bcc9e8e1eadb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:58.351659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:58.352801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.353270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.353901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.355105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:58.357315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f842cb-7602-4e38-a405-33694317e6a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:58.390679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:58.394150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:58.394402 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1234/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:02:58.423810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2658-f152-469d-bc05-8dbaa0a12a80 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:58.431056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:58.431708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.431996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.432275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] PATH_INFO: `/v3/projects/3be2c45bf5e4480288d64235413f7547/users/5448ab39fbd8491698fa8a3777940155/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.434427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be2c45bf5e4480288d64235413f7547, user_id=5448ab39fbd8491698fa8a3777940155, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:58.437395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5fab-d6ac-4ee5-9460-8f0d2f0c1eda admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:58.456586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1270/2504] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:02:58 2022] PUT /identity/v3/projects/3be2c45bf5e4480288d64235413f7547/users/5448ab39fbd8491698fa8a3777940155/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:58.467192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140c82-9759-4d27-a857-0a483f07106f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.467558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140c82-9759-4d27-a857-0a483f07106f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.467756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140c82-9759-4d27-a857-0a483f07106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.529298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26cd-74f3-43e3-bb24-0d36b27cc7a5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.529758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26cd-74f3-43e3-bb24-0d36b27cc7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.530170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a26cd-74f3-43e3-bb24-0d36b27cc7a5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.533185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1271/2505] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:02:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:02:58.551431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:58.552068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:58.552495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:58.612289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a140c82-9759-4d27-a857-0a483f07106f None None] MFA Rules not processed for user `5448ab39fbd8491698fa8a3777940155`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:58.615233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a140c82-9759-4d27-a857-0a483f07106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:58.627254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:58.634443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:58.781107 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:58.836592 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:58.848513 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1272/2506] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:58.897256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:58.899298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:58.902548 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1235/2507] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:59.076570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60289923-4279-4cd5-a4c6-f7200d7e997a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:59.080750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:59.081678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.082244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.082681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.097394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:59.099945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:59.114857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1273/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:59.160950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.161499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.163696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.220304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:59.223774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.259045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1236/2509] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:02:59.305150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:59.324361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4378-c3fb-4e02-97e7-f9e17891b101 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:59.337569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:59.338207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.338323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.338603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.351495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:59.353494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.381536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:59.383148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:59.451065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1274/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:59.526393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:59.528051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.556678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7bbd0-123c-43e3-8fb8-72fc2a40c613 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:59.574270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:59.574912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.575196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.575465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.596336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:59.599605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72583da-41e3-40fb-9320-c1d915ce3903 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:59.608614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdfea-5195-491a-9b1a-9399fca0f886 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:02:59.612792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1275/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:02:59.615819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:02:59.616830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.617628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.618110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] PATH_INFO: `/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.620557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd514b50a7c49f0903f4d3f152e9c9c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:02:59.623508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:02:59.735560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.735878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.736259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.738706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd514b50a7c49f0903f4d3f152e9c9c', 'request_id': 'req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:59.756400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd514b50a7c49f0903f4d3f152e9c9c', 'request_id': 'req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:59.771939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd514b50a7c49f0903f4d3f152e9c9c', 'request_id': 'req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:59.796500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] The token cache is being invalidate because project 7bd514b50a7c49f0903f4d3f152e9c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:02:59.796761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:59.797785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1eda7d21-5ad3-4b6a-ae3d-746cee9a59cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:02:59.802674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1237/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:59 2022] DELETE /identity/v3/projects/7bd514b50a7c49f0903f4d3f152e9c9c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:02:59.808713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace3c9-74ed-437d-af9c-6ee2891753d1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.809044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace3c9-74ed-437d-af9c-6ee2891753d1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.809263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace3c9-74ed-437d-af9c-6ee2891753d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:02:59.820258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] MFA Rules not processed for user `545456a4a4e540be9138c47b0df77bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:59.822594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.859028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-35ace3c9-74ed-437d-af9c-6ee2891753d1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:02:59.860432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-35ace3c9-74ed-437d-af9c-6ee2891753d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.928473 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1276/2513] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:59.932787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:02:59.934540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:02:59.989673 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1238/2514] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:02:59.998891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:02:59.999202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:02:59.999624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.044788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:00.050053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:00.073011 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1239/2515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:00.076603 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:00.078530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.115160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1917ae-0b33-45e4-9942-ee33c4570515 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.125128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3a0c7-c97a-4c54-81be-61109032ad18 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.126296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.127194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.127701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.128161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.129257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.133666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.172077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.174019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.177864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.179545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.183273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:00.191789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.196060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.200600 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:00.230860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1277/2516] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:02:59 2022] POST /identity/v3/projects => generated 395 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:03:00.233053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.234946 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1240/2517] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:00.239883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.263975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058447bd-a73c-492f-ac3a-d27a347f15ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.422222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adedd4-f667-48b7-9ae1-795bfea510d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.426074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.427120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.427452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.427741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.428968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.432084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.434674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.435620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.436115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.436612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.437565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.446931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.492332 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1278/2518] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:00 2022] POST /identity/v3/users => generated 304 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:03:00.493700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.552785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b3d59-d3fd-4cd0-a2c0-93233c34b680 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.574240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.575271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.580546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.581083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.585223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.587728 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1241/2519] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:00 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:00.589298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.590976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.639763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1279/2520] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:00.641111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.668158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2683-803f-44a6-ba9d-93526a4095e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.846603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e2aa3-89a1-4d93-8475-5db1d239c9a4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:00.860170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.860874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.861174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.863900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:00.865305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:00.866112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] PATH_INFO: `/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083/users/5854d8d6e34543948c1c3ddea3f0b5a0/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.866261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:00.866544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:00.868104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.878936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.910588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d61f03c84f74f68bf62dfd2b52ff083, user_id=5854d8d6e34543948c1c3ddea3f0b5a0, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:00.914605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:00.930751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1242/2521] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:00 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:00.935953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.947528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1280/2522] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:00 2022] PUT /identity/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083/users/5854d8d6e34543948c1c3ddea3f0b5a0/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:00.954699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:00.960606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c67a-84b6-4435-8843-49a6213141dc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:01.074137 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:01.155742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf524b-fa52-4885-b217-c4e38f338da6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:01.171631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:01.172327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.172606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.172878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.173563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:01.175203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:01.198165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1281/2523] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:01.202616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:01.211745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:01.212390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.212679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.212984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.221147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:01.226400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592c8e7-a5e7-45b5-99ba-f7e63cac3786 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:01.235668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:01.236226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:01.236390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.236673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.237030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] PATH_INFO: `/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083/users/5854d8d6e34543948c1c3ddea3f0b5a0/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.243050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d61f03c84f74f68bf62dfd2b52ff083, user_id=5854d8d6e34543948c1c3ddea3f0b5a0, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:01.245765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:01.277611 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1282/2524] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:01 2022] PUT /identity/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083/users/5854d8d6e34543948c1c3ddea3f0b5a0/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:01.287367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:01.289827 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1243/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:01.457040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9669a-992b-4172-95a3-844b01a5cc12 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:01.464518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:01.465243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.465605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.465879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.470578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:01.475385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d882d-7d7e-402f-9693-5356e6878fab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:01.498752 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1283/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:01.500430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:01.510771 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:01.529918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af326ba0-97b4-4681-b1ec-caee56df7e50 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:01.545057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:01.547179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.548841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.549351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] PATH_INFO: `/v3/projects/31eef923c6104d6ea7bb63db20f13dc3/users/687667b3aadf4dd591e1335678be938d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.617205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31eef923c6104d6ea7bb63db20f13dc3, user_id=687667b3aadf4dd591e1335678be938d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:01.621021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:01.696672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1244/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:01 2022] PUT /identity/v3/projects/31eef923c6104d6ea7bb63db20f13dc3/users/687667b3aadf4dd591e1335678be938d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:01.709254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:01.709746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:01.710269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:01.778438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:01.779944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:01.972060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:01.975422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:01.988176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1284/2528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:01.990515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.144017 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:02.167718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ff8-ee63-4952-ad03-0160f1600f6c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.182060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c46c-87e2-4565-af41-951546c22095 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.186381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:02.187035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.187320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.187594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] PATH_INFO: `/v3/users/d4a0146643314178b28eb00cbbc60436` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.191898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a0146643314178b28eb00cbbc60436)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:02.193956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:02.197859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:02.201907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.202279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.202664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.208330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:02.211458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:02.288524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1285/2529] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:01 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:03:02.292065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.310226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a0146643314178b28eb00cbbc60436'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:02.310871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a0146643314178b28eb00cbbc60436'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:02.326426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a0146643314178b28eb00cbbc60436'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:02.358034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a0146643314178b28eb00cbbc60436'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:02.358805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f59eaf8-1dbc-42d7-86e1-aeab7f442117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a0146643314178b28eb00cbbc60436'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:02.381253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1245/2530] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:01 2022] DELETE /identity/v3/users/d4a0146643314178b28eb00cbbc60436 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:02.385261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.385595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.385854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.425058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:02.428811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:02.439490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162e0d-8e30-474c-8272-7239f08c9ec5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.539809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:02.540499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.541526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.541980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.543057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:02.545871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:02.559184 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:02.582479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1246/2531] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:02.609169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.615592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1286/2532] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:02 2022] POST /identity/v3/users => generated 298 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:02.616019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:02.619499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.625171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:02.646881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045d02-7e93-485d-a68c-c344bb5f4d33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.654255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:02.655802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.656958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.657646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.658834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:02.661674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:02.679255 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1287/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:02.683996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.700526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae6a1-d315-400a-b8ea-78c449799182 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.706818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:02.708351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:02.708764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:02.709277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] PATH_INFO: `/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23/users/576f6792fff743518c31742e3df576dd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:02.743368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a642e38bcd3c41b093ba9ed920eb3e23, user_id=576f6792fff743518c31742e3df576dd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:02.749913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:02.820327 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1288/2534] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:02 2022] PUT /identity/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23/users/576f6792fff743518c31742e3df576dd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:02.821359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:02.821872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd05a45-f1d4-46f5-a32d-02e056091541 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:02.931495 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:02.996347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7389e9-9cd3-49b2-bc11-7ddcaba21b5a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:03.010608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:03.011435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.015158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.015554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.016456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:03.019075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:03.033522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:03.038825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.039271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.039551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.051003 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1289/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:03.052205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:03.065672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:03.069921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47ded4-7a48-41d4-b576-fbd45d69dd90 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:03.077654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729e00-2a4c-4326-8698-ce383323f4dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:03.086028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:03.087211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.087211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.087456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] PATH_INFO: `/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23/users/576f6792fff743518c31742e3df576dd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.094702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a642e38bcd3c41b093ba9ed920eb3e23, user_id=576f6792fff743518c31742e3df576dd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:03.101202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fb9d6-8e19-473a-ba67-9a97d8f82860 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:03.101875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1247/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:03.121192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1290/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:03 2022] PUT /identity/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23/users/576f6792fff743518c31742e3df576dd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:03.133839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.134129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.134460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.180221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] MFA Rules not processed for user `576f6792fff743518c31742e3df576dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:03.183057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:03.438571 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1248/2538] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:03.439928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.439928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.440290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.470162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:03.471637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:03.566695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1291/2539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:03.582155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:03.585377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:03.749430 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:03.865078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea1ac-328d-4548-b1c3-74a7123ad7c8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:03.893705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:03.895970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:03.898124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:03.899014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:03.906748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:03.966004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:03.969629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:04.008040 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1249/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:04.079269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:04.084275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:04.213207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823da34b-98d8-4b20-bd8a-1419fd7adcfa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:04.219671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:04.221438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:04.222023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:04.223061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] PATH_INFO: `/v3/projects/24b28acf62d2465f8b45ad227b0f67ba` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:04.226616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b28acf62d2465f8b45ad227b0f67ba)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:04.230918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:04.334789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b28acf62d2465f8b45ad227b0f67ba', 'request_id': 'req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.350388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b28acf62d2465f8b45ad227b0f67ba', 'request_id': 'req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.374743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b28acf62d2465f8b45ad227b0f67ba', 'request_id': 'req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.381974 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:04.421180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] The token cache is being invalidate because project 24b28acf62d2465f8b45ad227b0f67ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:04.421180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.421180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.423129 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1292/2541] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:04 2022] DELETE /identity/v3/projects/24b28acf62d2465f8b45ad227b0f67ba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:04.428728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:04.466788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a0-70c1-4ef8-a4c9-ccff374bfaf3 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:04.671749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:04.682668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:04.682668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:04.682668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] PATH_INFO: `/v3/users/5448ab39fbd8491698fa8a3777940155` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:04.689639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5448ab39fbd8491698fa8a3777940155)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:04.692525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:04.759086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5448ab39fbd8491698fa8a3777940155'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.761102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5448ab39fbd8491698fa8a3777940155'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.771697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5448ab39fbd8491698fa8a3777940155'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.786046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5448ab39fbd8491698fa8a3777940155'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.786918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6302bdab-9611-403f-9276-cb4df4dfe0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5448ab39fbd8491698fa8a3777940155'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:04.806342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1250/2542] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:04 2022] DELETE /identity/v3/users/5448ab39fbd8491698fa8a3777940155 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:05.396411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:05.399070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:05.447294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd0c2-5f14-4c9f-9a3b-ff1e8b348c0b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:05.584853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:05.585568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:05.586042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:05.586342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] PATH_INFO: `/v3/projects/3be2c45bf5e4480288d64235413f7547` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:05.587867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be2c45bf5e4480288d64235413f7547)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:05.590335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:05.732000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be2c45bf5e4480288d64235413f7547', 'request_id': 'req-19f23643-c7d7-462c-96e3-4524ad0228de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:05.741039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be2c45bf5e4480288d64235413f7547', 'request_id': 'req-19f23643-c7d7-462c-96e3-4524ad0228de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:05.749293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be2c45bf5e4480288d64235413f7547', 'request_id': 'req-19f23643-c7d7-462c-96e3-4524ad0228de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:05.781992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] The token cache is being invalidate because project 3be2c45bf5e4480288d64235413f7547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:05.782310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:05.783338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19f23643-c7d7-462c-96e3-4524ad0228de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:05.786134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1293/2543] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:05 2022] DELETE /identity/v3/projects/3be2c45bf5e4480288d64235413f7547 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:05.791611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:05.792207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:05.792207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:05.846741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:05.849622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:05.999229 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:06.052279 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1251/2544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:06.053271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.053684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.054038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.115407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:06.118801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:06.146609 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1294/2545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:06.151334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.170931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a1a4-8db9-4b40-b216-be0bbe325ff8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.188432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.189516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.189870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.191448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.193233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:06.194067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.196594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.233478 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1252/2546] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:06.236818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.249241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f8418-ca9c-45a3-af7b-61921494eaf8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.276853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.277299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.277619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.277892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.278750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.291291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.389548 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1295/2547] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:06 2022] POST /identity/v3/projects => generated 395 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:06.391804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.416142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf847e-5dd8-4e89-b8af-71fe9c2e0b53 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.579786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.583457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.583984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.586239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.587642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.599549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.719916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1253/2548] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:06 2022] POST /identity/v3/users => generated 298 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:06.724445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.757248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85277-163a-468c-9857-6c4cf23c5d31 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.765022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.765718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.766087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.766364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.767030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.768790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.788848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1296/2549] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:06.794555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.820783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0276d-4bbb-4731-b1c6-e8e8e7fa3337 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.828077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.829125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.829500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.829824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.830733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.833456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b526-63a6-4ead-95b1-a5f983f50839 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.853582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1254/2550] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:06.859602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:06.874315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd544-76c0-40ea-942d-d023932b4069 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:06.884861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:06.886169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.886637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.887055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] PATH_INFO: `/v3/projects/61aec289e69e4ec6b580caddfd559c66/users/cc879316f009409190f3614673fcc637/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:06.912383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aec289e69e4ec6b580caddfd559c66, user_id=cc879316f009409190f3614673fcc637, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:06.915822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:06.947375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1297/2551] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:06 2022] PUT /identity/v3/projects/61aec289e69e4ec6b580caddfd559c66/users/cc879316f009409190f3614673fcc637/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:06.971149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:06.973076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:06.974118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:07.012980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] MFA Rules not processed for user `cc879316f009409190f3614673fcc637`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:07.014863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:07.100115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1255/2552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:07.105031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:07.143080 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:07.334699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc84be2-b3ea-4155-8123-5afb0903b301 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:07.344505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:07.345906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:07.346492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:07.347109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:07.349631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:07.353307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:07.468205 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1298/2553] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:07 2022] POST /identity/v3/projects => generated 395 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:07.475784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:07.512677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3625f8-684a-4d0c-a85e-f48c26bd0a54 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:07.674053 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:07.736833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:07.739793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:07.740321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:07.740811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:07.742177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:07.747742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:07.821320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1256/2554] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:07 2022] POST /identity/v3/users => generated 304 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:07.827218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:07.870287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c8c3-2663-48b1-9b6a-f9013eafbc4a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:07.891141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:07.892337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:07.892887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:07.893640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:07.897349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:07.903266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:07.937551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1299/2555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:07.938616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:07.963158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428457-e2a8-448b-8b87-286284a39bc5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:07.978792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:07.981194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:07.982077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:07.985132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] PATH_INFO: `/v3/projects/efa05be5a12844408742a7dab9305318/users/2f996a3257fa456b9220e5231609dab4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:08.071302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa05be5a12844408742a7dab9305318, user_id=2f996a3257fa456b9220e5231609dab4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:08.093440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:08.134689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1257/2556] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:07 2022] PUT /identity/v3/projects/efa05be5a12844408742a7dab9305318/users/2f996a3257fa456b9220e5231609dab4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:08.140583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:08.165723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91374-ef7b-4d44-96ae-97045f0540bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:08.293920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:08.294889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:08.296109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:08.296109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:08.296109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:08.297814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859b799-7c0a-4755-a6ec-8877ccb0b77d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:08.313485 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1300/2557] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:08.316471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:08.329111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2592e-c5c6-4d3a-b791-e934520987c3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:08.336301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:08.336994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:08.337284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:08.337580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] PATH_INFO: `/v3/projects/efa05be5a12844408742a7dab9305318/users/2f996a3257fa456b9220e5231609dab4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:08.340525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa05be5a12844408742a7dab9305318, user_id=2f996a3257fa456b9220e5231609dab4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:08.343308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:08.369387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1258/2558] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:08 2022] PUT /identity/v3/projects/efa05be5a12844408742a7dab9305318/users/2f996a3257fa456b9220e5231609dab4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:08.382351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:08.382687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:08.383032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:08.438978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] MFA Rules not processed for user `2f996a3257fa456b9220e5231609dab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:08.440594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:08.621025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1301/2559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:08.812033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:08.814804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:08.967284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0861d-161b-452b-b5f2-e5a572550319 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:08.982857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:08.983664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:08.983945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:08.984922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:09.006100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:09.007891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:09.037109 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1259/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:10.757798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:10.779520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2251d-db35-40b9-a7b5-1b5445ed4e39 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:10.787849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:10.788864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:10.789149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:10.789612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:10.807630 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:10.870024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:10.872139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f351-85ee-44ad-864a-e3daa65bb2e8 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:10.885963 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1302/2561] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:10.910266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:11.019518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eece40d-3386-4f5a-8388-dfea46687137 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:11.027886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:11.029127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:11.029858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:11.031179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] PATH_INFO: `/v3/users/cc879316f009409190f3614673fcc637` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:11.033382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc879316f009409190f3614673fcc637)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:11.038238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:11.110191 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:11.171348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc879316f009409190f3614673fcc637'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.172495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc879316f009409190f3614673fcc637'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.201697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc879316f009409190f3614673fcc637'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.232664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc879316f009409190f3614673fcc637'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.234656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc879316f009409190f3614673fcc637'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.278824 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1260/2562] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:10 2022] DELETE /identity/v3/users/cc879316f009409190f3614673fcc637 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:11.283339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:11.289601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:11.289601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:11.297133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:11.299336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:11.348103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:11.357058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:11.443706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150854-a122-4861-b60b-e517d70a8248 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:11.450500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:11.451176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:11.451461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:11.451738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] PATH_INFO: `/v3/users/f8c135c37b804252a8275d28972d8c31` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:11.452980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c135c37b804252a8275d28972d8c31)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:11.455025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:11.574352 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1303/2563] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:11.589153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:11.590709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:11.631503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c135c37b804252a8275d28972d8c31'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.632348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c135c37b804252a8275d28972d8c31'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.649889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c135c37b804252a8275d28972d8c31'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.676934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c135c37b804252a8275d28972d8c31'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.677786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6858d176-cacc-43e6-b8fa-444a43c4b6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c135c37b804252a8275d28972d8c31'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:11.708292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1261/2564] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:11 2022] DELETE /identity/v3/users/f8c135c37b804252a8275d28972d8c31 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:11.713130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:11.713741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:11.714022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:11.733861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16eefa-b5d4-4125-a6b5-443745c81db0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:11.766892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:11.772071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:11.806624 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:11.877389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:11.881092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:11.881435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:11.883567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:11.888787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:11.959807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1262/2565] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:11.969793 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:11.986518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:11.988445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:12.010699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670134b-a16f-4a80-b404-1e32d3912057 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:12.019880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:12.020670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:12.020964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:12.021240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:12.044344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:12.050821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:12.079364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1263/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:12.090390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:12.097490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:12.120572 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1304/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:12.502887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:12.504971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:12.538881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d071-95a6-485c-91d3-8378f7f88847 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:12.567055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:12.569343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:12.569664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:12.569937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] PATH_INFO: `/v3/projects/065df012fefb435e9a3329b6b1b51b4a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:12.572612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065df012fefb435e9a3329b6b1b51b4a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:12.582147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:12.709940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065df012fefb435e9a3329b6b1b51b4a', 'request_id': 'req-eb1d8d29-2c29-4539-8303-68103697ad95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:12.717351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065df012fefb435e9a3329b6b1b51b4a', 'request_id': 'req-eb1d8d29-2c29-4539-8303-68103697ad95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:12.727165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065df012fefb435e9a3329b6b1b51b4a', 'request_id': 'req-eb1d8d29-2c29-4539-8303-68103697ad95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:12.749074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] The token cache is being invalidate because project 065df012fefb435e9a3329b6b1b51b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:12.749636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:12.750460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:12.755874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1264/2568] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:12 2022] DELETE /identity/v3/projects/065df012fefb435e9a3329b6b1b51b4a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:12.757192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:12.769108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e746-8a1b-4115-ab19-8a342c821ed8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:12.856082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:12.858194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:12.859588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:12.859985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] PATH_INFO: `/v3/users/09a8ec918453488f85edc4a79af2b11d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:12.863815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a8ec918453488f85edc4a79af2b11d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:12.874620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:12.975374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:12.977576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:13.009980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d8d29-2c29-4539-8303-68103697ad95 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:13.010664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a8ec918453488f85edc4a79af2b11d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.032698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:13.034581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:13.036266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:13.036672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] PATH_INFO: `/v3/projects/61aec289e69e4ec6b580caddfd559c66` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:13.038262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aec289e69e4ec6b580caddfd559c66)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:13.038979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a8ec918453488f85edc4a79af2b11d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.043778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:13.071032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a8ec918453488f85edc4a79af2b11d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.074924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a8ec918453488f85edc4a79af2b11d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.078773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a8ec918453488f85edc4a79af2b11d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.108909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1305/2569] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:12 2022] DELETE /identity/v3/users/09a8ec918453488f85edc4a79af2b11d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:13.143110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aec289e69e4ec6b580caddfd559c66', 'request_id': 'req-08aefd25-7293-485a-89ec-d524c7a1cb62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.153099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aec289e69e4ec6b580caddfd559c66', 'request_id': 'req-08aefd25-7293-485a-89ec-d524c7a1cb62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.161189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aec289e69e4ec6b580caddfd559c66', 'request_id': 'req-08aefd25-7293-485a-89ec-d524c7a1cb62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.182002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] The token cache is being invalidate because project 61aec289e69e4ec6b580caddfd559c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:13.182605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.183485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.186415 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1265/2570] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:12 2022] DELETE /identity/v3/projects/61aec289e69e4ec6b580caddfd559c66 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:13.190642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:13.192908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:13.268320 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:13.310375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb199-cf1e-4c92-a75e-140416fd84f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:13.471415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:13.472929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:13.473200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:13.473505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] PATH_INFO: `/v3/users/2f996a3257fa456b9220e5231609dab4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:13.475222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f996a3257fa456b9220e5231609dab4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:13.477487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:13.622521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f996a3257fa456b9220e5231609dab4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.640392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f996a3257fa456b9220e5231609dab4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.640992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:13.642661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:13.668569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f996a3257fa456b9220e5231609dab4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.670160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f996a3257fa456b9220e5231609dab4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.671357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5850151-b684-4af6-8316-dfdd8668fde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f996a3257fa456b9220e5231609dab4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.679416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefd25-7293-485a-89ec-d524c7a1cb62 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:13.692477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:13.695698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:13.696348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:13.699191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] PATH_INFO: `/v3/projects/07de72db09664c1fa135a784f54b3cab` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:13.704508 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1306/2571] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:13 2022] DELETE /identity/v3/users/2f996a3257fa456b9220e5231609dab4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:13.705576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07de72db09664c1fa135a784f54b3cab)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:13.708688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:13.720978 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:13.792010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07de72db09664c1fa135a784f54b3cab', 'request_id': 'req-bbc1b5f4-129b-4c83-ab69-be5759e758c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.804377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07de72db09664c1fa135a784f54b3cab', 'request_id': 'req-bbc1b5f4-129b-4c83-ab69-be5759e758c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.817880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07de72db09664c1fa135a784f54b3cab', 'request_id': 'req-bbc1b5f4-129b-4c83-ab69-be5759e758c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.848837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] The token cache is being invalidate because project 07de72db09664c1fa135a784f54b3cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:13.850634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.852639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbc1b5f4-129b-4c83-ab69-be5759e758c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:13.856039 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1266/2572] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:13 2022] DELETE /identity/v3/projects/07de72db09664c1fa135a784f54b3cab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:13.861125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:13.864199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:13.864614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:13.900968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:13.902318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.018743 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1307/2573] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:14.026577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.027166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.027359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.083895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:14.087239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.104976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1267/2574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:14.110605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.125623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a294-691a-4a55-97cb-196a63c1cbba None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.134807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.136290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.137032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.142503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.143165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:14.143617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.147241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.149095 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:14.178164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1308/2575] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:14.184170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.214616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cef2a-3290-4f80-9b95-7e356704f611 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.228317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.229274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.229811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.230385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.231324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.233602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.256488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.260171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.300445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309744d3-ef53-4787-9072-1c25c52124df admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.316216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.318417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.319818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.320492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] PATH_INFO: `/v3/projects/efa05be5a12844408742a7dab9305318` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.327379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa05be5a12844408742a7dab9305318)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.344963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.347256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1268/2576] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:14 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:14.352419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.447416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa05be5a12844408742a7dab9305318', 'request_id': 'req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:14.460850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa05be5a12844408742a7dab9305318', 'request_id': 'req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:14.477926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa05be5a12844408742a7dab9305318', 'request_id': 'req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:14.522091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] The token cache is being invalidate because project efa05be5a12844408742a7dab9305318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:14.522389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:14.523298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7b6bb7b-e807-4211-bb54-02d1cdd6181d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:14.527207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1309/2577] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:14 2022] DELETE /identity/v3/projects/efa05be5a12844408742a7dab9305318 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:14.537451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.537451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.537689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.553003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c369-1a2e-497b-8a59-b5cb49cf9756 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.587727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:14.621442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.782222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.782852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.783133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.783407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.784046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.786600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4106-b90d-4d6a-966d-a9daf453b9f3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.850635 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1310/2578] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:14.850849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1269/2579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:14 2022] POST /identity/v3/users => generated 296 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:14.850969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.850969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.852882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.853178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.853503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.869886 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:14.890605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106924-7ce7-4f07-aac2-6af1260f6828 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.899400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:14.902123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:14.908663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.910171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.911016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.911442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.912229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.914387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.924105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1270/2580] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:14.928742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.946292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1311/2581] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:14.950416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:14.960218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bafc0-db1a-4924-b5fb-bc5c2981f97a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.964972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfe80-a81e-4878-a0e6-70ab9ebd2213 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:14.970933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.971795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.973587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.974071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:14.974475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.974701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:14.974983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:14.975256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:14.975776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.975916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:14.976223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:14.978523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.980055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:14.998041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1312/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:15.001892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.009043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1271/2583] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:15.016991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.023391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8205072-5202-4fcf-9f89-07db1ba2e8e8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.032150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f3bdc-fddf-4a24-b98e-0dd3076ec9a7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.040687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.041531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.041654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.041991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.042357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] PATH_INFO: `/v3/projects/cec290298c294206965c9569bb3bd700/users/f8ac5a9bf1fc4483b198984f18930e42/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.042767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.043313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.043732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.044791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.047467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.068987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec290298c294206965c9569bb3bd700, user_id=f8ac5a9bf1fc4483b198984f18930e42, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.088632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1272/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:15.098578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b9e-bd90-44b3-8809-49f19661e94d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.100422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.142136 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1313/2585] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:15 2022] PUT /identity/v3/projects/cec290298c294206965c9569bb3bd700/users/f8ac5a9bf1fc4483b198984f18930e42/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:15.207880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa164dc-3ea2-4891-9452-afd123e48fec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.208693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa164dc-3ea2-4891-9452-afd123e48fec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.209187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa164dc-3ea2-4891-9452-afd123e48fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.226772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398bf3-1158-40c4-8481-f87a1889707c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.239566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dfa164dc-3ea2-4891-9452-afd123e48fec None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:15.240991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dfa164dc-3ea2-4891-9452-afd123e48fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:15.292658 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:15.310459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.311950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.312434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.312908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.313791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.316186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.359507 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1314/2586] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:15.365953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.366258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.366540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.367617 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1273/2587] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:15.369208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.392070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1becc59-eccd-49ee-b5fa-70ce5856e872 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.407208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.410195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.410427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.410707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.411399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.420144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.471361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1274/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:15.472994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] MFA Rules not processed for user `f8ac5a9bf1fc4483b198984f18930e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:15.473926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.475273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:15.479507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:15.598876 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:15.606319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1315/2589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:15.611850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.642715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11709f7-6d0b-4362-ab8d-36b4d6f31ba5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.647563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83c035-8f68-4569-b0b5-cba3b0d92346 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.656618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.656842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.657062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.657294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.669435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.672072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.672632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.673776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.675512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.677936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.679561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.680048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.694867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1316/2590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:15.696353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.703026 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1275/2591] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:15.712020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.728371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7993-7560-407e-b5ac-299350dcf01b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.740796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d570d-d432-4dd6-abfb-0ee020b6db14 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:15.746972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.747751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.748408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.748695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.749354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.751534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.758641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:15.759536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.759863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.760384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] PATH_INFO: `/v3/projects/a97a70a2a1744376a7f8a6b5120470e7/users/3260d086db0846e6b305d9cccfdbf976/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.815780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97a70a2a1744376a7f8a6b5120470e7, user_id=3260d086db0846e6b305d9cccfdbf976, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:15.819097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eed50-5273-43ba-9410-ab6f6bfe9649 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:15.845732 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1276/2592] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:15 2022] PUT /identity/v3/projects/a97a70a2a1744376a7f8a6b5120470e7/users/3260d086db0846e6b305d9cccfdbf976/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:15.851375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:15.852012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:15.852501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:15.853327 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1317/2593] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:15.858031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:15.904415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:15.911015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:16.051974 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1277/2594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:16.070145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:16.071705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:16.100137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4777a-c74f-41be-a8c6-44257037cd7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.117982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.118634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.118920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.119653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.119930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.121953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.175291 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1318/2595] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:15 2022] POST /identity/v3/users => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:16.177720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:16.200550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559f84d-57df-4f81-a351-31fff5222fff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.210223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.210561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.210931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.211421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.224466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ac7a7-527e-4290-b106-ce51111b88a0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.244469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.244914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.245257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.245481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.246002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.247601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.247989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.252237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.283440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1278/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:16.296278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1319/2597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:16.301159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:16.316192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61c55-32de-468a-b222-cf9295f4112a service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.329481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.330316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.330726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.331140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] PATH_INFO: `/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4/users/ee80493926ae46939c357bc01592818a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.396556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05cc20a4d8c4ffda8cb3b45e3f674e4, user_id=ee80493926ae46939c357bc01592818a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.400040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.436265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1279/2598] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:16 2022] PUT /identity/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4/users/ee80493926ae46939c357bc01592818a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:16.442044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:16.469647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0944-e5ba-4f4a-8848-6a5106f87dd8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.498731 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:16.634285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.635235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.636091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.636091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.636739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.645253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3f72e-8178-47c2-adf3-b170c94d1cae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.673784 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1320/2599] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:16.678674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:16.704894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f180f-4c16-4476-b483-1a59d9dcf3bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:16.739142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:16.740193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.740590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.740977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] PATH_INFO: `/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4/users/ee80493926ae46939c357bc01592818a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.743729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05cc20a4d8c4ffda8cb3b45e3f674e4, user_id=ee80493926ae46939c357bc01592818a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:16.746790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:16.781165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1280/2600] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:16 2022] PUT /identity/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4/users/ee80493926ae46939c357bc01592818a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:16.791318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6576e-0314-4e68-a497-53523fb1d798 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:16.791598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6576e-0314-4e68-a497-53523fb1d798 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:16.791878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6576e-0314-4e68-a497-53523fb1d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:16.866532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8bd6576e-0314-4e68-a497-53523fb1d798 None None] MFA Rules not processed for user `ee80493926ae46939c357bc01592818a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:16.868313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8bd6576e-0314-4e68-a497-53523fb1d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:17.134700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1321/2601] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:17.346900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:17.349113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d045-f634-45a0-aa81-97da08b48d1c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:17.349527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:17.350183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d045-f634-45a0-aa81-97da08b48d1c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:17.350183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d045-f634-45a0-aa81-97da08b48d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:17.459850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c8e2d045-f634-45a0-aa81-97da08b48d1c None None] MFA Rules not processed for user `5854d8d6e34543948c1c3ddea3f0b5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:17.461851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8e2d045-f634-45a0-aa81-97da08b48d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:17.714123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1322/2602] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:17.725300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:17.725638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:17.725917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:17.784906 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:17.786571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] MFA Rules not processed for user `545456a4a4e540be9138c47b0df77bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:17.793671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:17.840609 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:17.903754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9e4e-5866-4686-919b-c1499039fb22 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:17.922117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:17.923062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:17.923506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:17.923936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:17.931222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1323/2603] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:17.946041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:17.947954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae790-064a-4c63-9796-ad567506f885 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:17.986177 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1281/2604] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:18.234146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:18.235169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:18.247443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:18.248106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:18.248761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:18.281470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61d5d-5efe-4346-bea9-f478d00d1878 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:18.291242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] MFA Rules not processed for user `fe77600029ff40f8b738c097bf184495`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:18.296897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:18.311399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:18.316162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:18.322164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:18.322491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:18.334205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:18.375717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:18.381830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:18.482214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1324/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:18.493044 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1282/2606] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:20.540987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:20.559353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321dcca-0fbd-466c-8ad0-78c0cecf3f72 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:20.570141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:20.571233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:20.571691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:20.572171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:20.717794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:20.719606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250b0f4-4e4d-4e9d-8e35-7ada1aa1faa7 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:20.749266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1325/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:20.772548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:20.952556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67bd2d-66b1-4175-85d8-2c28eb8ab30c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:20.977582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:20.978356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:20.979057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:20.979057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] PATH_INFO: `/v3/users/f8ac5a9bf1fc4483b198984f18930e42` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:20.982762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ac5a9bf1fc4483b198984f18930e42)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:20.987018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:21.103720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ac5a9bf1fc4483b198984f18930e42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:21.105370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ac5a9bf1fc4483b198984f18930e42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:21.114891 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:21.122983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ac5a9bf1fc4483b198984f18930e42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:21.153527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ac5a9bf1fc4483b198984f18930e42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:21.154684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ac5a9bf1fc4483b198984f18930e42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:21.188439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1283/2608] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:20 2022] DELETE /identity/v3/users/f8ac5a9bf1fc4483b198984f18930e42 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:21.193584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:21.194348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:21.194631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:21.240157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:21.242144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:21.393453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1326/2609] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:21.406327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:21.409662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:21.584743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68b921-f64d-45d7-9a6b-75fb5d12e27b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:21.592892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:21.593532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:21.593814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:21.594091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:21.626300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:21.634782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:21.674935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1284/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:22.619066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:22.621784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:22.670499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997c4b7-c874-40b4-8aa6-ec7ff866b99b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:22.695261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:22.696148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:22.696774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:22.697253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] PATH_INFO: `/v3/projects/cec290298c294206965c9569bb3bd700` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:22.699338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec290298c294206965c9569bb3bd700)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:22.701901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:22.837544 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:22.845011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec290298c294206965c9569bb3bd700', 'request_id': 'req-8c780f5b-662e-467f-8168-800194d48cf1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:22.874273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec290298c294206965c9569bb3bd700', 'request_id': 'req-8c780f5b-662e-467f-8168-800194d48cf1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:22.894950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec290298c294206965c9569bb3bd700', 'request_id': 'req-8c780f5b-662e-467f-8168-800194d48cf1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:22.941359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] The token cache is being invalidate because project cec290298c294206965c9569bb3bd700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:22.943021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:22.946005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:22.953198 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1327/2611] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:22 2022] DELETE /identity/v3/projects/cec290298c294206965c9569bb3bd700 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:22.954593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:22.970191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856ee4f-31e1-4550-b650-9e75abbd2814 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:23.134311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:23.141572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:23.142561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:23.143118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] PATH_INFO: `/v3/users/ee80493926ae46939c357bc01592818a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:23.145613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee80493926ae46939c357bc01592818a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:23.148636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:23.279083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee80493926ae46939c357bc01592818a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:23.279712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee80493926ae46939c357bc01592818a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:23.298382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee80493926ae46939c357bc01592818a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:23.342112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee80493926ae46939c357bc01592818a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:23.343059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8bdd7f59-b8fd-4433-ae4f-62906d7cf042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee80493926ae46939c357bc01592818a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:23.353921 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:23.392749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1285/2612] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:22 2022] DELETE /identity/v3/users/ee80493926ae46939c357bc01592818a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:25.368536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:25.370515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:25.398861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780f5b-662e-467f-8168-800194d48cf1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:25.575991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:25.577736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:25.578247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:25.578729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] PATH_INFO: `/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:25.581669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05cc20a4d8c4ffda8cb3b45e3f674e4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:25.586522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:25.690215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05cc20a4d8c4ffda8cb3b45e3f674e4', 'request_id': 'req-211ee28c-7a6d-4a81-8a62-ab6e471d3447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:25.706640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05cc20a4d8c4ffda8cb3b45e3f674e4', 'request_id': 'req-211ee28c-7a6d-4a81-8a62-ab6e471d3447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:25.725192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05cc20a4d8c4ffda8cb3b45e3f674e4', 'request_id': 'req-211ee28c-7a6d-4a81-8a62-ab6e471d3447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:25.748048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] The token cache is being invalidate because project a05cc20a4d8c4ffda8cb3b45e3f674e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:25.748361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:25.750482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-211ee28c-7a6d-4a81-8a62-ab6e471d3447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:25.760652 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1328/2613] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:25 2022] DELETE /identity/v3/projects/a05cc20a4d8c4ffda8cb3b45e3f674e4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:25.760869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:25.761366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:25.761511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:25.814914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:25.819280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:25.985861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1286/2614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:25.988305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229894da-172a-4983-a108-17d173160bd1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:25.989179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229894da-172a-4983-a108-17d173160bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:25.989739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229894da-172a-4983-a108-17d173160bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.036096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-229894da-172a-4983-a108-17d173160bd1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:26.038479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-229894da-172a-4983-a108-17d173160bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:26.051534 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1329/2615] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:26.060173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.074330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f7cd-a087-4faf-bddc-f3f6f1a6492b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.085743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.087111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.087780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.088539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.090163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:26.090853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.094663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.151926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229894da-172a-4983-a108-17d173160bd1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.161280 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1287/2616] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:26.168840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229894da-172a-4983-a108-17d173160bd1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.179165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.180714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.181480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.182100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.182924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.187032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.253669 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1330/2617] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:26 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:03:26.255638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.287356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a84285-b890-4e5f-97d4-51d402bad366 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.463971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.464650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.464933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.465206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.466225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.468197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.569123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.571890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1288/2618] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:26 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:03:26.592669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ea85d-d5e9-4cc6-b900-aac08db934ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.604164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.605319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.605654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.606547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.608450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.622868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.664812 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1331/2619] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:26.674635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.702594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35996-ece6-4bd0-ae23-5d7633ee050f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.720943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.722986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.723547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.724107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.725745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.740847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c924f-6822-4c1b-acf4-6395fd206c63 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.774258 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1289/2620] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:26.775036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:26.793093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dff7f6-44b0-4cf8-83e4-ae4eecd277e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:26.809905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:26.810906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.811261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.811666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] PATH_INFO: `/v3/projects/f7afc63d70434b138d1b64efaa8b6b1c/users/a98f5be7a70e487c9b394093cfd6deca/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.839647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7afc63d70434b138d1b64efaa8b6b1c, user_id=a98f5be7a70e487c9b394093cfd6deca, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:26.845960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:26.864926 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:26.880686 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1332/2621] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:26 2022] PUT /identity/v3/projects/f7afc63d70434b138d1b64efaa8b6b1c/users/a98f5be7a70e487c9b394093cfd6deca/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:26.900269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:26.900551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:26.900784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:26.983841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] MFA Rules not processed for user `a98f5be7a70e487c9b394093cfd6deca`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:26.986303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:27.189953 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:27.312260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1290/2622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:28.111189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:28.114025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:28.348166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b9fca-aa96-4cac-a13f-dc6a40115ab3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:28.363586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:28.364213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:28.364498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:28.364770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:28.378254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:28.389660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9036d2-8997-47be-9d53-f653a34c5866 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:28.417393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1333/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:29.178019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:29.348193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a882-4ec2-47ad-968b-993150a59c2f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:29.354152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:29.355536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:29.356057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:29.356565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] PATH_INFO: `/v3/users/a98f5be7a70e487c9b394093cfd6deca` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:29.358554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98f5be7a70e487c9b394093cfd6deca)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:29.362886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:29.481018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98f5be7a70e487c9b394093cfd6deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:29.481846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98f5be7a70e487c9b394093cfd6deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:29.494752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98f5be7a70e487c9b394093cfd6deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:29.533916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98f5be7a70e487c9b394093cfd6deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:29.537284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98f5be7a70e487c9b394093cfd6deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:29.560573 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1291/2624] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:29 2022] DELETE /identity/v3/users/a98f5be7a70e487c9b394093cfd6deca => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:29.564920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:29.566783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:29.567273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:29.610362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:29.615533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:29.783845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1334/2625] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:29.865739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:29.867539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:30.047779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102f943-0f3f-408e-9119-8e1b4c720873 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:30.063026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:30.064841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:30.064841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:30.064841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:30.098290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:30.100047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:30.137893 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1292/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:31.356468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:31.359430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:31.571881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d34dc-59bc-4bfe-8dd0-c0cc3384755d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:31.591095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:31.591929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:31.592322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:31.592701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:31.600067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:31.665348 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:31.831630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:31.833935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3163bd-ba95-44c0-883e-fccdca10ca02 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:31.866584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1335/2627] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:32.296814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:32.298492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:32.321593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6cdc7-a6b0-4dfd-8d84-5618829597ca service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:32.333345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:32.334546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:32.335043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:32.335529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] PATH_INFO: `/v3/projects/f7afc63d70434b138d1b64efaa8b6b1c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:32.337026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7afc63d70434b138d1b64efaa8b6b1c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:32.339228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:32.344007 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:32.618947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7afc63d70434b138d1b64efaa8b6b1c', 'request_id': 'req-6f5e980c-de76-46a5-a93f-e54c92b8d245'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:32.649716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7afc63d70434b138d1b64efaa8b6b1c', 'request_id': 'req-6f5e980c-de76-46a5-a93f-e54c92b8d245'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:32.657938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7afc63d70434b138d1b64efaa8b6b1c', 'request_id': 'req-6f5e980c-de76-46a5-a93f-e54c92b8d245'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:32.687888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] The token cache is being invalidate because project f7afc63d70434b138d1b64efaa8b6b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:32.691893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:32.695827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faddd53-ef4b-49cf-9acf-54a2367c3fb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:32.696771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faddd53-ef4b-49cf-9acf-54a2367c3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:32.697222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faddd53-ef4b-49cf-9acf-54a2367c3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:32.709606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f5e980c-de76-46a5-a93f-e54c92b8d245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:32.717001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1293/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:32 2022] DELETE /identity/v3/projects/f7afc63d70434b138d1b64efaa8b6b1c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:32.722777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:32.723105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:32.723348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:32.783414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:32.785231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:32.804706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6faddd53-ef4b-49cf-9acf-54a2367c3fb0 None None] MFA Rules not processed for user `3260d086db0846e6b305d9cccfdbf976`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:32.806022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6faddd53-ef4b-49cf-9acf-54a2367c3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:33.015611 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1336/2629] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:03:33.043066 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1294/2630] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:33.051438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.052307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.052902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.098387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:33.100718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:33.134540 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1337/2631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:33.137209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:33.166347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ce5b8-90e5-479c-84e5-1c95e8a85f75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:33.188092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:33.188759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.189056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.189282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.189978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:33.190359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:33.192276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:33.244975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1295/2632] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:33.249975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:33.260656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece8e3-1720-47fc-a63a-4d511b3a116a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:33.280383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:33.286247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.287606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.287906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.292999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:33.295817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8a6e-8a74-417c-a157-f668f74ec1b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:33.322783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:33.326369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:33.434887 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1338/2633] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:33 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:33.438036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.438849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.439731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.527177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cacd-d56e-4f82-a94f-b850edf326bf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:33.565175 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:33.688794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:33.690060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:33.697394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:33.698210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.698654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.699770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.790958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1339/2634] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:33.792556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:33.841932 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:33.885374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:33.887246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:33.933630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1296/2635] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:33.964325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367b1a-3150-4ace-b6f1-1eb34544dc11 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:33.975627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:33.976614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:33.977068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:33.977734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:33.986417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:33.991046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:34.045761 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1340/2636] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:33 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:34.046423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:34.064782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987bcf-4b7f-4f20-9dd5-d9af0048167b service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:34.076194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:34.076645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:34.076931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:34.077208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:34.078005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:34.079554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:34.116475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1297/2637] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:34.120984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:34.137338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0ed83-6d1e-4179-bd80-ef2fd8fc4b59 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:34.152606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:34.155499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:34.156032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:34.156611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:34.158796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:34.163147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc1705-ef0a-4cb9-8c35-bd214b8a3526 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:34.194490 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1341/2638] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:34.198930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:34.218695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc073-6273-465a-9700-8c280825cdd6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:34.232581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:34.233290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:34.233596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:34.233875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] PATH_INFO: `/v3/projects/624fa9637d2844fbbce4439455fbe41f/users/1e62f0277cf04e87be2017098f3d6327/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:34.285538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624fa9637d2844fbbce4439455fbe41f, user_id=1e62f0277cf04e87be2017098f3d6327, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:34.291002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:34.342581 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1298/2639] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:34 2022] PUT /identity/v3/projects/624fa9637d2844fbbce4439455fbe41f/users/1e62f0277cf04e87be2017098f3d6327/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:34.348979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:34.349689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:34.350195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:34.397369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:34.399148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:34.585091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1342/2640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:34.722039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:34.724281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:34.936671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09e96-0e7c-4d7d-890a-a47f7dbba960 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:34.950327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:34.951003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:34.951292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:34.951567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:34.978414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:34.980155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451cde5-d25a-40fe-be5a-f1e8facef551 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:35.006363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1299/2641] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:44.564894 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:44.998765 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:46.747977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:46.750692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:46.979910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a0700-a8f9-46f8-ac5c-e62d6ca24f4b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:46.991458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:46.993450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:46.993450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:46.993450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:46.999914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:47.023915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:47.025683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:47.050493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1343/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:50.638444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:50.640597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:50.641977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:50.709056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] MFA Rules not processed for user `1e62f0277cf04e87be2017098f3d6327`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:50.711777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:50.918656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1300/2643] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:50.925480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:50.951558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1102006-31ea-419c-afc9-081b7b0e75cd service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:50.957845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:50.958708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:50.958987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:50.959441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:50.960264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:50.962504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.056091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1344/2644] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:50 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:51.058056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.082290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633c50-e007-4dd5-84ce-172cd17fb1e7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.182367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.183119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.183526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.183894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.184640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.188328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.209713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.231338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1301/2645] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:51 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:51.232963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.257312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e94d-5151-43eb-b85b-9bc7468c40e6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.271730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.272371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.272652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.272921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.273616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.275275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.309486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1302/2646] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:03:51.316139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.352598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da64a5b-06a7-460f-a591-c86ce1e23c5f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.378447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.379164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.379663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.381278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] PATH_INFO: `/v3/projects/3fdc8578ba924129bdaf870344fbb0a9/users/57fabc03383348fd9f3726513f3007c9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.423838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e144b54-96cd-4d9e-bc75-6783957baad5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.451582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.452363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.452861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.453351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.458203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc8578ba924129bdaf870344fbb0a9, user_id=57fabc03383348fd9f3726513f3007c9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.467404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.473299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:51.526967 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1303/2647] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:51 2022] PUT /identity/v3/projects/3fdc8578ba924129bdaf870344fbb0a9/users/57fabc03383348fd9f3726513f3007c9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:51.528679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.644349 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:51.691573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2b59-5fcc-4a7c-9886-cfd08614c37a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.702396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.703545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.704045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.704516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.706576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.710852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.746129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1304/2648] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:51.749100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:51.761771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.766610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051857-7582-43fa-b7e1-a329c6db32e3 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.776427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a21dc-a334-4a4e-b679-b7f59ef7ef2a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:51.781813 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:51.789917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:51.792638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:51.793128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:51.793824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] PATH_INFO: `/v3/projects/3fdc8578ba924129bdaf870344fbb0a9/users/57fabc03383348fd9f3726513f3007c9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:51.798802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc8578ba924129bdaf870344fbb0a9, user_id=57fabc03383348fd9f3726513f3007c9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:51.807048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e940f-dd40-42dc-a007-0eb3e9d96056 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:51.818297 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1345/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:03:51.839870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1305/2650] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:51 2022] PUT /identity/v3/projects/3fdc8578ba924129bdaf870344fbb0a9/users/57fabc03383348fd9f3726513f3007c9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:52.984729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:52.985698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:52.985698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:52.987384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1346/2651] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:03:53.022197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:53.023043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:53.023194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:53.093738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:53.096738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:53.173665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:53.175211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:53.287449 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1306/2652] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:53.297072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cca3-d3e8-4198-8664-3ecaec951c1a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:53.304173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:53.305606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:53.306412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:53.306796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] PATH_INFO: `/v3/users/3260d086db0846e6b305d9cccfdbf976` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:53.308257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3260d086db0846e6b305d9cccfdbf976)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:53.319111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:53.321314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:53.328531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:53.356342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17b8b-1948-4a35-83bf-4c06361ff808 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:53.374923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:53.375641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:53.375931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:53.376299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:53.406232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:53.422762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:53.442724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3260d086db0846e6b305d9cccfdbf976'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:53.443349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1307/2653] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:53.453177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3260d086db0846e6b305d9cccfdbf976'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:53.475214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3260d086db0846e6b305d9cccfdbf976'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:53.477050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3260d086db0846e6b305d9cccfdbf976'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:53.478531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-711aafbf-55b2-4293-99bd-3286fa212eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3260d086db0846e6b305d9cccfdbf976'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:53.506421 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1347/2654] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:03:53 2022] DELETE /identity/v3/users/3260d086db0846e6b305d9cccfdbf976 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:03:53.984918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:54.020016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3c8e4-9764-44e1-884f-76beda800194 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:54.294716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:54.296920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.297758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.300378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] PATH_INFO: `/v3/projects/a97a70a2a1744376a7f8a6b5120470e7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.303944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97a70a2a1744376a7f8a6b5120470e7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:54.309242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:54.457811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97a70a2a1744376a7f8a6b5120470e7', 'request_id': 'req-1169f88c-53c0-413d-9010-8647cadcdf70'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:54.461353 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:54.463464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.463980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.464099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.471384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97a70a2a1744376a7f8a6b5120470e7', 'request_id': 'req-1169f88c-53c0-413d-9010-8647cadcdf70'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:54.482440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97a70a2a1744376a7f8a6b5120470e7', 'request_id': 'req-1169f88c-53c0-413d-9010-8647cadcdf70'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:54.512084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:54.514369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:54.537245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] The token cache is being invalidate because project a97a70a2a1744376a7f8a6b5120470e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:03:54.537900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:54.541120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1169f88c-53c0-413d-9010-8647cadcdf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:03:54.545133 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1308/2655] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:53 2022] DELETE /identity/v3/projects/a97a70a2a1744376a7f8a6b5120470e7 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:54.552726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1994bf-2fe5-4d3a-ab92-c2f0f8bb58be None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.553941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1994bf-2fe5-4d3a-ab92-c2f0f8bb58be None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.554932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1994bf-2fe5-4d3a-ab92-c2f0f8bb58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.600734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ef1994bf-2fe5-4d3a-ab92-c2f0f8bb58be None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:54.603395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef1994bf-2fe5-4d3a-ab92-c2f0f8bb58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:54.634727 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1348/2656] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:54.649972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:54.651241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:54.712457 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:54.793211 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1309/2657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:54.797811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.797811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.797811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.834624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:54.838177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:54.839654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a4abf-09ca-4b00-9e5b-d667ef3f0114 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:54.849739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:54.851700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.852675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.853539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.854715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1310/2658] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:54.864608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:54.886999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:54.889922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:54.896067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61294489-41d6-4265-aa16-dcf33f170c5c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:54.903627 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1349/2659] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:03:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:03:54.908197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:54.909045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.909468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.909956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.911145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:03:54.911415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:54.914206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:54.933971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1311/2660] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:03:54.940578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:54.967341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b8ee-00da-4f17-ba17-d33c56227db7 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:54.988016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:54.989137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:54.989863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:54.990322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:54.991163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:54.993661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:55.075791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:55.076208 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1350/2661] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:03:54 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:55.093241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad801-5b79-4114-914d-0b84200a4080 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:55.309875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:55.311306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:55.311791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:55.312861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:55.315637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:55.320441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:55.371591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1312/2662] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:03:55 2022] POST /identity/v3/users => generated 294 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:03:55.375501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:55.401213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020e97-b634-495c-866c-c3e8ffaffe97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:55.407561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:55.408213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:55.409113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:55.409483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:55.410609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:55.418396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:55.451439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1351/2663] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:55.453586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:55.491608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa555-5099-428d-8394-5c7e0dc95d57 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:55.509309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:55.509589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:55.510128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:55.512891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:55.517033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:55.525666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bef0a0-fd69-4a2c-b211-23056e744b99 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:55.577931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:55.588312 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1313/2664] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:03:55.600307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b8dc-6da6-42ee-bf5d-4e6ecba3b858 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:55.607417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:55.608218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:55.608496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:55.608978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] PATH_INFO: `/v3/projects/ae4604b9d224479fbb818f6b87f862b7/users/911ffff8013d461683827935d51de2cf/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:55.649166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4604b9d224479fbb818f6b87f862b7, user_id=911ffff8013d461683827935d51de2cf, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:55.653282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:55.718851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670394-6c1f-41e6-bf69-754851d4236e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:55.719631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670394-6c1f-41e6-bf69-754851d4236e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:55.720150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670394-6c1f-41e6-bf69-754851d4236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:55.730475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1352/2665] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:03:55 2022] PUT /identity/v3/projects/ae4604b9d224479fbb818f6b87f862b7/users/911ffff8013d461683827935d51de2cf/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:03:55.751471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-db670394-6c1f-41e6-bf69-754851d4236e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:55.753231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db670394-6c1f-41e6-bf69-754851d4236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:55.868326 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:55.944989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1314/2666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:55.961226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:55.963206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:56.102208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09e140-68c6-420f-ae0b-6ea8e4a945f9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:56.107138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:56.107782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:56.108059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:56.108331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:56.133459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:56.135127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683735-ef53-42f2-a37a-9e59d027db92 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:56.159995 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1353/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:56.755319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87c66-3650-4d20-b1c0-1fcba0e0d748 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:56.756311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87c66-3650-4d20-b1c0-1fcba0e0d748 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:56.756626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f87c66-3650-4d20-b1c0-1fcba0e0d748 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:56.758671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1315/2668] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:03:56.771012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd09fa-7406-4fe0-9789-73877fb3d9a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:56.771650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd09fa-7406-4fe0-9789-73877fb3d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:56.771868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd09fa-7406-4fe0-9789-73877fb3d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:56.816478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1bcd09fa-7406-4fe0-9789-73877fb3d9a7 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:56.817902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1bcd09fa-7406-4fe0-9789-73877fb3d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:56.977300 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:57.012924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1354/2669] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:57.089358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87c66-3650-4d20-b1c0-1fcba0e0d748 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:57.107292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f87c66-3650-4d20-b1c0-1fcba0e0d748 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:57.123964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:57.124887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:57.125316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:57.125902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:57.154223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:57.159714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:57.195844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1316/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:03:57.259325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24ee6-72e2-4f24-83e9-608be24c3982 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:57.259623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24ee6-72e2-4f24-83e9-608be24c3982 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:57.259974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24ee6-72e2-4f24-83e9-608be24c3982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:57.319600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-35f24ee6-72e2-4f24-83e9-608be24c3982 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:03:57.331928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35f24ee6-72e2-4f24-83e9-608be24c3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:03:57.357219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1355/2671] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:03:57.401919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:03:57.428792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8c7a-9dcc-416f-93f2-82ccf1d66541 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:03:57.445492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:03:57.450083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:03:57.450470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:03:57.450969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:03:57.475918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:03:57.478782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:03:57.491229 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1317/2672] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:03:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:05.760087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:05.761704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:05.762230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:05.818520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] MFA Rules not processed for user `57fabc03383348fd9f3726513f3007c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:05.820014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:05.997015 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1356/2673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:06.012439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:06.014779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:06.230723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1e08-7a60-4462-8cff-d3ea7a6c7fb8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:06.243774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:06.244809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:06.245131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:06.245450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:06.257084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:06.394801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:06.397101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09213b10-7b67-4632-bd37-1b068735444a service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:06.424488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1318/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:13.444057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:13.448294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:13.539098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a58b48-09e2-42e1-9059-db7e15f392f6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:13.579613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:13.583284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:13.584198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:13.584900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] PATH_INFO: `/v3/users/2eddf0cd4fb54de2ab7f26843380a1be` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:13.590109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eddf0cd4fb54de2ab7f26843380a1be)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:13.593193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:13.690736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eddf0cd4fb54de2ab7f26843380a1be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:13.701912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eddf0cd4fb54de2ab7f26843380a1be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:13.742790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eddf0cd4fb54de2ab7f26843380a1be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:13.744028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eddf0cd4fb54de2ab7f26843380a1be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:13.745333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eddf0cd4fb54de2ab7f26843380a1be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:13.790507 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1357/2675] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:04:13 2022] DELETE /identity/v3/users/2eddf0cd4fb54de2ab7f26843380a1be => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:13.797818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:13.800137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:13.801816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:13.909685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:13.914719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:14.085845 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:14.131260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1319/2676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:14.159450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:14.161526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:14.350383 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:14.427104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c43d5-a063-4108-bfe1-2ed596d76cdb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:14.444134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:14.445812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:14.446253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:14.450992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:14.499856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:14.502491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:14.550235 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1358/2677] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:14.958578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:14.960122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:14.987911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448c58-d932-43cb-924d-01a2f06071c3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:15.010934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:15.027231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:15.028044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:15.029596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] PATH_INFO: `/v3/projects/66b3353b3fbc4f97a0387a6c40e4fb15` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:15.031607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b3353b3fbc4f97a0387a6c40e4fb15)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:15.038214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:15.158201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b3353b3fbc4f97a0387a6c40e4fb15', 'request_id': 'req-7b757e3a-cfbd-411b-9e90-7ded7bec3778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.170799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b3353b3fbc4f97a0387a6c40e4fb15', 'request_id': 'req-7b757e3a-cfbd-411b-9e90-7ded7bec3778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.181931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b3353b3fbc4f97a0387a6c40e4fb15', 'request_id': 'req-7b757e3a-cfbd-411b-9e90-7ded7bec3778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.241649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] The token cache is being invalidate because project 66b3353b3fbc4f97a0387a6c40e4fb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:04:15.241996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.242647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.250085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:15.256756 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1320/2678] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:14 2022] DELETE /identity/v3/projects/66b3353b3fbc4f97a0387a6c40e4fb15 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:15.265546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd50a-b07c-415c-a257-a093705f4b30 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:15.425289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:15.425996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:15.426265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:15.426534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] PATH_INFO: `/v3/users/46e97397fc0d4e9e980eb3138ae9b872` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:15.437986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e97397fc0d4e9e980eb3138ae9b872)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:15.440497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:15.614624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e97397fc0d4e9e980eb3138ae9b872'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.639267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e97397fc0d4e9e980eb3138ae9b872'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.687027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e97397fc0d4e9e980eb3138ae9b872'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.688016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e97397fc0d4e9e980eb3138ae9b872'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.688874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17f190d3-7e3d-4910-8fac-876abb356785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e97397fc0d4e9e980eb3138ae9b872'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:15.716216 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1359/2679] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:04:15 2022] DELETE /identity/v3/users/46e97397fc0d4e9e980eb3138ae9b872 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:16.275484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:16.277740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:16.322950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757e3a-cfbd-411b-9e90-7ded7bec3778 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:16.535672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:16.539663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:16.540425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:16.544399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] PATH_INFO: `/v3/projects/f14704bcf9e547a88595a26c70a98a00` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:16.550847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14704bcf9e547a88595a26c70a98a00)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:16.552806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:16.605129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b417-16bf-4cf8-8882-8a12d330f5e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:16.605634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b417-16bf-4cf8-8882-8a12d330f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:16.606096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b417-16bf-4cf8-8882-8a12d330f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:16.710062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b091b417-16bf-4cf8-8882-8a12d330f5e3 None None] MFA Rules not processed for user `911ffff8013d461683827935d51de2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:16.712301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b091b417-16bf-4cf8-8882-8a12d330f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:16.728737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14704bcf9e547a88595a26c70a98a00', 'request_id': 'req-b138b558-8e35-43ec-bc88-1f7395fc4617'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:16.755935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14704bcf9e547a88595a26c70a98a00', 'request_id': 'req-b138b558-8e35-43ec-bc88-1f7395fc4617'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:16.765805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14704bcf9e547a88595a26c70a98a00', 'request_id': 'req-b138b558-8e35-43ec-bc88-1f7395fc4617'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:16.814053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] The token cache is being invalidate because project f14704bcf9e547a88595a26c70a98a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:04:16.815356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:16.817339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b138b558-8e35-43ec-bc88-1f7395fc4617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:16.825975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1321/2680] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:16 2022] DELETE /identity/v3/projects/f14704bcf9e547a88595a26c70a98a00 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:16.832130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:16.832695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:16.836536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:16.865377 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:16.867318 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:16.902480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1360/2681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:04:16.903840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:16.906804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:17.128511 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1322/2682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:17.137389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.137709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.138027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.207559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:17.224755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:17.251969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1361/2683] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:17.257916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.275830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d8d85-5855-47c4-bdea-e19e02e0fabd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:17.311419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:17.312063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.312351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.316439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.322770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:04:17.322770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:17.322770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:17.371358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.376235 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1323/2684] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:04:17.399012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b268569-1f50-4f6a-840a-f033885921e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:17.422065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:17.434337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.434337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.436401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.437716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.439867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:17.443774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:17.448516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:17.579694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1362/2685] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:04:17 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:04:17.584838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.615181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a0c9-dc6d-4867-a0da-556ecd5a4f42 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:17.790256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:17.791571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.792625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.792911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.795186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42250-7875-4605-8a2a-7d0012636fd9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:17.818946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:17.819870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.820321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.820757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.821625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:17.824481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:17.846814 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:17.877493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1363/2686] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:04:17 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:04:17.881787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.902294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3985d-13c2-4c5e-be13-e12c32cee35e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:17.916608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:17.917916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:17.918554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:17.919050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:17.920478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:17.927160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:17.954214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:17.956511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:17.958819 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1364/2687] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:04:17.961886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:17.997759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1324/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:17.998873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04fc5-00e3-47f3-8f45-4a3913932f84 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:18.011782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:18.013950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:18.014293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:18.014579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:18.017087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:18.019492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb65f7-43dd-4c1e-bcf1-6214e9f6c045 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:18.065355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1365/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:04:18.068062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:18.083629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d522-efb5-40cb-9e30-9b9a43f974a8 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:18.109497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:18.110618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:18.111604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:18.112053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] PATH_INFO: `/v3/projects/b441a5d4d3c84076ac989a842c24b053/users/a111da16efad4df68e12ed703ca9ecf4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:18.134748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b441a5d4d3c84076ac989a842c24b053, user_id=a111da16efad4df68e12ed703ca9ecf4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:18.138264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:18.178000 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1325/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:04:18 2022] PUT /identity/v3/projects/b441a5d4d3c84076ac989a842c24b053/users/a111da16efad4df68e12ed703ca9ecf4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:18.190095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b4f6e-b8db-48a5-85f6-221703b099f6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:18.190393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b4f6e-b8db-48a5-85f6-221703b099f6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:18.190709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b4f6e-b8db-48a5-85f6-221703b099f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:18.299101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-334b4f6e-b8db-48a5-85f6-221703b099f6 None None] MFA Rules not processed for user `a111da16efad4df68e12ed703ca9ecf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:18.300540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-334b4f6e-b8db-48a5-85f6-221703b099f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:18.506953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1366/2691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:21.171737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:21.308487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd83f8-7474-4a13-90c4-1568f1498267 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:21.316327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:21.317133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:21.317641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:21.318018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:21.335281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:21.337242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:21.368466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1326/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:21.556206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:21.560528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:21.561250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:21.617647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:21.618950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:21.681652 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:21.773576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1367/2693] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:24.820713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:24.822197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:25.019925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e21d-dc06-45ee-99c8-83b933c40d31 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:25.043319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:25.045995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:25.050422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:25.050422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:25.053710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:25.057572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:25.063713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:25.083289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:25.086344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a297b-a20b-435b-8331-0836f93a9946 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:25.103785 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1327/2694] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:25.126683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51348f-ae52-4ca3-9d05-fb3df72d1452 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:25.136929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:25.137982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:25.138422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:25.139591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:25.164387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:25.169124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:25.205614 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1368/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:25.321434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71024eb-a82c-46db-bc94-75b16238f147 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:25.325860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71024eb-a82c-46db-bc94-75b16238f147 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:25.326367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71024eb-a82c-46db-bc94-75b16238f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:25.403185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b71024eb-a82c-46db-bc94-75b16238f147 None None] MFA Rules not processed for user `545456a4a4e540be9138c47b0df77bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:25.405832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b71024eb-a82c-46db-bc94-75b16238f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:25.436438 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:25.600849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1328/2696] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:29.714862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:29.920361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24f5c6-ddf0-4434-9f1b-a55f4f3703f5 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:29.927881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:29.928934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:29.930711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:29.934999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:29.936813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:29.937109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:29.937383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] PATH_INFO: `/v3/users/a111da16efad4df68e12ed703ca9ecf4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:29.939913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a111da16efad4df68e12ed703ca9ecf4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:29.945454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:29.963188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:29.965565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:30.072383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a111da16efad4df68e12ed703ca9ecf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:30.088855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a111da16efad4df68e12ed703ca9ecf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:30.129201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a111da16efad4df68e12ed703ca9ecf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:30.130276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a111da16efad4df68e12ed703ca9ecf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:30.131470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5fd1b231-69e9-4830-a1e9-109ae40b843a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a111da16efad4df68e12ed703ca9ecf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:30.144485 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1329/2697] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:04:30.146571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:30.151047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:30.171332 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1369/2698] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:04:29 2022] DELETE /identity/v3/users/a111da16efad4df68e12ed703ca9ecf4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:30.175906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:30.175906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:30.175906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:30.200422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:30.202995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:30.288164 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:30.322331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9a8aa-90fd-4797-a8dd-e44864757d25 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:30.379922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1370/2699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:30.416555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:30.418919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:30.517111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:30.525421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:30.526116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:30.527877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:30.550887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:30.609611 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:30.685012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0bc0-ef30-4ff6-b4b6-f11b009e5c7d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:30.698588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:30.700604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:30.700983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:30.701329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:30.726777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:30.728451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:30.757256 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1371/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:04:30.781643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:30.786256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ff70f-2cf9-4ccf-ae78-2c2db2de391b service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:30.815188 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1330/2701] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:32.944656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:32.947740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:32.981866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3156bde-7f3b-41b4-9903-f5fd8b9cb975 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:32.993160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:32.994318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:32.995700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:32.996224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] PATH_INFO: `/v3/projects/b441a5d4d3c84076ac989a842c24b053` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:32.998235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b441a5d4d3c84076ac989a842c24b053)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:33.000695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:33.164686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b441a5d4d3c84076ac989a842c24b053', 'request_id': 'req-17ded02d-07ae-4be8-8d09-6af306f4241c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:33.176971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b441a5d4d3c84076ac989a842c24b053', 'request_id': 'req-17ded02d-07ae-4be8-8d09-6af306f4241c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:33.188966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b441a5d4d3c84076ac989a842c24b053', 'request_id': 'req-17ded02d-07ae-4be8-8d09-6af306f4241c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:33.216718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] The token cache is being invalidate because project b441a5d4d3c84076ac989a842c24b053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:04:33.217080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:33.217697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17ded02d-07ae-4be8-8d09-6af306f4241c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:04:33.224411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1372/2702] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:32 2022] DELETE /identity/v3/projects/b441a5d4d3c84076ac989a842c24b053 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:33.225903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:33.227495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:33.227495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:33.274813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:33.280073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:33.554797 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1331/2703] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:33.562017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:33.562582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:33.563047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:33.618553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:33.622895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:33.644681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1373/2704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:33.648728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:33.663588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffa84-cb3a-485f-aaf0-9b0423cf3d03 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:33.673921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:33.674870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:33.675338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:33.675950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:33.676801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:04:33.677115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:33.678936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:33.726180 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1332/2705] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:04:33.730650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:33.747812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a309897-d3f4-4b22-830b-08d7cee42f87 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:33.765661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:33.768793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:33.769083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:33.772727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:33.775128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:33.780767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:33.865245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1374/2706] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:04:33 2022] POST /identity/v3/projects => generated 411 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:04:33.868093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:33.893018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d416-8dd4-4dfd-9890-33ae424d6f6e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:34.109657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:34.111134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:34.112276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:34.112558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:34.113626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:34.131635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:34.201436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1333/2707] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:04:33 2022] POST /identity/v3/users => generated 306 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:04:34.201834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:34.228356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01714ee-fa11-4894-80ba-a7175fa60ee1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:34.239646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:34.240888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:34.240888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:34.241113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:34.241891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:34.249130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:34.282109 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1375/2708] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:04:34.284239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:34.309580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a62e-ffc0-4005-986c-da3e8a544b5d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:34.325136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:34.326739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:34.327103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:34.328577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:34.330479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:34.333806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f0b5e-b021-4e94-8379-b86720bd7c16 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:34.348548 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1334/2709] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:04:34.369547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:34.433531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad4d5-6f26-4d92-86af-3b7a7c4a72e3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:34.461499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:34.468182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:34.469018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:34.471318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] PATH_INFO: `/v3/projects/d22d569cfdfb47619e63f469ad2d00bd/users/f07489ff6ce74b7cab3b78a9654e4192/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:34.554417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22d569cfdfb47619e63f469ad2d00bd, user_id=f07489ff6ce74b7cab3b78a9654e4192, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:34.557966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:34.569636 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:34.622685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24012-9274-4d44-832d-6867c0d815e0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:34.623835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24012-9274-4d44-832d-6867c0d815e0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:34.624441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24012-9274-4d44-832d-6867c0d815e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:34.626338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1376/2710] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:04:34 2022] PUT /identity/v3/projects/d22d569cfdfb47619e63f469ad2d00bd/users/f07489ff6ce74b7cab3b78a9654e4192/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:04:34.653434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a3a24012-9274-4d44-832d-6867c0d815e0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:34.655733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a3a24012-9274-4d44-832d-6867c0d815e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:34.669805 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:34.882767 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1335/2711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:34.931154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:34.937787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:35.178585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0864e-db5f-4222-8cf0-d2ebd2aad32c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:35.187726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:35.189656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:35.191880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:35.192365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:35.231894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:35.240465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3255f-bf4d-4b72-8b9c-0527d6d9f0a0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:35.273646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1377/2712] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:44.861973 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=20 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:45.261922 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=28 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:50.400807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:50.401183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:50.401393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:50.447197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] MFA Rules not processed for user `f07489ff6ce74b7cab3b78a9654e4192`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:50.448553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:50.532538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1336/2713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:50.543274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db0c8-74a3-4d82-8136-bdc8d225df7b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:50.544160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db0c8-74a3-4d82-8136-bdc8d225df7b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:50.544643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db0c8-74a3-4d82-8136-bdc8d225df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:50.592062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-806db0c8-74a3-4d82-8136-bdc8d225df7b None None] MFA Rules not processed for user `f07489ff6ce74b7cab3b78a9654e4192`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:50.596225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-806db0c8-74a3-4d82-8136-bdc8d225df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:50.614928 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1378/2714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:04:51.029827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:04:51.031639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:51.193028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6e493-c17c-4a8e-b80e-6c791dd4767b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:04:51.212085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:04:51.214744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:51.215223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:51.215702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:51.243174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:04:51.245224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16d5d-5f03-4c12-b32b-a3f29ce3550d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:04:51.293989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1337/2715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:04:51 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:04:58.313046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:04:58.313659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:04:58.313933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:04:58.423836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:04:58.429582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:04:58.614443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1379/2716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:01.264348 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=66 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:01.723898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:01.724180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:01.724455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:01.788786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] MFA Rules not processed for user `fe77600029ff40f8b738c097bf184495`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:01.791500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:02.029746 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1338/2717] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:06.087826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:06.089528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:06.111737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ce0d7-621e-4c94-a5e6-d44ec7b628f0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:06.128423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:06.129088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:06.129372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:06.129687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] PATH_INFO: `/v3/users/911ffff8013d461683827935d51de2cf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:06.130906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911ffff8013d461683827935d51de2cf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:06.132817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:06.233146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911ffff8013d461683827935d51de2cf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.244555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911ffff8013d461683827935d51de2cf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.277549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911ffff8013d461683827935d51de2cf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.278577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911ffff8013d461683827935d51de2cf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.279946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9bfe2d49-48a3-4910-9e41-92d6ec72e739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911ffff8013d461683827935d51de2cf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.302305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1380/2718] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:06 2022] DELETE /identity/v3/users/911ffff8013d461683827935d51de2cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:06.600088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:06.617157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cf266-7a0b-41eb-a6e7-a2149a9a5297 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:06.708985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:06.710032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:06.710466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:06.710913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] PATH_INFO: `/v3/projects/ae4604b9d224479fbb818f6b87f862b7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:06.712879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4604b9d224479fbb818f6b87f862b7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:06.715019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:06.802408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4604b9d224479fbb818f6b87f862b7', 'request_id': 'req-e9bc4612-a9fe-4000-8e25-6370f2d132f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.817157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4604b9d224479fbb818f6b87f862b7', 'request_id': 'req-e9bc4612-a9fe-4000-8e25-6370f2d132f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.827458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4604b9d224479fbb818f6b87f862b7', 'request_id': 'req-e9bc4612-a9fe-4000-8e25-6370f2d132f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.865014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] The token cache is being invalidate because project ae4604b9d224479fbb818f6b87f862b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:06.865014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.867582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e9bc4612-a9fe-4000-8e25-6370f2d132f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:06.869339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1339/2719] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:06 2022] DELETE /identity/v3/projects/ae4604b9d224479fbb818f6b87f862b7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:06.876528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:06.877050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:06.877578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:06.915748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:06.917102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:07.040528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1381/2720] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:07.048926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.049237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.049712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.074966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:07.076475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:07.097453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1340/2721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:07.102564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.126948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe56e3-0374-480b-8547-496d557b1b80 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.148609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.149806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.150229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.150599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.152427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:05:07.152804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.157965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.176342 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:07.193113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.204599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1382/2722] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:05:07.210813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98ecf-b6a7-4cb3-b965-dd340f16dbe1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.215601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.216221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.217573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.218061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.218952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.221630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.275496 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1341/2723] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:07 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:05:07.279358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.308736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224044f-51e8-4c65-a466-ff47f6c30db3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.433867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.436877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.437172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.437496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.441861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.447193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.497004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1383/2724] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:07 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:07.501629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.531785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1071b4-7c26-4a9a-9bcc-3273c63b2f86 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.550967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.551667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.552015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.552391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.553144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.555254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.561884 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:07.583800 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1342/2725] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:07.585482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.598729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67708524-b063-498b-ab35-1dff469c368b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.613551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.614191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.614471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.615261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.616479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.617620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131c8cd-4077-4b44-883d-aac6fc655f86 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.633190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1384/2726] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:07.634378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.646526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe7d4-d1b8-428f-8c10-7b2be30e8377 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:07.652475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:07.653480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.653760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.654032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] PATH_INFO: `/v3/projects/13257d388164408199a58e3792ea8e83/users/b89692a762994574ba71c634f400323e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.670501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13257d388164408199a58e3792ea8e83, user_id=b89692a762994574ba71c634f400323e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:07.673951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:07.690413 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1343/2727] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:07 2022] PUT /identity/v3/projects/13257d388164408199a58e3792ea8e83/users/b89692a762994574ba71c634f400323e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:05:07.701417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:07.701967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:07.702336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:07.733192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] MFA Rules not processed for user `b89692a762994574ba71c634f400323e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:07.734971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:07.833015 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1385/2728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:07.956792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:07.961144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:08.073732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0fba4-bd1b-42c7-b268-01d6c47e1450 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:08.080767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:08.081617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:08.082000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:08.082341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:08.095333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:08.097177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d993fbe-c7a4-4a15-bede-70a476899dda service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:08.108922 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1344/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:09.652486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:09.751401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d12a-09dd-4e0a-a18f-adb9bb4afdee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:09.763119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:09.764039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:09.764333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:09.764612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] PATH_INFO: `/v3/users/b89692a762994574ba71c634f400323e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:09.766134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89692a762994574ba71c634f400323e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:09.768977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:09.775702 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:09.835908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89692a762994574ba71c634f400323e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:09.847774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89692a762994574ba71c634f400323e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:09.870924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89692a762994574ba71c634f400323e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:09.872245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89692a762994574ba71c634f400323e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:09.873034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89692a762994574ba71c634f400323e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:09.892790 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1386/2730] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:09 2022] DELETE /identity/v3/users/b89692a762994574ba71c634f400323e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:09.897639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:09.898161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:09.898508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:09.926061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:09.927375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:10.013991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1345/2731] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:10.025925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:10.027627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:10.101655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827581-7fc8-4ee9-883a-4c4af47ffb5b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:10.105956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:10.106664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:10.107045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:10.107444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:10.135061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:10.136875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4b8ae-1cde-49b5-81d2-08e75edac212 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:10.154386 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1387/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:05:10.950116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:10.960116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:10.998716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5ff1-6106-4bcf-938d-efdcb597fd80 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.010542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.011485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.011727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.012180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] PATH_INFO: `/v3/projects/13257d388164408199a58e3792ea8e83` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.016074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=13257d388164408199a58e3792ea8e83)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:11.018487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:11.135044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13257d388164408199a58e3792ea8e83', 'request_id': 'req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:11.147918 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:11.162111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13257d388164408199a58e3792ea8e83', 'request_id': 'req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:11.177974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13257d388164408199a58e3792ea8e83', 'request_id': 'req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:11.201138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] The token cache is being invalidate because project 13257d388164408199a58e3792ea8e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:11.202212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:11.203522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c1a7d1c3-e4c9-44e4-8cb4-cf6aff1ae7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:11.211663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1346/2733] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:10 2022] DELETE /identity/v3/projects/13257d388164408199a58e3792ea8e83 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:11.213531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1d76-ac49-4009-a5e2-acf498ea0019 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.214769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1d76-ac49-4009-a5e2-acf498ea0019 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.215451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1d76-ac49-4009-a5e2-acf498ea0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.302620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-baff1d76-ac49-4009-a5e2-acf498ea0019 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:11.306219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-baff1d76-ac49-4009-a5e2-acf498ea0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:11.350976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.351550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.352059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.392010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:11.393848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:11.448968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1388/2734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:11.460939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.461256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.463949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.506056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:11.508645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:11.524148 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1389/2735] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:11.530060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:11.537437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1347/2736] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 25 01:05:11.552558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:11.554103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:11.561777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f124c5-6432-4292-9d42-0dbf73db402f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.580799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.581508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.581796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.582074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.582759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:05:11.583065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:11.584740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:11.631615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1390/2737] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:05:11.637658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:11.656364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3f55-0332-4ed6-9332-479635665b39 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.676819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.678451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.678745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.679019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.679998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:11.682033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:11.683332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a03d6-4866-4bf8-839f-c34d38a2237a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.691867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.693064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.693064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.694152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.699650 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:11.710046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:11.723012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:11.734941 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1348/2738] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:05:11.757044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1391/2739] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:11 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:11.775124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:11.794270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4f5e-9cb0-470e-a2fe-824662048e6c service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.904080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.912002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.912561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.912561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:11.913296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:11.916624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:11.971489 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1349/2740] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:11 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:11.975120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:11.989439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea23b-f936-4ddd-bdc5-1d5183726e69 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:11.997728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:11.998648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:11.999032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:11.999407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.001186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:12.004023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:12.017869 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1392/2741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:12.021864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:12.034050 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:12.039772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb22cb-3514-41d1-99b9-70eb231f3191 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:12.049842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:12.051457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.052056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.052671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.054276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:12.056913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e505ec-91ab-4f04-8f03-92094b953235 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:12.079943 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1350/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:12.084008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:12.095369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfabe-153e-4601-90ce-1c5697de9537 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:12.101058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:12.102363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.102363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.102363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] PATH_INFO: `/v3/projects/e3b524092c484ec3b22d1ce29930fa58/users/46ba0c28dade4f7abf4e3ef3dcafa957/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.122854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b524092c484ec3b22d1ce29930fa58, user_id=46ba0c28dade4f7abf4e3ef3dcafa957, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:12.126475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa69f8-71f1-468a-bd36-b58cef53518d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:12.153036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1393/2743] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:12 2022] PUT /identity/v3/projects/e3b524092c484ec3b22d1ce29930fa58/users/46ba0c28dade4f7abf4e3ef3dcafa957/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:05:12.157230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b532e-12d6-46d1-9946-d46256f751c3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.157230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b532e-12d6-46d1-9946-d46256f751c3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.157230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b532e-12d6-46d1-9946-d46256f751c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.219292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b75b532e-12d6-46d1-9946-d46256f751c3 None None] MFA Rules not processed for user `46ba0c28dade4f7abf4e3ef3dcafa957`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:12.220540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b75b532e-12d6-46d1-9946-d46256f751c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:12.382244 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1351/2744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:12.401008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f95f-1018-4965-b514-132632c3b698 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.401625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f95f-1018-4965-b514-132632c3b698 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.401957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f95f-1018-4965-b514-132632c3b698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.443767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2724f95f-1018-4965-b514-132632c3b698 None None] MFA Rules not processed for user `46ba0c28dade4f7abf4e3ef3dcafa957`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:12.445093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2724f95f-1018-4965-b514-132632c3b698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:12.454274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1394/2745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:12.609211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b748-1d2e-4c2d-81a9-df9656a63196 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.609211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b748-1d2e-4c2d-81a9-df9656a63196 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.609211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b748-1d2e-4c2d-81a9-df9656a63196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.627530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-86e3b748-1d2e-4c2d-81a9-df9656a63196 None None] MFA Rules not processed for user `1e62f0277cf04e87be2017098f3d6327`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:12.628609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86e3b748-1d2e-4c2d-81a9-df9656a63196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:12.686608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.686901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.687177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.704327 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1352/2746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:12.714307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.714596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.714880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.729520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:12.732500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:12.754657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] MFA Rules not processed for user `1e62f0277cf04e87be2017098f3d6327`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:12.757139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:12.780127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1353/2747] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:12.844078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1395/2748] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:12.858865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:12.950154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fff1-8e2f-4820-bd91-248b5501f9da None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:12.959248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:12.960870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:12.961543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:12.962052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:12.991873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:12.994395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:13.006475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1354/2749] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:13.561098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:13.564087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:13.773617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0c1a-b981-421e-8f1d-d1a4432b50bf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:13.783616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:13.785881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:13.785881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:13.785881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:13.799059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:13.801743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:13.814000 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1396/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:16.871378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:16.872903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:16.907816 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:16.998501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53751-0c87-4562-a44d-7ef1ff67e75f service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:17.005246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:17.006399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:17.006899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:17.007367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] PATH_INFO: `/v3/users/98ed412afded46c49d993a2749e42c65` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:17.008616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ed412afded46c49d993a2749e42c65)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:17.011199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:17.085780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ed412afded46c49d993a2749e42c65'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.086530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ed412afded46c49d993a2749e42c65'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.098708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ed412afded46c49d993a2749e42c65'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.118614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ed412afded46c49d993a2749e42c65'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.119449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ed412afded46c49d993a2749e42c65'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.138218 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1355/2751] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:16 2022] DELETE /identity/v3/users/98ed412afded46c49d993a2749e42c65 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:17.550666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:17.570098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38f01-ecbc-4006-b60e-e142a610271d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:17.617840 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:17.661510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:17.662209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:17.662424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:17.662722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] PATH_INFO: `/v3/projects/fbd08c233d6944199beebf1a2e1a1a23` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:17.664033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd08c233d6944199beebf1a2e1a1a23)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:17.667788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:17.750339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd08c233d6944199beebf1a2e1a1a23', 'request_id': 'req-3e627d9b-35d1-49cf-b31c-7a24da0176bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.772319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd08c233d6944199beebf1a2e1a1a23', 'request_id': 'req-3e627d9b-35d1-49cf-b31c-7a24da0176bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.786057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd08c233d6944199beebf1a2e1a1a23', 'request_id': 'req-3e627d9b-35d1-49cf-b31c-7a24da0176bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.803501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] The token cache is being invalidate because project fbd08c233d6944199beebf1a2e1a1a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:17.804560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.804560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e627d9b-35d1-49cf-b31c-7a24da0176bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.806158 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1397/2752] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:17 2022] DELETE /identity/v3/projects/fbd08c233d6944199beebf1a2e1a1a23 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:17.810365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:17.811817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:17.826217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56472658-bdc5-4833-ba1e-5d85bebae055 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:17.891369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:17.892125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:17.892263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:17.892509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] PATH_INFO: `/v3/users/d467ea16905d40ce8b4121b21942bf7d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:17.893719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d467ea16905d40ce8b4121b21942bf7d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:17.895668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:17.941984 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:17.973141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd467ea16905d40ce8b4121b21942bf7d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.974409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd467ea16905d40ce8b4121b21942bf7d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:17.983907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd467ea16905d40ce8b4121b21942bf7d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.000983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd467ea16905d40ce8b4121b21942bf7d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.001782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd467ea16905d40ce8b4121b21942bf7d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.023303 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1356/2753] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:17 2022] DELETE /identity/v3/users/d467ea16905d40ce8b4121b21942bf7d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:18.034658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.034940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.035212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.056361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:18.058553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:18.138305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1398/2754] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:18.159158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.161957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:18.256845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.258433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:18.269576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a66875-a571-4e59-b119-d1164c806b04 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.283540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.285228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.285745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.286868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.299798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.301994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71ee1-f0d6-4739-a307-c29fb61f62b7 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.316236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1357/2755] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:18.349017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744cb91-0061-4ec8-a481-05bb4b724dda None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.354653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.355072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.355339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.355645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] PATH_INFO: `/v3/projects/3d3702a599b248909d6d2828d3ce58bf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.361268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3702a599b248909d6d2828d3ce58bf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.363451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.376701 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:18.431405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3702a599b248909d6d2828d3ce58bf', 'request_id': 'req-1ff51f55-5127-4300-a25e-ed98156cdd71'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.441273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3702a599b248909d6d2828d3ce58bf', 'request_id': 'req-1ff51f55-5127-4300-a25e-ed98156cdd71'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.449319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3702a599b248909d6d2828d3ce58bf', 'request_id': 'req-1ff51f55-5127-4300-a25e-ed98156cdd71'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.466238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] The token cache is being invalidate because project 3d3702a599b248909d6d2828d3ce58bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:18.466534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.472762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ff51f55-5127-4300-a25e-ed98156cdd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:18.475188 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1399/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:18 2022] DELETE /identity/v3/projects/3d3702a599b248909d6d2828d3ce58bf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:05:18.480917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.481682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.482109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.509164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:18.510829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:18.597214 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1358/2757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:18.604597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.605068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.605194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.631098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:18.632336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:18.645522 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1400/2758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:18.657852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.669191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8ddb7-971c-4e43-ae93-10f4136f7b76 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.675550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.676286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.677161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.677493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.678168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:05:18.678474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.680143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.697821 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1359/2759] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:05:18.703563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.716920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd064db-32c7-465e-94a4-6676ed30c066 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.723293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.723915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.724258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.724699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.725553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.727723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.778516 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1401/2760] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:18 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:05:18.779782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.792222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dac79-cd79-4ed5-be69-60d620c5d868 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.821082 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:18.862997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.863623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.863903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.864174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.864820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.866843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.891049 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1360/2761] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:18 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:18.895852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.908315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c71cde-9ebc-4e25-aade-2a79fa63a3af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.913638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.914302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.914580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.915010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.915485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.917109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.933579 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1402/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:05:18.934902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.947024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520244d-65c1-4df4-91cf-2a64ca5a2451 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.953700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.954378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.954840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.955106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:18.955768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:18.957658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21183-1ea5-4ebb-8a02-cd65cff8c2f7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:18.969765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1361/2763] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:18.974195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:18.986941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f8938-6b9f-4f23-a91b-496993b3aea5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:18.991776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:18.992451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:18.992730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:18.993000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] PATH_INFO: `/v3/projects/829ed353f9104a14b276d36b480b850f/users/10739e6066e3468b98e14168ff2df181/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.011007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ed353f9104a14b276d36b480b850f, user_id=10739e6066e3468b98e14168ff2df181, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.013700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.033138 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1403/2764] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:18 2022] PUT /identity/v3/projects/829ed353f9104a14b276d36b480b850f/users/10739e6066e3468b98e14168ff2df181/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:19.043873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.044269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.044637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.076890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] MFA Rules not processed for user `10739e6066e3468b98e14168ff2df181`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:19.078269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:19.160399 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1362/2765] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:19.165143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.250516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a7a0-6d90-4ef3-8873-aa9bdc3d5b83 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.255528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.256158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.257267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.257267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.257563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.259753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.298013 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1404/2766] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:19 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:05:19.299561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.311301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3535922-0e74-46c5-83bc-9e4636674d51 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.377746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.378372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.378655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.378932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.379568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.382152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.429317 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1363/2767] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:19 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:19.430616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.452694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8ca2-9a89-4d9a-9b3d-0b0441154a49 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.460908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.461881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.462202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.462583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.463320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.465339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.488387 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1405/2768] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:05:19.489937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.500477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96b50d-8f4e-46aa-a14f-a73c9deba189 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.506689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.507391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.507670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.507947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] PATH_INFO: `/v3/projects/5672ac1a88784c1daa7592719d1d4653/users/cb5ef9508e0049ca8832d65634a7aaeb/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.531330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5672ac1a88784c1daa7592719d1d4653, user_id=cb5ef9508e0049ca8832d65634a7aaeb, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.534043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.549323 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:19.558816 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1364/2769] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:19 2022] PUT /identity/v3/projects/5672ac1a88784c1daa7592719d1d4653/users/cb5ef9508e0049ca8832d65634a7aaeb/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:19.561793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.574616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990af9b-359f-4500-9d4c-7a1f011d974d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.586604 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:19.649986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.650658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.651035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.651387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.652107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.654438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f8d0-adde-4cf2-a7d8-eeeadb9d3077 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.668251 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1406/2770] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:19.681195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:19.696653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9e694-8346-4d0d-b108-834dba10f1a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:19.702368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:19.703367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.703924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.704294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] PATH_INFO: `/v3/projects/5672ac1a88784c1daa7592719d1d4653/users/cb5ef9508e0049ca8832d65634a7aaeb/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.706486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5672ac1a88784c1daa7592719d1d4653, user_id=cb5ef9508e0049ca8832d65634a7aaeb, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:19.709186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf505dd-ff7c-4b48-b50f-39a5e20429d5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:19.727398 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1365/2771] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:19 2022] PUT /identity/v3/projects/5672ac1a88784c1daa7592719d1d4653/users/cb5ef9508e0049ca8832d65634a7aaeb/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:19.739378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27557-c0cd-4862-b1c9-997c639682c6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.739693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27557-c0cd-4862-b1c9-997c639682c6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.740192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27557-c0cd-4862-b1c9-997c639682c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.774802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c2b27557-c0cd-4862-b1c9-997c639682c6 None None] MFA Rules not processed for user `cb5ef9508e0049ca8832d65634a7aaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:19.776066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2b27557-c0cd-4862-b1c9-997c639682c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:19.872731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1407/2772] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:19.884341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0187b-c0e3-4c95-af46-e648cd66f853 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:19.884622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0187b-c0e3-4c95-af46-e648cd66f853 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:19.884894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0187b-c0e3-4c95-af46-e648cd66f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:19.904240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7ff0187b-c0e3-4c95-af46-e648cd66f853 None None] MFA Rules not processed for user `10739e6066e3468b98e14168ff2df181`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:19.906000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7ff0187b-c0e3-4c95-af46-e648cd66f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:19.975311 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1366/2773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:22.129721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:22.130352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:22.130352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:22.131878 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1408/2774] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:05:22.137784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:22.138934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:22.139431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:22.182199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:22.183469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:22.258901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:22.260931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:22.300862 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1367/2775] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:22.322406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:22.325164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:22.364769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd367ad1-bfec-4dad-9867-9b989d280d71 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:22.372939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:22.373615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:22.373914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:22.374305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:22.386448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:22.388867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3163-b191-4542-907f-81a7ad7107a9 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:22.403680 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1409/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:22.404708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb0409-8f1a-48ae-9d7b-1e68cad077a8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:22.409587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:22.410248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:22.410667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:22.411010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:22.430966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:22.432722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044634-8b40-4d67-8918-69503d0333cc service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:22.446783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1368/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:05:29.032033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:29.032871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:29.032871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:29.071957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:29.074850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:29.105174 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:29.220258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1410/2778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:32.441195 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:37.569716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:37.570365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:37.570365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:37.608062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] MFA Rules not processed for user `545456a4a4e540be9138c47b0df77bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:37.610078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:37.762649 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1369/2779] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:38.568232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:38.569956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:38.594051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c8880-632e-4f11-9c4c-97301dcfb1ca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:38.616813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:38.618447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:38.620666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:38.621237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:38.634370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:38.680804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:38.683935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64e92-780a-4a1f-8f0e-c9fd17ddfee6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:38.748831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1411/2780] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:39.918473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:39.935465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eacc8b-8e44-47be-b6ae-922a778ef7e6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:39.944510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:39.945890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:39.946410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:39.946917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:39.950105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:39.974029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:39.975662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:39.990340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1370/2781] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:41.129884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:41.130339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:41.130459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:41.145885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:41.148203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:41.153059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:41.154279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:41.239405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b9e-0809-4cbe-b9dc-cbbca143f8ac service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:41.247936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1412/2782] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:41.251690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:41.254123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:41.267421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:41.268456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:41.269018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:41.269596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:41.275408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:41.292567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:41.294826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:41.307938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1371/2783] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:41.340999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b811549-fa56-4812-89d7-393bed0d7cd0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:41.347718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:41.348614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:41.349104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:41.349578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:41.366289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:41.369163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8498c6-9638-43eb-b276-d804ff006c3b service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:41.389731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1413/2784] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:43.328238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:43.356663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828947-74f1-4780-a91d-dba81a23204d service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:43.365489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:43.366571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:43.367149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:43.367646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:43.382854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:43.402418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:43.426180 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1372/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:44.363334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:44.363878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:44.364097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:44.389014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:44.395550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:44.404569 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1414/2786] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:44.421837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:44.436452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4f68-23bd-4d90-80b2-3faeed77198d service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:44.444827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:44.446239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:44.446993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:44.447431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:44.469084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:44.471192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:44.492243 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1373/2787] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:44.811082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:44.826403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1071bb-2d83-4e35-8167-9647d5b9b2ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:44.834460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:44.835517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:44.836026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:44.836702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:44.838920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:44.852762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:44.854667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4bbb5-bc6f-47a3-b324-78989e5f7119 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:44.870350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1415/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:44.932115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:44.949843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d1b6-88cf-4f72-a566-549f11840d04 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:44.954844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:44.955816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:44.956260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:44.957511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:44.981146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:44.984447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:44.995811 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1374/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:45.525580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:45.526103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:45.526188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:45.559837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:45.561461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:45.582493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1416/2790] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:45.596606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:45.618896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5c238-2f35-43f4-8b97-98b3990e76d8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:45.630351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:45.631363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:45.631867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:45.632335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:45.685253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:45.687890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd0285-333c-4f6a-87c2-0362f2b6715a service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:45.704989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1375/2791] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:45.879025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:45.880782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:45.920432 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:46.038266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac627d3f-0b4e-4421-96d6-1b9527dbd1a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:46.056886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:46.058052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:46.058400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:46.058683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] PATH_INFO: `/v3/users/5bfdfd44cd064a3f88e8a5c2a3b09307` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:46.059905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfdfd44cd064a3f88e8a5c2a3b09307)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:46.063691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:46.152117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfdfd44cd064a3f88e8a5c2a3b09307'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:46.167958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfdfd44cd064a3f88e8a5c2a3b09307'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:46.193634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfdfd44cd064a3f88e8a5c2a3b09307'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:46.194495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfdfd44cd064a3f88e8a5c2a3b09307'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:46.197911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfdfd44cd064a3f88e8a5c2a3b09307'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:46.228192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1417/2792] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:45 2022] DELETE /identity/v3/users/5bfdfd44cd064a3f88e8a5c2a3b09307 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:46.233064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:46.233329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:46.234455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:46.256513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:46.257986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:46.303753 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:46.391566 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1376/2793] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:46.404822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:46.410276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:46.525562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d95d-e72d-4bc2-8d33-73c9c904837d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:46.535146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:46.535821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:46.536105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:46.536555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:46.549546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:46.551307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d797-4744-4d4c-a970-12ad2ba17ea5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:46.565608 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1418/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:46.946900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:46.948860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:46.962028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81799398-97a7-44cf-b418-3085452cc9a1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:46.967138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:46.969171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:46.969806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:46.970235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] PATH_INFO: `/v3/projects/298a602ff055472e9ac0f14f846f8160` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:46.971621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] RBAC: Authorizing `identity:delete_project(project_id=298a602ff055472e9ac0f14f846f8160)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:46.973892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.074127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298a602ff055472e9ac0f14f846f8160', 'request_id': 'req-52ffeb46-e6a0-47f9-b88d-96f76efc157d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:47.083330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298a602ff055472e9ac0f14f846f8160', 'request_id': 'req-52ffeb46-e6a0-47f9-b88d-96f76efc157d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:47.091962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298a602ff055472e9ac0f14f846f8160', 'request_id': 'req-52ffeb46-e6a0-47f9-b88d-96f76efc157d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:47.109839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] The token cache is being invalidate because project 298a602ff055472e9ac0f14f846f8160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:47.110606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:47.111881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ffeb46-e6a0-47f9-b88d-96f76efc157d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:47.113927 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1377/2795] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:46 2022] DELETE /identity/v3/projects/298a602ff055472e9ac0f14f846f8160 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:47.119066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.119352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.119676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.162929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:47.167141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:47.216703 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:47.254242 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1419/2796] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:47.261723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.262016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.262297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.291634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:47.294642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:47.304798 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1378/2797] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:47.309223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.322269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548aa4-4018-4681-b8b2-4ac2b42f5dd8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.330487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.331116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.331394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.331660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.332348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:05:47.332647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.334287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.348717 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1420/2798] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:05:47.353516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.364713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4d041-688b-4413-a441-20dbd484caa8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.370794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.371734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.372177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.372966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.373933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.376850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.433458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1379/2799] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:47 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:47.437634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.449845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53582cc-7585-4391-9877-833cef84ad10 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.532292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.532292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.532292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.532292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.532828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.532828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.562174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1421/2800] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:47 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:47.566438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.582815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d55a5e-09ad-41fc-af73-e0ae941da4a2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.605556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.606208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.607853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.608130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.609188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.614772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.630967 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1380/2801] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:47.636261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.649493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01705-39aa-4ec4-8893-ec31abcc0b69 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.656036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.656903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.658742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.659194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.660095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.661804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef14a-a397-4446-ab6d-f312542884f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.677687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1422/2802] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:47.681734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:47.695947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468845-ab43-45b2-bf31-cceb269a7686 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:47.707386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:47.708447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.708839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.709242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] PATH_INFO: `/v3/projects/0981570728b14e0b9a283a8d4f6853f6/users/d7c3a9a3a75c44749ca907863f868cb0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.733616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0981570728b14e0b9a283a8d4f6853f6, user_id=d7c3a9a3a75c44749ca907863f868cb0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:47.736439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:47.756064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1381/2803] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:47 2022] PUT /identity/v3/projects/0981570728b14e0b9a283a8d4f6853f6/users/d7c3a9a3a75c44749ca907863f868cb0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:47.838898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:47.839410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:47.839863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:47.917656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] MFA Rules not processed for user `d7c3a9a3a75c44749ca907863f868cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:47.918932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:48.038357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1423/2804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:49.426204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:49.429593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:49.513025 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:49.558442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6bc8-3db9-4c61-8ecc-c97a03ef928a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:49.566356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:49.567155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:49.567550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:49.567888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:49.576560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:49.578999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcaa1e-9cfa-4d40-b17b-3a2e5048a963 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:49.605620 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1382/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:50.392027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:50.446138 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:50.476286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c42b6-9eca-4ce6-823d-4662532113af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:50.481200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:50.481875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:50.482200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:50.482422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] PATH_INFO: `/v3/users/d7c3a9a3a75c44749ca907863f868cb0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:50.484080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c3a9a3a75c44749ca907863f868cb0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:50.486095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:50.548878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c3a9a3a75c44749ca907863f868cb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:50.557684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c3a9a3a75c44749ca907863f868cb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:50.572559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c3a9a3a75c44749ca907863f868cb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:50.573302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c3a9a3a75c44749ca907863f868cb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:50.574025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c3a9a3a75c44749ca907863f868cb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:50.594333 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1424/2806] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:05:50 2022] DELETE /identity/v3/users/d7c3a9a3a75c44749ca907863f868cb0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:05:50.598935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:50.599517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:50.599517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:50.626386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:50.627812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:50.715331 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1383/2807] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:50.725377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:50.727030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:50.789205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428dc86-77a8-4b63-a55d-a6afbad38a45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:50.793177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:50.793815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:50.794094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:50.794363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:50.804282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:50.805815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4b09-5b6c-4bd7-b31f-692787c615ee service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:50.817443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1425/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:05:51.113567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.115664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:51.138500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a941999-d7fd-4266-8125-587acd7057fe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.147088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.147755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.148061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.148340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] PATH_INFO: `/v3/projects/0981570728b14e0b9a283a8d4f6853f6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.149771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0981570728b14e0b9a283a8d4f6853f6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.152469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.218824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0981570728b14e0b9a283a8d4f6853f6', 'request_id': 'req-cb099c3e-0d47-43a6-bd2a-0c08555c1340'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:51.227447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0981570728b14e0b9a283a8d4f6853f6', 'request_id': 'req-cb099c3e-0d47-43a6-bd2a-0c08555c1340'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:51.236433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0981570728b14e0b9a283a8d4f6853f6', 'request_id': 'req-cb099c3e-0d47-43a6-bd2a-0c08555c1340'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:51.254260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] The token cache is being invalidate because project 0981570728b14e0b9a283a8d4f6853f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:05:51.254814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:51.255637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb099c3e-0d47-43a6-bd2a-0c08555c1340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:05:51.263301 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1384/2809] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:51 2022] DELETE /identity/v3/projects/0981570728b14e0b9a283a8d4f6853f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:51.264926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.265299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.265723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.289241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:51.290579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:51.351125 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:51.370744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.371030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.371301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.373509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1426/2810] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:51.396039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:51.397312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:51.406812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1385/2811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:51.417108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.434910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341290e-acb4-4a8d-932c-c27396a5deed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.464789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.465478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.466920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.467208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.468722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:05:51.469174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.470827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.488848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1427/2812] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:05:51.490130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.500172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413da7-0e57-40b1-92fd-1bb7ded06f6b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.507045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.507749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.508064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.508331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.509369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.511420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.549466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1386/2813] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:51.551774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.564367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d54-e41f-4488-9988-af97aa249b10 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.668415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.669249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.669576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.670092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.670810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.673471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3a39-f641-41b2-9d05-5154a2b0ad0c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.716883 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1428/2814] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:05:51.721598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.734905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af46c2-25d7-4a76-a538-e035e44ebc6e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.742887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.744068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.744532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.745113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.746836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.748483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.765763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e20f2-f2a8-4772-9a9b-6d4dae5162ac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.766358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e20f2-f2a8-4772-9a9b-6d4dae5162ac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.766853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e20f2-f2a8-4772-9a9b-6d4dae5162ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.778689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1387/2815] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:51.779622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.791242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-730e20f2-f2a8-4772-9a9b-6d4dae5162ac None None] MFA Rules not processed for user `10739e6066e3468b98e14168ff2df181`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:51.792099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b29d-9450-4d66-93db-56d280ca6624 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.792586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-730e20f2-f2a8-4772-9a9b-6d4dae5162ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:51.800533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.801234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.801705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.802589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.803429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.808080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.849994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1388/2816] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:05:51.852176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:51.868954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe81e-7abf-44fa-9126-a88f1f7db5dc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:51.885718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:51.886746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.887030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.887376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] PATH_INFO: `/v3/projects/afce265709264879a2e1cafb56ea22f7/users/1f85ae026362410fb573c81bef57159e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:51.898983 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:51.955678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1429/2817] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:51.956223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afce265709264879a2e1cafb56ea22f7, user_id=1f85ae026362410fb573c81bef57159e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:51.959598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:51.988843 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1389/2818] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:05:51 2022] PUT /identity/v3/projects/afce265709264879a2e1cafb56ea22f7/users/1f85ae026362410fb573c81bef57159e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:05:51.990316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c89b0-2b27-41ee-b5e5-5bee57a7fcf1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:51.990606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c89b0-2b27-41ee-b5e5-5bee57a7fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:51.990881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c89b0-2b27-41ee-b5e5-5bee57a7fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:52.023070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9a1c89b0-2b27-41ee-b5e5-5bee57a7fcf1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:52.024337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a1c89b0-2b27-41ee-b5e5-5bee57a7fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:52.113613 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1430/2819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:05:52.126809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:52.128650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:52.195757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb7ca-99d5-48b9-9062-603fb2455532 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:52.199443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:52.200250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:52.200421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:52.200623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:52.211887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:52.213394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:52.224930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1390/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:05:52.746047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:52.747087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:52.747557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:52.785316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] MFA Rules not processed for user `687667b3aadf4dd591e1335678be938d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:05:52.788865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:52.815886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:05:52.818766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:52.847223 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:52.956922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1431/2821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:05:53.025585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6b06-d990-4588-a861-736ddfc4ecaa service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:05:53.039252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:05:53.039892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:05:53.040178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:05:53.040508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:05:53.042919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:05:53.063792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:05:53.066673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b06afc-20d5-4a6f-8e71-194fdf3ab7d2 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:05:53.100105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1391/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:00.809728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:00.812420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:00.833516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367c8e-972c-40e0-970f-c07c97dad1ed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:00.847449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:00.848207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:00.848493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:00.848763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:00.850600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:00.880836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:00.884940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:00.920303 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1432/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:01.044822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc705-11ea-4252-bf34-8b6c9e8fb97e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:01.045395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc705-11ea-4252-bf34-8b6c9e8fb97e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:01.045395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc705-11ea-4252-bf34-8b6c9e8fb97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:01.099756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7d3dc705-11ea-4252-bf34-8b6c9e8fb97e None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:01.101033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7d3dc705-11ea-4252-bf34-8b6c9e8fb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:01.250428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1392/2824] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:01.287078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:01.288436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:01.466230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508725-9508-4087-ab24-96dcf065aca3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:01.483593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:01.484240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:01.484521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:01.484795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:01.502074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:01.503894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:01.531287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1433/2825] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:06:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:03.145147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f233-f3c1-4fc9-86da-b1a550a9b422 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:03.145984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f233-f3c1-4fc9-86da-b1a550a9b422 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:03.146542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7f233-f3c1-4fc9-86da-b1a550a9b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:03.245137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-94f7f233-f3c1-4fc9-86da-b1a550a9b422 None None] MFA Rules not processed for user `1f85ae026362410fb573c81bef57159e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:03.250376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-94f7f233-f3c1-4fc9-86da-b1a550a9b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:03.276378 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:03.553979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1393/2826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:03.584744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:03.601830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e8a1e-68c0-4a43-9ce0-c0a62a096995 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:03.630431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:03.633041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:03.636362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:03.636946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:03.669845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:03.674085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:03.702087 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1434/2827] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:06.783748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:06.784325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:06.784325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:06.809201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] MFA Rules not processed for user `1f85ae026362410fb573c81bef57159e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:06.812696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:06.846316 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1394/2828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:13.690295 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=60 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:15.397455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:15.401498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:15.466544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffacbc7-4751-4ee5-9251-35374e3ddabf service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:15.482663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:15.482663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:15.482663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:15.482663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] PATH_INFO: `/v3/users/f07489ff6ce74b7cab3b78a9654e4192` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:15.483438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07489ff6ce74b7cab3b78a9654e4192)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:15.486940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:15.698876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07489ff6ce74b7cab3b78a9654e4192'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:15.726203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07489ff6ce74b7cab3b78a9654e4192'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:15.746663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07489ff6ce74b7cab3b78a9654e4192'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:15.747587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07489ff6ce74b7cab3b78a9654e4192'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:15.749637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-54971af7-4bac-431f-9870-c6a79fe07232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07489ff6ce74b7cab3b78a9654e4192'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:15.772186 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1435/2829] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:15 2022] DELETE /identity/v3/users/f07489ff6ce74b7cab3b78a9654e4192 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:16.081776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:16.110638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6abbed-9a8b-49ab-9a38-8a82d73207da None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:16.240977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:16.242326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.242973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.243743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] PATH_INFO: `/v3/projects/d22d569cfdfb47619e63f469ad2d00bd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.246394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22d569cfdfb47619e63f469ad2d00bd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:16.252200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:16.344469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22d569cfdfb47619e63f469ad2d00bd', 'request_id': 'req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:16.354390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22d569cfdfb47619e63f469ad2d00bd', 'request_id': 'req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:16.367049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22d569cfdfb47619e63f469ad2d00bd', 'request_id': 'req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:16.394986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] The token cache is being invalidate because project d22d569cfdfb47619e63f469ad2d00bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:16.395891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:16.397052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e48add-b7b2-41ab-b83e-fd1c44d056ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:16.410151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.411810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.412383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.416269 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1395/2830] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:16 2022] DELETE /identity/v3/projects/d22d569cfdfb47619e63f469ad2d00bd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:16.448489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:16.451025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:16.605474 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1436/2831] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:16.615925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.616202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.617693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.651850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:16.653175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:16.678971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1396/2832] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:16.683945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:16.705077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743785-ac10-4025-a5a5-c1b09cb8aa68 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:16.718806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:16.718806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.718806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.718806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.719537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:16.719921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:16.721660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:16.745981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:16.746386 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1437/2833] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:16.757869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4762-0a6c-4cf9-a270-f9dbaa32e4cb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:16.772621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:16.773243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.773608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.773884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.774537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:16.776565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:16.809737 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:16.828214 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1397/2834] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:16 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:16.833139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:16.846871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9777344-8cbc-4947-a327-37f3b2aa608f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:16.984637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:16.985275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:16.985607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:16.985887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:16.986538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:16.988602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:17.016324 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:17.058202 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1438/2835] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:16 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:17.058995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:17.074029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22643144-4e5b-45d6-9cc0-ead1d2785784 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:17.088748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:17.090447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.090963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.091781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.093469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:17.095399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:17.111452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1398/2836] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:17.115186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:17.136126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a8da-4e8f-44cb-b940-f2732df5c25f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:17.175375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:17.176009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.176294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.176572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.177230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:17.178896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5e51a-fe21-4c13-9f88-7100ae5d4a48 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:17.229677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:17.232269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1439/2837] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:17.244300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70744-98c5-4d16-8e7e-c23261e57d3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:17.259261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:17.262041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.262666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.263893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] PATH_INFO: `/v3/projects/4ea4f73d0bc34551b05b440442cc90fc/users/cb3218babac5488185fc2f8597cc827f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.313872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea4f73d0bc34551b05b440442cc90fc, user_id=cb3218babac5488185fc2f8597cc827f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:17.316812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:17.354881 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1399/2838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:17 2022] PUT /identity/v3/projects/4ea4f73d0bc34551b05b440442cc90fc/users/cb3218babac5488185fc2f8597cc827f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:17.369555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33075-417c-4512-b0d2-044fe9033bfd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.369984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33075-417c-4512-b0d2-044fe9033bfd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.370369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33075-417c-4512-b0d2-044fe9033bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.449287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1da33075-417c-4512-b0d2-044fe9033bfd None None] MFA Rules not processed for user `cb3218babac5488185fc2f8597cc827f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:17.452028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1da33075-417c-4512-b0d2-044fe9033bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:17.572191 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1440/2839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:17.583737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:17.585520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:17.708028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0abcbf-52ff-409a-9dae-699eb4247278 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:17.713234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:17.714253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.714716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.715154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.730103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:17.732067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:17.742773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1400/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:17.923716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:17.924395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:17.924890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:17.956946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:17.959267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:18.069831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1441/2841] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:18.085960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:18.087570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:18.204000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd03947-dc5c-4eb8-9ee6-a1d41917a974 service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:18.213169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:18.214100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:18.214935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:18.215668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:18.233615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:18.255217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:18.279895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1401/2842] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:06:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:21.364421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:21.366741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:21.497866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d302ae7-146d-4820-afa5-01f81066872f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:21.528057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:21.530244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:21.530755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:21.546157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:21.551026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:21.589775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:21.595184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d8e6-1e61-4213-87a3-b80eb0fba59c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:21.611087 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:21.628475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1442/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:22.277217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:22.278008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:22.404462 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:22.423682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bac0-5369-4aab-8571-bb0426436a11 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:22.429127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:22.429807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:22.430232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:22.430508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] PATH_INFO: `/v3/users/10739e6066e3468b98e14168ff2df181` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:22.431955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10739e6066e3468b98e14168ff2df181)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:22.433996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:22.502622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10739e6066e3468b98e14168ff2df181'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:22.514431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10739e6066e3468b98e14168ff2df181'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:22.523977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10739e6066e3468b98e14168ff2df181'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:22.549728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10739e6066e3468b98e14168ff2df181'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:22.550626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10739e6066e3468b98e14168ff2df181'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:22.574675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1402/2844] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:22 2022] DELETE /identity/v3/users/10739e6066e3468b98e14168ff2df181 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:22.577130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:22.578222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:22.578598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:22.608980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:22.610570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:22.716236 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1443/2845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:22.729241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:22.731278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:22.824445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1debf9-1c8f-456a-bbee-de1bec58bbb6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:22.842897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:22.842897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:22.842897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:22.842897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:22.854799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:22.856373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:22.872702 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1403/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:23.395244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:23.397758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:23.426327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34369d-f928-430e-ba9a-6e93919afd16 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:23.431789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:23.432699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:23.444463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:23.445148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] PATH_INFO: `/v3/projects/829ed353f9104a14b276d36b480b850f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:23.447939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ed353f9104a14b276d36b480b850f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:23.451858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:23.550290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ed353f9104a14b276d36b480b850f', 'request_id': 'req-095ec856-1fdf-4eab-975d-b3795d110f6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.568568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ed353f9104a14b276d36b480b850f', 'request_id': 'req-095ec856-1fdf-4eab-975d-b3795d110f6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.576615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ed353f9104a14b276d36b480b850f', 'request_id': 'req-095ec856-1fdf-4eab-975d-b3795d110f6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.599712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] The token cache is being invalidate because project 829ed353f9104a14b276d36b480b850f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:23.601888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.602608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.605523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1444/2847] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:23 2022] DELETE /identity/v3/projects/829ed353f9104a14b276d36b480b850f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:23.609978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:23.622345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf446-c390-4de0-8f31-f474e32e403c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:23.704682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:23.705515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:23.705896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:23.707418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] PATH_INFO: `/v3/users/cb5ef9508e0049ca8832d65634a7aaeb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:23.712740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5ef9508e0049ca8832d65634a7aaeb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:23.714887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:23.746130 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:23.802639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5ef9508e0049ca8832d65634a7aaeb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.804205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5ef9508e0049ca8832d65634a7aaeb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.819200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5ef9508e0049ca8832d65634a7aaeb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.841536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5ef9508e0049ca8832d65634a7aaeb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.843652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-198fc05c-5f69-4103-b0f9-a27aedb89dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5ef9508e0049ca8832d65634a7aaeb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:23.867714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1404/2848] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:23 2022] DELETE /identity/v3/users/cb5ef9508e0049ca8832d65634a7aaeb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:24.696958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:24.698589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:24.713930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ec856-1fdf-4eab-975d-b3795d110f6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:24.864088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:24.864897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:24.865285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:24.865684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] PATH_INFO: `/v3/projects/5672ac1a88784c1daa7592719d1d4653` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:24.867180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5672ac1a88784c1daa7592719d1d4653)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:24.872038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:24.908761 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:24.941498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5672ac1a88784c1daa7592719d1d4653', 'request_id': 'req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:24.949882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5672ac1a88784c1daa7592719d1d4653', 'request_id': 'req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:24.959358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5672ac1a88784c1daa7592719d1d4653', 'request_id': 'req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:24.978758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] The token cache is being invalidate because project 5672ac1a88784c1daa7592719d1d4653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:24.979194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:24.979782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b836e9ae-29f4-4950-a30d-fb6cc79cbe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:24.993927 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1445/2849] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:24 2022] DELETE /identity/v3/projects/5672ac1a88784c1daa7592719d1d4653 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:24.996499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:24.996985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:24.997576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.021988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:25.023827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:25.111874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1405/2850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:25.120770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.121548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.121900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.162534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:25.163967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:25.181216 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1446/2851] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:25.186225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.219047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72c21-61f7-4120-8f88-c4b756279c3a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.226676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.227408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.227703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.227975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.228906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:25.233949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.236147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.254319 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1406/2852] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:25.259043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.270473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ffb07-50c1-4ad3-8ed3-983f0e466154 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.276906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.277656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.278306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.279447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.280499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.282931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.339457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1447/2853] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:25.344976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.367052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0a32-d368-4c8e-badd-3954f67ac824 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.464651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.464942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.465088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.465364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.466337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.468835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.494697 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1407/2854] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:25.499625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.522211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e710-9f31-4ce7-b11a-aa3bb89005ac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.531334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.532401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.532884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.533664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.534894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.538158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.559461 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1448/2855] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:25.565848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.592677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cdb7-1136-4c26-b181-f5a84baf0ddf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.592677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.592677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.592677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.593530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.593530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.593530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225883-28e3-401f-9601-5d099cd380f3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.600713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1408/2856] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:25.613361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.627617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4387-a76d-4a6d-8287-6882b40320eb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:25.635100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:25.636058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.636514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.636968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] PATH_INFO: `/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90/users/91405291b5ea46e59a1070e288702c23/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.670542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bc6fcd41a641daa357f3a25ea6ec90, user_id=91405291b5ea46e59a1070e288702c23, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:25.674349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff51a-f734-49f8-b0fc-e18f78a1e19c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:25.699842 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1449/2857] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:25 2022] PUT /identity/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90/users/91405291b5ea46e59a1070e288702c23/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:25.725756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.726549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.727047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.740979 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:25.771284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] MFA Rules not processed for user `91405291b5ea46e59a1070e288702c23`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:25.772524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:25.861170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:25.861508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:25.861982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:25.878412 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1409/2858] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:25.883118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:25.895959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:25.897861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:26.005890 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1450/2859] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:26.006736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d6c9e-7951-4c0b-8fad-6ca1a430e053 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.020519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.022558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.023305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.023663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.024168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:26.024315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.025387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.027684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.078135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1410/2860] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:26.082425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.179334 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:26.191902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2743f-1a9b-4dc5-9358-5706d4720e23 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.197348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.198198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.198490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.198769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.199420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.202043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.228196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780db5a-6bea-42f1-adfe-a13d6ccc381b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.230965 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1411/2861] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:26 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:26.235812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.255776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677bdd6-9356-4988-a04a-4a54a15ec3ea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.268542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.269449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.269836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.270219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.271520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.276489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.285221 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:26.305823 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1412/2862] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:26.311035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.319501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.320550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.321011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.321589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.327746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d390-e63c-4bf7-b2ca-aa471c749279 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.333555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.334356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.335039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.335428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] PATH_INFO: `/v3/projects/3366fed4d7f245cda5fafd4091b55a8e/users/8b310555a3b54e7fbdd8c0a3780ece4c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.356587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3366fed4d7f245cda5fafd4091b55a8e, user_id=8b310555a3b54e7fbdd8c0a3780ece4c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.363748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.388397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1413/2863] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:26 2022] PUT /identity/v3/projects/3366fed4d7f245cda5fafd4091b55a8e/users/8b310555a3b54e7fbdd8c0a3780ece4c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:26.392023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.442285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.444145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.458763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1451/2864] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:26.537451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d2c7-6b15-4c50-9b22-4c82d2a62705 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.542723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.543895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.544046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.544404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.546424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.548041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d7815-cbd6-4dc2-8f32-d0804b58434a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.566089 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1414/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:26.567124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:26.584980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b883f2-a937-4c26-b36f-c141e6d1a8fe service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:26.592227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:26.595776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.596117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.596404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] PATH_INFO: `/v3/projects/3366fed4d7f245cda5fafd4091b55a8e/users/8b310555a3b54e7fbdd8c0a3780ece4c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.599289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3366fed4d7f245cda5fafd4091b55a8e, user_id=8b310555a3b54e7fbdd8c0a3780ece4c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:26.602401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:26.626124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1452/2866] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:26 2022] PUT /identity/v3/projects/3366fed4d7f245cda5fafd4091b55a8e/users/8b310555a3b54e7fbdd8c0a3780ece4c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:26.638410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ea31-303c-4486-9d58-fe907bc050c3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:26.639224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ea31-303c-4486-9d58-fe907bc050c3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:26.639759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ea31-303c-4486-9d58-fe907bc050c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:26.693809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9271ea31-303c-4486-9d58-fe907bc050c3 None None] MFA Rules not processed for user `8b310555a3b54e7fbdd8c0a3780ece4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:26.695916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9271ea31-303c-4486-9d58-fe907bc050c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:26.847959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1415/2867] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:27.342888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:27.344665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:27.460913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f52860-d92f-46ef-9f33-688ae01cdebb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:27.466357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:27.467701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.467979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.468236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.477348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:27.478998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:27.489178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1453/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:27.659621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978fa4-dacf-438a-8ba1-4e7f66b10d0e None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.660180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978fa4-dacf-438a-8ba1-4e7f66b10d0e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.660180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978fa4-dacf-438a-8ba1-4e7f66b10d0e None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.661569 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1416/2869] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:06:27.666894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:06:27.681808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:27.683910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.684208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.684482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.692362 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:27.698490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161198ce-4f9d-496f-af25-071b82438a90 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:27.707314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b310555a3b54e7fbdd8c0a3780ece4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3366fed4d7f245cda5fafd4091b55a8e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:27.707634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:27.708219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.709330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:27.709503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.709503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] PATH_INFO: `/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.710296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9bc6fcd41a641daa357f3a25ea6ec90)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:27.712473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:27.715320 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1454/2870] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:06:27 2022] GET /identity/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90 => generated 379 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:27.768753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:27.768753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:27.776635 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:27.784141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eccd80-3197-47da-8006-bc0192086764 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:27.786955 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1417/2871] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:27.793645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:27.794378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.795070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.795070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.808618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:27.889453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79764a-816f-43d7-be81-daad5f236aa4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:27.896110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:27.896871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:27.897245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:27.898214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:27.907707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:27.908414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:27.910394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0dd1-bb65-45a0-aae3-824e3a60a5d7 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:27.912173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:27.930109 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1418/2872] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:06:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:27.940007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1455/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:28.080559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:28.081226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:28.081576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:28.082963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1419/2874] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:06:28.088997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:06:28.110813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:28.124190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b253-d74d-4e95-8fb4-36d550aae157 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:28.128001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:28.129844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:28.133592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b310555a3b54e7fbdd8c0a3780ece4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3366fed4d7f245cda5fafd4091b55a8e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:28.134769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:28.135157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:28.135533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] PATH_INFO: `/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:28.142638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9bc6fcd41a641daa357f3a25ea6ec90)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:28.145742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580ff27-c8cc-4b0b-9d5b-afe571e0267e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:28.147528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1456/2875] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:06:28 2022] GET /identity/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90 => generated 379 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:28.263846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760eeb-3c03-4d9f-a087-b87e8a00eb26 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:28.287931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:28.288816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:28.289245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:28.289644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] PATH_INFO: `/v3/users/cb3218babac5488185fc2f8597cc827f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:28.291142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3218babac5488185fc2f8597cc827f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:28.293380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:28.385952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3218babac5488185fc2f8597cc827f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:28.386897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3218babac5488185fc2f8597cc827f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:28.398735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3218babac5488185fc2f8597cc827f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:28.423760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3218babac5488185fc2f8597cc827f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:28.424982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3218babac5488185fc2f8597cc827f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:28.442894 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1420/2876] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:28 2022] DELETE /identity/v3/users/cb3218babac5488185fc2f8597cc827f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:28.447468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:28.448013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:28.448299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:28.471494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:28.473166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:28.546881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1457/2877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:28.561754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:28.563234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:28.580717 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:28.671543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c003c1-7ecd-4764-94e1-0c794c0b47fe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:28.674104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:28.674720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:28.675003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:28.675274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:28.688000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:28.690168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbad78-7274-4100-9a98-15b5d3188085 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:28.703166 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1421/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:29.010831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.012328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.027170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e7fde-fe89-42e3-a73f-4648e22226bc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.034613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.035826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.036062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.036451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] PATH_INFO: `/v3/users/91405291b5ea46e59a1070e288702c23` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.038324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91405291b5ea46e59a1070e288702c23)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.041761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:29.116297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91405291b5ea46e59a1070e288702c23'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.126266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91405291b5ea46e59a1070e288702c23'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.146378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91405291b5ea46e59a1070e288702c23'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.147705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91405291b5ea46e59a1070e288702c23'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.148423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91405291b5ea46e59a1070e288702c23'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.170315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1458/2879] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:29 2022] DELETE /identity/v3/users/91405291b5ea46e59a1070e288702c23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:29.174768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.175144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.175498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.198850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:29.200403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.296163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1422/2880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:29.304810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.306818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.325691 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:29.332922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.336444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.336858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ea77d-ada6-4386-9ba7-0ad8060ff2d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.348297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.349118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.349629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.350282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] PATH_INFO: `/v3/projects/4ea4f73d0bc34551b05b440442cc90fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.353251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea4f73d0bc34551b05b440442cc90fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.355933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:29.467772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea4f73d0bc34551b05b440442cc90fc', 'request_id': 'req-b91f27e8-0037-4c05-854a-52c26f5dc6fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.476578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea4f73d0bc34551b05b440442cc90fc', 'request_id': 'req-b91f27e8-0037-4c05-854a-52c26f5dc6fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.488798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea4f73d0bc34551b05b440442cc90fc', 'request_id': 'req-b91f27e8-0037-4c05-854a-52c26f5dc6fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.505369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02573a69-9ce0-4e72-a03e-237470855f3e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.507261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] The token cache is being invalidate because project 4ea4f73d0bc34551b05b440442cc90fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:29.507805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.508950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b91f27e8-0037-4c05-854a-52c26f5dc6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:29.515557 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1459/2881] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:29 2022] DELETE /identity/v3/projects/4ea4f73d0bc34551b05b440442cc90fc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:29.524263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375952c-d56f-4894-90e6-e12d709cde87 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.524819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375952c-d56f-4894-90e6-e12d709cde87 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.525209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375952c-d56f-4894-90e6-e12d709cde87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.560187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e375952c-d56f-4894-90e6-e12d709cde87 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:29.561638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e375952c-d56f-4894-90e6-e12d709cde87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.605830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.608739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.611633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.612022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.615531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.647396 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:29.658267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1460/2882] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:29.669168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.670645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.671089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.694226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:29.695905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:29.705634 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1461/2883] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:29.710942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.713299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.715157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:29.722515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcb7b9-6334-49e6-a674-7477911240a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.728658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.729383 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1423/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:29.729550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.729810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.730110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.730772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:29.731071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.733337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:29.749006 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1462/2885] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:06:29.754950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.767738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beaa33-b86b-456b-9cf8-27355980f8ad service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.775842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.776467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.776741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.777009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.777676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.780487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:29.819098 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1424/2886] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:29 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:29.820695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:29.837748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdfc-61e5-496e-924e-f2a004653616 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:29.967698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:29.970518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:29.970518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:29.970518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:29.985184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:29.987533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.042710 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:30.071102 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1463/2887] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:29 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:30.075113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.093135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096cb16-5ef4-4376-8e15-ebbdcde5e7f9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.121438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:30.123794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.124083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.124358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.125029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:30.131799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.173106 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1425/2888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:30.174042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.190934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa151a-7563-44c4-ae4a-590c0e849451 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.204873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.207125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:30.207337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:30.207988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.208281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.208555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.209220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:30.211042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.253616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31694-9ca7-48ec-8cd6-f9b0a58475de admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.267066 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1464/2889] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:30.269335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:30.270630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.271119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.271617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] PATH_INFO: `/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.274212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.281363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bc6fcd41a641daa357f3a25ea6ec90)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:30.291108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.291852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5075f-9c47-4ecd-9e87-6e876d810364 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.307614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:30.308440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.308823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.309235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] PATH_INFO: `/v3/projects/791f71e8d1144395986420de72c44d49/users/adf5758833764eb38eeed12ded9dff6e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.350213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] RBAC: Authorizing `identity:create_grant(project_id=791f71e8d1144395986420de72c44d49, user_id=adf5758833764eb38eeed12ded9dff6e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:30.353668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41de49-bae5-401e-aa7f-f4dcb1e8152e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.387253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1465/2890] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:30 2022] PUT /identity/v3/projects/791f71e8d1144395986420de72c44d49/users/adf5758833764eb38eeed12ded9dff6e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:30.401006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.401522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.401813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.444409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bc6fcd41a641daa357f3a25ea6ec90', 'request_id': 'req-8df77890-1484-4847-9b20-cd2dd0e5fc51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.455444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] MFA Rules not processed for user `adf5758833764eb38eeed12ded9dff6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:30.457118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bc6fcd41a641daa357f3a25ea6ec90', 'request_id': 'req-8df77890-1484-4847-9b20-cd2dd0e5fc51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.458709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:30.475973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bc6fcd41a641daa357f3a25ea6ec90', 'request_id': 'req-8df77890-1484-4847-9b20-cd2dd0e5fc51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.494720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] The token cache is being invalidate because project f9bc6fcd41a641daa357f3a25ea6ec90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:30.495129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.499443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.501912 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1426/2891] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:30 2022] DELETE /identity/v3/projects/f9bc6fcd41a641daa357f3a25ea6ec90 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:30.510116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.518682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:30.648337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77890-1484-4847-9b20-cd2dd0e5fc51 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.655527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1466/2892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:30.660850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:30.661743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:30.662196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:30.662541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] PATH_INFO: `/v3/users/8b310555a3b54e7fbdd8c0a3780ece4c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:30.663937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b310555a3b54e7fbdd8c0a3780ece4c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:30.666172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:30.667759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:30.670170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:30.689328 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:30.787765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b310555a3b54e7fbdd8c0a3780ece4c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.813688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b310555a3b54e7fbdd8c0a3780ece4c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.824353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b310555a3b54e7fbdd8c0a3780ece4c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.868270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b310555a3b54e7fbdd8c0a3780ece4c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.869335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b310555a3b54e7fbdd8c0a3780ece4c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:30.905302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c543-fd9e-4065-bc79-ea66db031341 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:30.908428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1427/2893] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:30 2022] DELETE /identity/v3/users/8b310555a3b54e7fbdd8c0a3780ece4c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:30.996967 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:31.036614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.037686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.037969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.038312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.041556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.159537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.161731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee108-f49c-4dfc-8758-3ac91c633ae5 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:31.175237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1467/2894] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:31.233473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:31.234952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.323267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542f1-ee0c-40d8-9b6a-f2faebd5b2be admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:31.328287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.329048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.329395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.329763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] PATH_INFO: `/v3/users/adf5758833764eb38eeed12ded9dff6e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.331019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf5758833764eb38eeed12ded9dff6e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.333034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:31.400391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf5758833764eb38eeed12ded9dff6e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.402051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf5758833764eb38eeed12ded9dff6e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.423077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf5758833764eb38eeed12ded9dff6e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.441556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf5758833764eb38eeed12ded9dff6e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.442852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf5758833764eb38eeed12ded9dff6e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.461460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1428/2895] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:31 2022] DELETE /identity/v3/users/adf5758833764eb38eeed12ded9dff6e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:31.464617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.464890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.465280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.488155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:31.489393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.583820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1468/2896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:31.588581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:31.590237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.596195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:31.599246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.612523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290d11-3f75-4be2-88bb-459419986cba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:31.624077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.624735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.625013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.625287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] PATH_INFO: `/v3/projects/3366fed4d7f245cda5fafd4091b55a8e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.628485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3366fed4d7f245cda5fafd4091b55a8e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.630607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:31.640549 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:31.708704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3366fed4d7f245cda5fafd4091b55a8e', 'request_id': 'req-45da6839-8504-4895-92ea-acf1801c5cdf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.717984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3366fed4d7f245cda5fafd4091b55a8e', 'request_id': 'req-45da6839-8504-4895-92ea-acf1801c5cdf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.726207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3366fed4d7f245cda5fafd4091b55a8e', 'request_id': 'req-45da6839-8504-4895-92ea-acf1801c5cdf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.728826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbe40e-87ff-4dde-b955-811c42ed2223 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:31.744185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] The token cache is being invalidate because project 3366fed4d7f245cda5fafd4091b55a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:31.744961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.745840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45da6839-8504-4895-92ea-acf1801c5cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:31.748865 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1429/2897] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:31 2022] DELETE /identity/v3/projects/3366fed4d7f245cda5fafd4091b55a8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:31.757000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e4c77-fa85-4afe-b458-4a4039980860 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.757344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e4c77-fa85-4afe-b458-4a4039980860 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.758968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e4c77-fa85-4afe-b458-4a4039980860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.781653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-911e4c77-fa85-4afe-b458-4a4039980860 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:31.782880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-911e4c77-fa85-4afe-b458-4a4039980860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.789790 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:31.801667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.802273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.802569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.802843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.804956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.853654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1430/2898] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:31.862682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.862975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.863249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.886527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:31.887109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.887966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:31.888620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:31.898404 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1431/2899] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:31.900989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1469/2900] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:31.903232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:31.914898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35bda-1dbd-4e42-84ab-6ea86a066c9a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:31.921674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.922295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.922588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.922841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.923663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:31.923961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.925732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:31.941202 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1432/2901] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:06:31.947056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:31.968001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd72f5-139d-4725-9e5f-d55c5cea993d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:31.977971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:31.979100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:31.979589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:31.980087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:31.981261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:31.986175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.028827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1470/2902] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:31 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:32.038028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.055414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f979-d385-40cc-9cea-674dbd901982 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.161996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.163201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.163713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.164213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.166176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.168487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.189666 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:32.202682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1433/2903] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:32.205797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.220923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036a4a-edb7-4086-b7a4-9fa6c1df1c93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.227357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.228300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.228581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.228859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.229774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.231846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.250078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1471/2904] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:32.252326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.275171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857672ac-d8ca-4a30-8041-f394e9338f1a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.284869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.286351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.286914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.287495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.288825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.292308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.318016 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1434/2905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:32.318128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.321109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.322841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:32.344320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fa2a-8e8d-4717-bb59-6fc19d2e9a24 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.349192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d220-4baa-4587-8b63-8de70bdd5a8a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.351785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.353632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.354009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.354283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] PATH_INFO: `/v3/projects/cbaf140c2ac84caabc94ffebda620de0/users/fb4642deaa2d4931b1fa4a43fe7dc66c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.355581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.356376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.356930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.357331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] PATH_INFO: `/v3/projects/791f71e8d1144395986420de72c44d49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.359071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791f71e8d1144395986420de72c44d49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.361724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.391998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbaf140c2ac84caabc94ffebda620de0, user_id=fb4642deaa2d4931b1fa4a43fe7dc66c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.397890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a91c1-c68b-47a5-b957-575fd7ef8e28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.428075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1435/2906] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:32 2022] PUT /identity/v3/projects/cbaf140c2ac84caabc94ffebda620de0/users/fb4642deaa2d4931b1fa4a43fe7dc66c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:32.431361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791f71e8d1144395986420de72c44d49', 'request_id': 'req-24ae0952-cd64-455b-a171-fa43c913ba18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:32.441691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.441918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791f71e8d1144395986420de72c44d49', 'request_id': 'req-24ae0952-cd64-455b-a171-fa43c913ba18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:32.442044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.442249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.450698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791f71e8d1144395986420de72c44d49', 'request_id': 'req-24ae0952-cd64-455b-a171-fa43c913ba18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:32.469821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] The token cache is being invalidate because project 791f71e8d1144395986420de72c44d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:32.470186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:32.470961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24ae0952-cd64-455b-a171-fa43c913ba18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:32.473291 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1472/2907] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:32 2022] DELETE /identity/v3/projects/791f71e8d1144395986420de72c44d49 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:32.477787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] MFA Rules not processed for user `fb4642deaa2d4931b1fa4a43fe7dc66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:32.478518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd280f-caff-4510-b402-d3112ca67c08 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.478884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd280f-caff-4510-b402-d3112ca67c08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.479211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:32.479364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd280f-caff-4510-b402-d3112ca67c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.504795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-12cd280f-caff-4510-b402-d3112ca67c08 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:32.507137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-12cd280f-caff-4510-b402-d3112ca67c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:32.560836 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:32.572763 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1436/2908] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:32.577940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.579823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:32.595349 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1473/2909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:32.603230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.603520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.603797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.652855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:32.654870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:32.664310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1474/2910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:32.668326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.679831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977d28-d48d-4ba8-9554-b3a72f249bea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.682402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f788d1-4803-4fd9-a4df-2cfeb0244db9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.685677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.687296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.687296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.687296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.687905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:32.688210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.689714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.689851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.690571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.690917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.691256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.691960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.694128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.709615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1475/2911] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:32.711691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.728080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108b69-1a03-4d36-becc-c37889e84a67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.733521 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1437/2912] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:06:32.734200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.734970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.735257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.735527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.736242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.736448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.744634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.789988 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1476/2913] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/projects => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:32.791233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.804904 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:32.844961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c3265-1e78-4a94-bc66-61236919648f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.890142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71734c1-825a-48c6-8b01-1235b46935ea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.910161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.911637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.911929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.912208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.912886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.914924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.927513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.928068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.928346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.928618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.929262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.931198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.938890 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1477/2914] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/users => generated 280 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:32.942938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.954649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e892c82-4cd5-4149-b90f-e84daabf8df0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.956458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1438/2915] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:32 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:32.959791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.960401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.960538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.960683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.960957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.961714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.963245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.970902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e629d-5b5f-47ad-a217-d77dbb0ad6df admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.973779 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1478/2916] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:32.977728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:32.978992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.979598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.979882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.980237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.980879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.982585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.988354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d8f5-5e89-4181-bfd0-9b627f744d8d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:32.993181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:32.994007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:32.994135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1439/2917] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:32.994235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:32.994356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:32.995021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:32.996619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:32.998602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.008506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf925-a568-4bb5-b898-e13dd5053de0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.009473 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1479/2918] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:33.013472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.017128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.017817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.018103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.018379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] PATH_INFO: `/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe/users/8ddbf361caea468196e225f12ee3f52b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.027646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baaf2b-c682-400a-9a0a-3f11784d112f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.032410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.033065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.033348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.033648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] PATH_INFO: `/v3/projects/39a7c55bf3894d5ab6de6bc3b0e4f497/users/e5ef41649b6149a29dc6a7e73a79b87c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.038996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a5d2b5c2c47c683d95d3ba0b1fabe, user_id=8ddbf361caea468196e225f12ee3f52b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.041768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.049159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a7c55bf3894d5ab6de6bc3b0e4f497, user_id=e5ef41649b6149a29dc6a7e73a79b87c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.052716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4cb9-a22a-423a-9a89-62a12c03eb1c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.056080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1440/2919] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:32 2022] PUT /identity/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe/users/8ddbf361caea468196e225f12ee3f52b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:33.059801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.067190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1480/2920] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:33 2022] PUT /identity/v3/projects/39a7c55bf3894d5ab6de6bc3b0e4f497/users/e5ef41649b6149a29dc6a7e73a79b87c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:33.077912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.078196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.078476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.107885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] MFA Rules not processed for user `e5ef41649b6149a29dc6a7e73a79b87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:33.109464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.129142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549676-132f-4cb6-976c-db2a3860e802 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.147139 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:33.176617 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:33.183512 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1481/2921] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:33.193976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.194593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.194902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.195150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.195150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.195770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.196242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.197441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.213037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1441/2922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:33.214153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.224089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952aea-efa1-492a-b5f0-42dc5ab1b397 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.229251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.229560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.229869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.230144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] PATH_INFO: `/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe/users/8ddbf361caea468196e225f12ee3f52b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.232651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a5d2b5c2c47c683d95d3ba0b1fabe, user_id=8ddbf361caea468196e225f12ee3f52b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.235364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec8b87-6b08-4493-9551-cfcbed9753f5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.246171 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1442/2923] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:33 2022] PUT /identity/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe/users/8ddbf361caea468196e225f12ee3f52b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:33.258345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.258636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.259229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.278802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee2ab0-9660-4a9f-b601-c81ea5ccc9b7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.290837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] MFA Rules not processed for user `8ddbf361caea468196e225f12ee3f52b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:33.292386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.348756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.349582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.349999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.350327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.369525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1443/2924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:33.382807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.384540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.401386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2c6b-9013-47d2-aa67-22afb451ae3c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.407148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.407763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.408045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.408319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.415125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.416725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.416840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.418466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.426951 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1482/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:33.429351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1444/2926] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:33.471754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.479346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.483391 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:33.491962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b88084-7c2c-4b05-acc9-cd756ac168d7 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.498086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.498808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.499185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.499519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.543628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23ac5-8aa6-42a3-aadb-c6d3f68f701b service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.548715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.549340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.549720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.549993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] PATH_INFO: `/v3/users/e5ef41649b6149a29dc6a7e73a79b87c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.551133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ef41649b6149a29dc6a7e73a79b87c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.553062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.562085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.563896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cdce8-e04d-49cd-8de1-b7fbfb3a13ba service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.573123 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1445/2927] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:33.606556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ef41649b6149a29dc6a7e73a79b87c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.614084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ef41649b6149a29dc6a7e73a79b87c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.628630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ef41649b6149a29dc6a7e73a79b87c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.629445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ef41649b6149a29dc6a7e73a79b87c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.630172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ef41649b6149a29dc6a7e73a79b87c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.655527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1483/2928] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:33 2022] DELETE /identity/v3/users/e5ef41649b6149a29dc6a7e73a79b87c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:33.660468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.660758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.661038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.686638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:33.689135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.737053 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:33.785541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1446/2929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:33.796621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.798447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.802026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:33.803396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:33.818332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d56e0-3e9c-412e-9b4d-f78e10e3569f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.825244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.825991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.826763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.827033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] PATH_INFO: `/v3/users/fb4642deaa2d4931b1fa4a43fe7dc66c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.828182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4642deaa2d4931b1fa4a43fe7dc66c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.830204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.887908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a27b8-b730-4963-b1f2-1ca0dbd408db admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:33.893294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:33.894362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.894911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.895370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.907725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:33.908910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4642deaa2d4931b1fa4a43fe7dc66c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.909323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31253e3e-8e57-484b-a1dd-8ced3d5843e9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:33.909991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4642deaa2d4931b1fa4a43fe7dc66c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.924529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4642deaa2d4931b1fa4a43fe7dc66c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.943528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1484/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:33.950940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4642deaa2d4931b1fa4a43fe7dc66c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.951799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4642deaa2d4931b1fa4a43fe7dc66c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:33.974585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:33.975654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:33.975977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:33.978256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1447/2931] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:33 2022] DELETE /identity/v3/users/fb4642deaa2d4931b1fa4a43fe7dc66c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:34.022034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:34.025790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:34.072809 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:34.133812 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1485/2932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:34.144068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:34.145553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:34.230306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264603-4a28-4ecc-be90-172ffa64bcbb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:34.234801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:34.236275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:34.236275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:34.236275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:34.247463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:34.249540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:34.260895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1448/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:34.604198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:34.606198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:34.632243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e38941-329c-46a1-9f03-fa49f48c8d99 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:34.638904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:34.639714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:34.640887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:34.641270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] PATH_INFO: `/v3/projects/cbaf140c2ac84caabc94ffebda620de0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:34.643291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbaf140c2ac84caabc94ffebda620de0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:34.645550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:34.742243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbaf140c2ac84caabc94ffebda620de0', 'request_id': 'req-deec4eac-34bc-46fb-8405-736a20c47ecc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:34.754284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbaf140c2ac84caabc94ffebda620de0', 'request_id': 'req-deec4eac-34bc-46fb-8405-736a20c47ecc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:34.763154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbaf140c2ac84caabc94ffebda620de0', 'request_id': 'req-deec4eac-34bc-46fb-8405-736a20c47ecc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:34.784746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] The token cache is being invalidate because project cbaf140c2ac84caabc94ffebda620de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:34.785163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:34.785969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:34.787904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1486/2934] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:34 2022] DELETE /identity/v3/projects/cbaf140c2ac84caabc94ffebda620de0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:34.791866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:34.815971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2026e-5875-4e52-b429-fded4f24cc7f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:34.852451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:34.853752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:34.922201 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:34.934111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:34.936388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:34.936949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:34.937646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] PATH_INFO: `/v3/users/8ddbf361caea468196e225f12ee3f52b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:34.940104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddbf361caea468196e225f12ee3f52b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:34.944748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.006261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec4eac-34bc-46fb-8405-736a20c47ecc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.026238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddbf361caea468196e225f12ee3f52b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.027291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddbf361caea468196e225f12ee3f52b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.039955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddbf361caea468196e225f12ee3f52b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.043086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.048145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.049379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.051925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] PATH_INFO: `/v3/projects/39a7c55bf3894d5ab6de6bc3b0e4f497` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.055474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a7c55bf3894d5ab6de6bc3b0e4f497)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.060380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.061156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddbf361caea468196e225f12ee3f52b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.064606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00690538-75b8-43bc-b649-fa8ca086bd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddbf361caea468196e225f12ee3f52b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.131863 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1449/2935] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:34 2022] DELETE /identity/v3/users/8ddbf361caea468196e225f12ee3f52b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:35.219528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a7c55bf3894d5ab6de6bc3b0e4f497', 'request_id': 'req-56fae3cf-bf01-404c-b7ee-13c0713729e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.230615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a7c55bf3894d5ab6de6bc3b0e4f497', 'request_id': 'req-56fae3cf-bf01-404c-b7ee-13c0713729e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.233706 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:35.258576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a7c55bf3894d5ab6de6bc3b0e4f497', 'request_id': 'req-56fae3cf-bf01-404c-b7ee-13c0713729e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.285835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] The token cache is being invalidate because project 39a7c55bf3894d5ab6de6bc3b0e4f497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:35.286288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.287342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fae3cf-bf01-404c-b7ee-13c0713729e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.296830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.297349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.297751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.301224 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1487/2936] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:34 2022] DELETE /identity/v3/projects/39a7c55bf3894d5ab6de6bc3b0e4f497 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:35.328106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:35.329541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.415074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1450/2937] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:35.491864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.492130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.492416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.515188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:35.516349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.533789 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1488/2938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:35.537961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.552487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36a425-0854-491a-920d-71f787b7ea1f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.565661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.567365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.567884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.568372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.569417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:35.569925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.576370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.578136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.586388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.603119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9739f-dc9b-4990-b539-1bd6905315e3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.614590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.615637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.616040 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1451/2939] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:35.616553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.616896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] PATH_INFO: `/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.618210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4a5d2b5c2c47c683d95d3ba0b1fabe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.620075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.620756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.640715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d61a-b576-405d-9446-4d615d6312c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.650194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.651574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.653381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.655314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.659046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.662677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.713446 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1452/2940] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:35.718011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.721960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4a5d2b5c2c47c683d95d3ba0b1fabe', 'request_id': 'req-eb943796-6671-48a9-b50f-e9a3aa1829bd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.730694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4a5d2b5c2c47c683d95d3ba0b1fabe', 'request_id': 'req-eb943796-6671-48a9-b50f-e9a3aa1829bd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.737564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4a5d2b5c2c47c683d95d3ba0b1fabe', 'request_id': 'req-eb943796-6671-48a9-b50f-e9a3aa1829bd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.756386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] The token cache is being invalidate because project 7f4a5d2b5c2c47c683d95d3ba0b1fabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:35.757167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.758727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-eb943796-6671-48a9-b50f-e9a3aa1829bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:35.761692 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1489/2941] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:35 2022] DELETE /identity/v3/projects/7f4a5d2b5c2c47c683d95d3ba0b1fabe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:35.770354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f9b6-dd33-4a53-b4b8-9a8a098a03f3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.770932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f9b6-dd33-4a53-b4b8-9a8a098a03f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.771330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f9b6-dd33-4a53-b4b8-9a8a098a03f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.790797 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:35.822495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-81e5f9b6-dd33-4a53-b4b8-9a8a098a03f3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:35.823925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81e5f9b6-dd33-4a53-b4b8-9a8a098a03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.842003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d71a2-bf06-4598-9d56-31b05ba84049 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.848419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1490/2942] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:35.856858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.857936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.857936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.859842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.860476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.860757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.861029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.861809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.865220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.897670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:35.902422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.920879 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1453/2943] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:35.922853 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1491/2944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:35.929537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.939011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.941053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:35.954267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ebc6-7ab8-4c9c-8647-e42543ed19dd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.957282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6370393-f5c5-4a86-92c1-15871679b98e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:35.959770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.960514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.960915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.961282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.962275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:35.962629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.963313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:35.964036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:35.964511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:35.964899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:35.965040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.965776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:35.968123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:35.979961 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1492/2945] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:35.982623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1454/2946] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:35.983870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:35.986690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.013985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd68bc-5296-428e-8b59-cbea6bc3e1d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.020276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58694e9-1f65-454a-8e9c-a407528fde45 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.026153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.027801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.029422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.030055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.030804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.031674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.032020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.032362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.032697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.034317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.034459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.036705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.046375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1493/2947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:36.050416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.062746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2cf7-53b5-4ed0-8f0c-c79ec0e0fe2b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.067909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.068067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1455/2948] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:35 2022] POST /identity/v3/projects => generated 409 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:36.068601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.068948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.069145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] PATH_INFO: `/v3/projects/740928060bf443508f8165c0dfa50514/users/53d16cedecbe4634bf384effd09ca0a9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.072062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.089214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=740928060bf443508f8165c0dfa50514, user_id=53d16cedecbe4634bf384effd09ca0a9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.091991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660119-aef0-4263-af60-f95c8e858beb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.109448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1494/2949] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:36 2022] PUT /identity/v3/projects/740928060bf443508f8165c0dfa50514/users/53d16cedecbe4634bf384effd09ca0a9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:36.113469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.113970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.114415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.137964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:36.140222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:36.144313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c76f32-0a0b-482a-af03-47059699d945 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.212520 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1495/2950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:36.222380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.223061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.223343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.223617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.223912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.224296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.225552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:36.226322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.231006 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:36.254675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1456/2951] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:36 2022] POST /identity/v3/users => generated 305 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:06:36.258945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.271975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b14d5-c1fc-4e70-88a9-0d3952ec2992 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.277546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.278139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.278510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.278792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.279509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.281123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.297189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1457/2952] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:36.298293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.298698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf976-a594-4ba6-bf61-d85f8f8a891e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.302533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.303147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.303436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.303712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.308970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b795-ed80-4e26-a829-0f200f97fca3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.313657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.314516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.315121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.315232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.315554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.315901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.316609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.318309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25cc5d-0bba-4bc0-9616-969b3678d487 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.327396 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1496/2953] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:36.334393 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1458/2954] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:36.338505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.350008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a132c3-6678-40e2-bb97-67eec569ae14 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.355730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.356400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.356724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.357571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] PATH_INFO: `/v3/projects/29a7875a3ab248798ffce7191e078d4e/users/dc4cb8a014f841f9beb300d47fc671a8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.388113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a7875a3ab248798ffce7191e078d4e, user_id=dc4cb8a014f841f9beb300d47fc671a8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.392146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.413315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1497/2955] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:36 2022] PUT /identity/v3/projects/29a7875a3ab248798ffce7191e078d4e/users/dc4cb8a014f841f9beb300d47fc671a8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:36.424667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.425092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.426172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.453099 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:36.467445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] MFA Rules not processed for user `dc4cb8a014f841f9beb300d47fc671a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:36.469278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:36.629664 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1459/2956] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:36.630731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.753554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0f6f4-d3ab-4235-af88-9ca139f15c9f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.765563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.766453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.769132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.769518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.770823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.776295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.838765 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1498/2957] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:36 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:06:36.844424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:36.870956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066557a4-0c61-4b4a-ac76-ae2e1d0ef194 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:36.958080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:36.958977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:36.959419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:36.959858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:36.961237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:36.963576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:36.991465 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1460/2958] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:36 2022] POST /identity/v3/users => generated 310 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:36.995392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.011314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce2f1-2c89-4209-898a-42504b353a6c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.020160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.021087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.023174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.023731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.024633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:37.026608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:37.042140 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1499/2959] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:37.047230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.061741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac61a1-7833-4f30-a5cd-c1f248e76cbc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.078309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.079964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.083395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.083672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] PATH_INFO: `/v3/projects/1fa1bc1da7a64c37adfbf807302fca30/users/cd22bf399f0c408fabfbec69df4ade78/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.117707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa1bc1da7a64c37adfbf807302fca30, user_id=cd22bf399f0c408fabfbec69df4ade78, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:37.121654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:37.140888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1461/2960] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:37 2022] PUT /identity/v3/projects/1fa1bc1da7a64c37adfbf807302fca30/users/cd22bf399f0c408fabfbec69df4ade78/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:37.145130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.159871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf823-89a3-4f9f-9520-9d846fdca39b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.247539 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:37.259347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.260947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.261316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.261596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.262274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:37.264555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebfa3-0f8a-4c95-81b5-f39e3b5fa849 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:37.278050 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1500/2961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:37.283323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.296946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b7ac-4336-483b-bb2c-d8c15c2c922d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.305653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.306897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.307199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.307483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] PATH_INFO: `/v3/projects/1fa1bc1da7a64c37adfbf807302fca30/users/cd22bf399f0c408fabfbec69df4ade78/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.309925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa1bc1da7a64c37adfbf807302fca30, user_id=cd22bf399f0c408fabfbec69df4ade78, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:37.314383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:37.327855 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1462/2962] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:37 2022] PUT /identity/v3/projects/1fa1bc1da7a64c37adfbf807302fca30/users/cd22bf399f0c408fabfbec69df4ade78/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:37.339877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.340198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.341141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.381789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] MFA Rules not processed for user `cd22bf399f0c408fabfbec69df4ade78`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:37.383054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:37.484570 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1501/2963] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:37.653907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.661746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:37.782541 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:37.812682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f537-5fab-4b5d-8820-eb5ce0ad76e1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.820855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.821949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.821949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.826743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:37.836640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:37.838311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:37.852398 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1463/2964] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:37.932121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:37.934040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:37.962038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb148fa-3a9d-4844-9745-049d258f4e81 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:37.968364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:37.969530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:37.979025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:37.979818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:38.137551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:38.150325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19560cfc-a30c-4a19-863d-0e72f7d59afe service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:38.205434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1502/2965] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:38.434178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:38.530872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bd6e-83ae-4548-bec9-5d1051a42d19 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:38.539933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:38.540683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:38.543177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:38.543662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] PATH_INFO: `/v3/users/dc4cb8a014f841f9beb300d47fc671a8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:38.546224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4cb8a014f841f9beb300d47fc671a8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:38.548831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:38.664182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4cb8a014f841f9beb300d47fc671a8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:38.665309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4cb8a014f841f9beb300d47fc671a8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:38.680653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4cb8a014f841f9beb300d47fc671a8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:38.735909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4cb8a014f841f9beb300d47fc671a8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:38.736519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4cb8a014f841f9beb300d47fc671a8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:38.755766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1464/2966] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:38 2022] DELETE /identity/v3/users/dc4cb8a014f841f9beb300d47fc671a8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:38.760435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:38.760782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:38.761057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:38.798731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:38.801133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:38.897453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1503/2967] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:38.908727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:38.910289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:39.009791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74fc5-be54-4b2e-991d-2ee3a51ff9a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:39.017028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:39.018372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:39.018873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:39.019540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:39.031831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:39.033429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:39.039696 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:39.048853 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1465/2968] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:39.480029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:39.481914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:39.517291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05710ef-e898-4636-9342-3afa967e3ff3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:39.537744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:39.539372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:39.539861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:39.540474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] PATH_INFO: `/v3/projects/29a7875a3ab248798ffce7191e078d4e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:39.542376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a7875a3ab248798ffce7191e078d4e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:39.545117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:39.560887 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:39.618979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a7875a3ab248798ffce7191e078d4e', 'request_id': 'req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.629729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a7875a3ab248798ffce7191e078d4e', 'request_id': 'req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.638893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a7875a3ab248798ffce7191e078d4e', 'request_id': 'req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.656497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] The token cache is being invalidate because project 29a7875a3ab248798ffce7191e078d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:39.657070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.657929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.667130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:39.675543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1504/2969] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:39 2022] DELETE /identity/v3/projects/29a7875a3ab248798ffce7191e078d4e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:39.691254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8fb8-ea0a-417d-91cb-6e0e3780fe8c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:39.760076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:39.760755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:39.761653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:39.762005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] PATH_INFO: `/v3/users/cd22bf399f0c408fabfbec69df4ade78` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:39.763317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd22bf399f0c408fabfbec69df4ade78)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:39.765587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:39.839244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd22bf399f0c408fabfbec69df4ade78'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.840160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd22bf399f0c408fabfbec69df4ade78'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.848255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd22bf399f0c408fabfbec69df4ade78'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.866960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd22bf399f0c408fabfbec69df4ade78'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.868512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c9f603f-4d80-427d-b8eb-2f77fa5cfffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd22bf399f0c408fabfbec69df4ade78'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:39.893448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1466/2970] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:39 2022] DELETE /identity/v3/users/cd22bf399f0c408fabfbec69df4ade78 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:40.333728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:40.335341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:40.353691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e46f9-8bfd-4b49-b8c6-c4d270a4a5e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:40.474042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:40.474718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:40.475148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:40.475430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] PATH_INFO: `/v3/projects/1fa1bc1da7a64c37adfbf807302fca30` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:40.478110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa1bc1da7a64c37adfbf807302fca30)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:40.480060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:40.568401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa1bc1da7a64c37adfbf807302fca30', 'request_id': 'req-284197b1-96c5-4fcf-87f0-c559f6e555bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:40.577682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa1bc1da7a64c37adfbf807302fca30', 'request_id': 'req-284197b1-96c5-4fcf-87f0-c559f6e555bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:40.584334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa1bc1da7a64c37adfbf807302fca30', 'request_id': 'req-284197b1-96c5-4fcf-87f0-c559f6e555bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:40.601984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] The token cache is being invalidate because project 1fa1bc1da7a64c37adfbf807302fca30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:40.602485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:40.603331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-284197b1-96c5-4fcf-87f0-c559f6e555bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:40.609673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1505/2971] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:40 2022] DELETE /identity/v3/projects/1fa1bc1da7a64c37adfbf807302fca30 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:40.611334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:40.611861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:40.612263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:40.639145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:40.642233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:40.725002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1467/2972] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:40.734180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:40.734764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:40.735205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:40.759709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:40.761364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:40.774484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1506/2973] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:40.775263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:40.790694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9ade-ff13-43a2-98df-cd5d6ff642c5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:40.796847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:40.797525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:40.797806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:40.798077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:40.798990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:40.799296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:40.801025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:40.833819 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1468/2974] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:06:40.835418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:40.857369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ccd1-4efb-4b77-8bde-a7683c6b165a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:40.869294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:40.870032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:40.870710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:40.871163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:40.872563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:40.874981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:40.911201 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:40.926615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1507/2975] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:40 2022] POST /identity/v3/projects => generated 411 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:40.928402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:40.943018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d83f7d-cbbc-4653-893a-a70720ce8eb7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:40.949190 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:41.122229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:41.123592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.126954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.126954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.126954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:41.126954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:41.191146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1469/2976] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:40 2022] POST /identity/v3/users => generated 306 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:41.195241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.211841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1d49-498a-4917-bb00-b559f6be42ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:41.225113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:41.225781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.226060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.226329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.226994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:41.228619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:41.250261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1508/2977] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:41.254385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.282089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd491-89d5-42bf-b45c-4e4c3b6580a2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:41.288629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:41.290234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.290716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.291151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.292304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:41.297155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c66c0-a69e-4618-b8ad-1c8ae6c43945 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:41.315275 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1470/2978] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:41.318403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.339900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4654-1c71-4b75-a62e-c85f2180ea54 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:41.346418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:41.347103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.347384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.347660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] PATH_INFO: `/v3/projects/94a306b9225f4c9da48f9aa5ce0f8a2c/users/84d91deac56c435aa95c64b9f1a327f8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.382610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a306b9225f4c9da48f9aa5ce0f8a2c, user_id=84d91deac56c435aa95c64b9f1a327f8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:41.386745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb172fcc-ad27-4357-8323-03ee02f2d416 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:41.415936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1509/2979] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:41 2022] PUT /identity/v3/projects/94a306b9225f4c9da48f9aa5ce0f8a2c/users/84d91deac56c435aa95c64b9f1a327f8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:41.428272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.428562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.428885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.485352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] MFA Rules not processed for user `84d91deac56c435aa95c64b9f1a327f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:41.487599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:41.509794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.510309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.510426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.550517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:41.551762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:41.642552 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1471/2980] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:41.645355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.725499 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1510/2981] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:41.749945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.751673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:41.833105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e9e0-fe41-42f2-979b-5417255c926a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:41.853720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:41.854562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:41.854844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:41.855114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:41.855766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:41.857948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:41.894100 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:41.914514 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1472/2982] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:41 2022] POST /identity/v3/projects => generated 409 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:41.915710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:41.932891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499004d-d720-4ebb-884f-a99326017c5f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.047705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5ba79-2dbb-4c5f-80be-08ddc9d83db5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.057420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.058185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.058782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.059463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.062205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.065494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.078909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.079852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.080298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.080725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.117224 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:42.147940 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1473/2983] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:41 2022] POST /identity/v3/users => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:06:42.152373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:42.177558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef95a-32ac-4a44-955c-07668e484c74 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.190932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.191568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.192003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.192292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.192962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.194649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.226092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1474/2984] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:42.230197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:42.251786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d500-3e6f-47dc-b9b0-d57be82ff128 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.258771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.260220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.260926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.261212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.261520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] PATH_INFO: `/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601/users/5b8468b1018a46f09368ca1acb4c820b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.261864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.291767 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1511/2985] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:42.297204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97a5c10ee5842ab8ad4ccd1b0a7c601, user_id=5b8468b1018a46f09368ca1acb4c820b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.300383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.331502 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1475/2986] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:42 2022] PUT /identity/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601/users/5b8468b1018a46f09368ca1acb4c820b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:42.335737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:42.377485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae5ed-0e0b-4d62-9c8d-4bc14abf5ef9 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.549479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.550150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.554956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.555258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.557727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.563673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bace1-850e-47cb-bf29-f4dbae089dd5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.608514 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1512/2987] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:42.612429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:42.636197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d7be-6721-421f-9cbf-b0c631792172 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:42.647699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:42.648409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.648693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.648976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] PATH_INFO: `/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601/users/5b8468b1018a46f09368ca1acb4c820b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.665167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97a5c10ee5842ab8ad4ccd1b0a7c601, user_id=5b8468b1018a46f09368ca1acb4c820b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:42.681087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:42.727249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1476/2988] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:42 2022] PUT /identity/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601/users/5b8468b1018a46f09368ca1acb4c820b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:42.823286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:42.823929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:42.824430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:42.900613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] MFA Rules not processed for user `5b8468b1018a46f09368ca1acb4c820b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:42.902541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:43.109271 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1513/2989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:43.116164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:43.118181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:43.402751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b7a8-3369-49d4-ae91-e64f195839f7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:43.443316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:43.443597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:43.443812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:43.444088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:43.500310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:43.507924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:43.570982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1477/2990] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:43.792270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:43.826184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f344-72fc-47ba-b78b-acbdc747e16e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:43.853713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:43.854417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:43.854714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:43.854994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:43.999903 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:44.071040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:44.072785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2dfd6-0f53-4f77-81f7-73e34dedc305 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:44.097358 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1514/2991] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:45.033954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:45.164135 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:45.269084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f23431-b38f-4800-8038-705e58ba09d9 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:45.289881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:45.290717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:45.293026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:45.296215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] PATH_INFO: `/v3/users/84d91deac56c435aa95c64b9f1a327f8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:45.302125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d91deac56c435aa95c64b9f1a327f8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:45.314185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:45.542381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d91deac56c435aa95c64b9f1a327f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:45.543426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d91deac56c435aa95c64b9f1a327f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:45.580742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d91deac56c435aa95c64b9f1a327f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:45.639661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d91deac56c435aa95c64b9f1a327f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:45.643467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d91deac56c435aa95c64b9f1a327f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:45.679991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1478/2992] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:45 2022] DELETE /identity/v3/users/84d91deac56c435aa95c64b9f1a327f8 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:45.684697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:45.686491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:45.687012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:45.741239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:45.744296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:45.906014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:45.907878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:46.080460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1515/2993] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:46.112257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:46.114870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:46.186854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da779-c0f1-4857-981f-864bc10fad5d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:46.221538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:46.222361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:46.222782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:46.224711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:46.229671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:46.280464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:46.282513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b59069-c4bd-405b-baa2-36f7c3436d03 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:46.339626 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1479/2994] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:46.394891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d9668-93c4-450f-9e2f-af0c60bbcf5c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:46.401709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:46.403081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:46.404495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:46.404955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:46.443014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:46.444508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:46.486678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1516/2995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:49.189250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:49.190248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:49.190741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:49.274209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] MFA Rules not processed for user `53d16cedecbe4634bf384effd09ca0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:49.275464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:49.334613 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.503593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1480/2996] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:49.503819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:49.505630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:49.511183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:49.514932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:49.555756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0016-02bf-456b-aec4-b26acab38354 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:49.600964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:49.603926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:49.607726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cdf79-21f5-4279-b3cf-fcec8a311bf2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:49.609101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:49.609385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] PATH_INFO: `/v3/projects/94a306b9225f4c9da48f9aa5ce0f8a2c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:49.616498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a306b9225f4c9da48f9aa5ce0f8a2c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:49.626036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:49.648380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:49.649494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:49.649988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:49.651062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:49.714957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:49.718135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:49.779803 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1481/2997] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:49.869961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a306b9225f4c9da48f9aa5ce0f8a2c', 'request_id': 'req-9f321c68-d383-4e7a-8106-12a4f31b4f14'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:49.898393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a306b9225f4c9da48f9aa5ce0f8a2c', 'request_id': 'req-9f321c68-d383-4e7a-8106-12a4f31b4f14'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:49.934064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a306b9225f4c9da48f9aa5ce0f8a2c', 'request_id': 'req-9f321c68-d383-4e7a-8106-12a4f31b4f14'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:49.962325 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.978356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] The token cache is being invalidate because project 94a306b9225f4c9da48f9aa5ce0f8a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:49.978817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:49.986336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:49.988974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1517/2998] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:49 2022] DELETE /identity/v3/projects/94a306b9225f4c9da48f9aa5ce0f8a2c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:49.993900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:50.083830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fae4f-a2ff-4727-94a7-e369d9a7340a service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:50.234640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:50.235738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:50.235738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:50.235934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] PATH_INFO: `/v3/users/5b8468b1018a46f09368ca1acb4c820b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:50.238794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8468b1018a46f09368ca1acb4c820b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:50.242959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:50.387014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8468b1018a46f09368ca1acb4c820b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:50.391202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8468b1018a46f09368ca1acb4c820b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:50.426707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8468b1018a46f09368ca1acb4c820b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:50.538320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8468b1018a46f09368ca1acb4c820b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:50.540198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587f807b-c950-4412-9a8b-0f86a21a83e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8468b1018a46f09368ca1acb4c820b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:50.583220 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1482/2999] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:49 2022] DELETE /identity/v3/users/5b8468b1018a46f09368ca1acb4c820b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:52.606339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:52.609722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:52.653621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c68-d383-4e7a-8106-12a4f31b4f14 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:52.865545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:52.866387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:52.866773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:52.869981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] PATH_INFO: `/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:52.874415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97a5c10ee5842ab8ad4ccd1b0a7c601)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:52.877268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:53.088725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97a5c10ee5842ab8ad4ccd1b0a7c601', 'request_id': 'req-a4face1a-ded7-497f-bad4-63302dc9190e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:53.116141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97a5c10ee5842ab8ad4ccd1b0a7c601', 'request_id': 'req-a4face1a-ded7-497f-bad4-63302dc9190e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:53.134570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97a5c10ee5842ab8ad4ccd1b0a7c601', 'request_id': 'req-a4face1a-ded7-497f-bad4-63302dc9190e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:53.162415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] The token cache is being invalidate because project a97a5c10ee5842ab8ad4ccd1b0a7c601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:06:53.162913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:53.163729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4face1a-ded7-497f-bad4-63302dc9190e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:06:53.165788 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1518/3000] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:52 2022] DELETE /identity/v3/projects/a97a5c10ee5842ab8ad4ccd1b0a7c601 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:53.173200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:53.173971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:53.173971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:53.241859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:53.243285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:53.280490 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:53.463590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1483/3001] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:53.465474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:53.466777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:53.467306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:53.588433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:53.592795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:53.630838 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1519/3002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:53.635020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:53.668225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564069-a424-426a-966d-3b560f45d3a3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:53.690757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:53.692214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:53.692894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:53.693425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:53.694354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:06:53.695303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:53.714192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:53.771180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:53.787494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1484/3003] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:06:53.804297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d02640-af96-4c12-b6f4-c2067a188f9e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:53.824927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:53.827182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:53.829216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:53.830791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:53.869318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:53.890589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:54.041717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:54.054351 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1520/3004] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:53 2022] POST /identity/v3/projects => generated 359 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:54.067714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b32e0-5947-4b44-b2ad-58e0b1b2e65b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:54.211289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:54.212687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:54.213189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:54.213704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:54.214812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:54.217747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:54.282909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1485/3005] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:54 2022] POST /identity/v3/users => generated 280 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:54.287363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:54.319400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057a469-a823-4d53-8595-4be0bd19eeae admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:54.330348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:54.331185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:54.331726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:54.332257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:54.333209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:54.335153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:54.363968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:54.365331 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1521/3006] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:54.382837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8653ad-6fba-4842-bfcb-13cd329da1d3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:54.396908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:54.398583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:54.399060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:54.399497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:54.400709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:54.402747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73334ed-d9ce-49da-b731-cba7ea17838c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:54.436884 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1486/3007] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:06:54.441920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:54.461803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd51868-101b-47bb-bd71-5924e945c25c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:54.470929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:54.471922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:54.472371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:54.472856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] PATH_INFO: `/v3/projects/77dea47d6c8f45fa83f7f20bfea50aeb/users/0106de25838f4bb8a2009e76ead02c06/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:54.508190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dea47d6c8f45fa83f7f20bfea50aeb, user_id=0106de25838f4bb8a2009e76ead02c06, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:54.510924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:54.550764 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1522/3008] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:54 2022] PUT /identity/v3/projects/77dea47d6c8f45fa83f7f20bfea50aeb/users/0106de25838f4bb8a2009e76ead02c06/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:54.574284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:54.574858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:54.575360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:54.642243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] MFA Rules not processed for user `0106de25838f4bb8a2009e76ead02c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:54.662073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:54.948260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1487/3009] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:54.952541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:55.020169 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:55.183236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9d97-176c-4af3-8795-b074c7ead4f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:55.197612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:55.201776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.202293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.202777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.206211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:55.218697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:55.284344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1523/3010] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:06:54 2022] POST /identity/v3/projects => generated 361 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:06:55.288767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:55.316271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c867d-6fc8-4dcc-8360-1fc13b937cea None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:55.390391 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:55.490708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:55.491700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.492188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.492799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.493813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:55.496388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:55.533207 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1488/3011] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:06:55 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:06:55.534759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:55.547828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405f9d-34e7-4af8-964d-f24a806e24b8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:55.555012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:55.555909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.556890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.557546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.558736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:55.562449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:55.583328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1524/3012] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:55.587616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:55.608432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4645e3-4b66-4852-bbe8-a40ec52be996 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:55.617152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:55.619081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.619649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.620175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] PATH_INFO: `/v3/projects/d10ec0bf0e30476796a6b082686bd66e/users/95a4a7962cd64839a0762871e2a42f6b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.646605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10ec0bf0e30476796a6b082686bd66e, user_id=95a4a7962cd64839a0762871e2a42f6b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:55.656736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe380a-2739-4671-adb3-5cabc35e2c2f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:55.693563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1489/3013] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:55 2022] PUT /identity/v3/projects/d10ec0bf0e30476796a6b082686bd66e/users/95a4a7962cd64839a0762871e2a42f6b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:06:55.695469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:55.717062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e20b7-eb7e-4c7c-ba65-0e0c5e6a8891 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:55.780233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.780834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.781338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.809268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] MFA Rules not processed for user `53d16cedecbe4634bf384effd09ca0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:55.813251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:55.926196 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1490/3014] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:06:55.974885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:55.975499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:55.975783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:55.976049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:55.977032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:55.978410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610dccf-c607-4eea-8309-9920f70a4253 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:55.993628 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1525/3015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:06:55.998164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:56.012388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55edc92-3f74-483d-886b-eabc6910f34e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:56.019791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:56.021563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:56.022265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:56.022771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] PATH_INFO: `/v3/projects/d10ec0bf0e30476796a6b082686bd66e/users/95a4a7962cd64839a0762871e2a42f6b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:56.026115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10ec0bf0e30476796a6b082686bd66e, user_id=95a4a7962cd64839a0762871e2a42f6b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:56.030164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:56.045128 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1491/3016] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:06:55 2022] PUT /identity/v3/projects/d10ec0bf0e30476796a6b082686bd66e/users/95a4a7962cd64839a0762871e2a42f6b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:06:56.055965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:56.056827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:56.056827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:56.166782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] MFA Rules not processed for user `95a4a7962cd64839a0762871e2a42f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:06:56.172718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:56.666289 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1526/3017] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 606 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:06:56.974082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:56.978728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:57.135975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03522-f688-49dd-9398-a1c8fbc71dcc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:57.143153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:57.144349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:57.147911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:57.148628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:57.151041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:57.165795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:57.167688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:57.205655 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1492/3018] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:06:58.149905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:06:58.151634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:06:58.224352 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:58.364601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365578b7-17cd-4ca7-a7eb-dfbd0bc29aa4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:06:58.372989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:06:58.374451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:06:58.374960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:06:58.375482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:06:58.412702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:06:58.433587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc45b36-85d6-47f6-88cf-2ef8ea16a591 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:06:58.533820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1527/3019] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:06:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:00.369621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:00.438611 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:00.547366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56773cba-9155-4cba-9e4d-5c388d603a65 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:00.554873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:00.555787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:00.556679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:00.557609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] PATH_INFO: `/v3/users/0106de25838f4bb8a2009e76ead02c06` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:00.561878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0106de25838f4bb8a2009e76ead02c06)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:00.565928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:00.697220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0106de25838f4bb8a2009e76ead02c06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:00.697961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0106de25838f4bb8a2009e76ead02c06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:00.716902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0106de25838f4bb8a2009e76ead02c06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:00.764455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0106de25838f4bb8a2009e76ead02c06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:00.765826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0106de25838f4bb8a2009e76ead02c06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:00.812333 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1493/3020] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:07:00 2022] DELETE /identity/v3/users/0106de25838f4bb8a2009e76ead02c06 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:00.819470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:00.819962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:00.820113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:00.889154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:00.891665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:01.093679 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1528/3021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:07:01.111728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:01.113451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:01.242228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8514-ac03-4908-a160-f85dae9900de admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:01.248890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:01.249747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:01.250036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:01.250370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:01.264474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:01.266615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:01.287315 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1494/3022] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:07:02.083200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:02.087105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:02.113111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f8943-9a47-4120-bcbe-07eaa76fe1f4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:02.128778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:02.130243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:02.130859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:02.133030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] PATH_INFO: `/v3/projects/77dea47d6c8f45fa83f7f20bfea50aeb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:02.136439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77dea47d6c8f45fa83f7f20bfea50aeb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:02.142944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:02.262759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77dea47d6c8f45fa83f7f20bfea50aeb', 'request_id': 'req-13c353d7-ffd6-4480-93e7-359c5d2cb45b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.282325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77dea47d6c8f45fa83f7f20bfea50aeb', 'request_id': 'req-13c353d7-ffd6-4480-93e7-359c5d2cb45b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.299264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77dea47d6c8f45fa83f7f20bfea50aeb', 'request_id': 'req-13c353d7-ffd6-4480-93e7-359c5d2cb45b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.330677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] The token cache is being invalidate because project 77dea47d6c8f45fa83f7f20bfea50aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:07:02.330976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.331677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.333594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1529/3023] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:02 2022] DELETE /identity/v3/projects/77dea47d6c8f45fa83f7f20bfea50aeb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:02.338057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:02.350917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00dea3-af17-46db-9a6a-0047654b83fa service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:02.453874 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:02.490205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:02.491369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:02.491996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:02.492666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] PATH_INFO: `/v3/users/95a4a7962cd64839a0762871e2a42f6b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:02.498866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a4a7962cd64839a0762871e2a42f6b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:02.502914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:02.699954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a4a7962cd64839a0762871e2a42f6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.702776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a4a7962cd64839a0762871e2a42f6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.755813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a4a7962cd64839a0762871e2a42f6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.793683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a4a7962cd64839a0762871e2a42f6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.796680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f73105dc-e27d-4e32-998c-5b39dc7615bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a4a7962cd64839a0762871e2a42f6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:02.821677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1495/3024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:07:02 2022] DELETE /identity/v3/users/95a4a7962cd64839a0762871e2a42f6b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:07:04.399434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:04.401149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:04.429556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c353d7-ffd6-4480-93e7-359c5d2cb45b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:04.527516 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:04.607677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:04.609187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:04.609642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:04.610590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] PATH_INFO: `/v3/projects/d10ec0bf0e30476796a6b082686bd66e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:04.612694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10ec0bf0e30476796a6b082686bd66e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:04.616655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:04.756460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10ec0bf0e30476796a6b082686bd66e', 'request_id': 'req-cc21bdb4-627e-47f2-9a31-302aad25c084'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:04.768793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10ec0bf0e30476796a6b082686bd66e', 'request_id': 'req-cc21bdb4-627e-47f2-9a31-302aad25c084'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:04.783729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10ec0bf0e30476796a6b082686bd66e', 'request_id': 'req-cc21bdb4-627e-47f2-9a31-302aad25c084'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:04.814680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] The token cache is being invalidate because project d10ec0bf0e30476796a6b082686bd66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:07:04.815017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:04.815953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc21bdb4-627e-47f2-9a31-302aad25c084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:04.818747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1530/3025] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:04 2022] DELETE /identity/v3/projects/d10ec0bf0e30476796a6b082686bd66e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:04.823922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:04.824513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:04.824607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:04.873951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:04.881063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:05.093805 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1496/3026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:07:05.101289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.102232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.103076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.150590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:05.152268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:05.181340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1531/3027] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:05.193155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.208930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec37a-7d9f-4948-aeea-72eadcbb1caf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:05.256996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:05.261433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.266017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.271815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.273864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:07:05.276205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:05.284830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:05.324639 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1497/3028] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:07:05.332119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.343064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292b822-d1f4-4102-8ad4-ee181201584f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:05.348471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:05.349064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.349350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.349692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.350304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:05.352606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:05.413637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1532/3029] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:07:05 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:05.420336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.447737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a5c2-476a-4a3a-aef0-248ba444283f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:05.645376 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:05.683696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:05.687325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.687734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.688239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.689013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:05.693430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:05.745602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1498/3030] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:07:05 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:05.752118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.773125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c396d5-97a9-455d-8046-e2f1291c0d55 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:05.793168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:05.794043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.794717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.795188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.811043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:05.815797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:05.878779 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1533/3031] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:05.882143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.910998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00fffc-d769-4ffe-bbd7-53d2c1715ebb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:05.931494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:05.933237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:05.933836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:05.935873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:05.937652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:05.943402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80579bd5-424c-4329-af36-5e77466cf9c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:05.974833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1499/3032] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:05.976688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:05.993476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad27f-271f-42b7-a556-da670685d2fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:06.003241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:06.004093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:06.004389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:06.004670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] PATH_INFO: `/v3/projects/ece9c2b6ca644160ad4c5fb7e1131c14/users/9164864381494d9991fd97410bedea72/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:06.050485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece9c2b6ca644160ad4c5fb7e1131c14, user_id=9164864381494d9991fd97410bedea72, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:06.055287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:06.089237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1534/3033] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:05 2022] PUT /identity/v3/projects/ece9c2b6ca644160ad4c5fb7e1131c14/users/9164864381494d9991fd97410bedea72/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:06.098192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23aca-2de7-40ec-9915-bcca86ad66e3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:06.099267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23aca-2de7-40ec-9915-bcca86ad66e3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:06.099646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23aca-2de7-40ec-9915-bcca86ad66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:06.209161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fdf23aca-2de7-40ec-9915-bcca86ad66e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:06.217784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fdf23aca-2de7-40ec-9915-bcca86ad66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:06.728152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1500/3034] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 632 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:06.864744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:06.867663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:07.146033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852fcff-875a-466a-9955-55be77f026bf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:07.181153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:07.184391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:07.185387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:07.197598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:07.247876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:07.258066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442e978-fed2-4d4f-a8b9-0e0bb3bb5898 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:07.275778 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:07.289665 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1535/3035] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:07:13.538376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:13.538944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:13.538944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:13.574369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] MFA Rules not processed for user `1f85ae026362410fb573c81bef57159e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:13.578968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:13.702339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1501/3036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:14.962172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:14.962779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:14.962779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:14.991676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:14.994252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:15.089046 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1536/3037] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:15.110551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:15.113789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:15.293958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48321f3-8cf5-4c40-82c0-29026edc75cd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:15.306191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:15.307137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:15.307513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:15.307833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:15.333235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:15.334904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85285-b2df-4a9c-b6e0-18b7d9e358c1 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:15.354436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1502/3038] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:07:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:07:15.991991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:15.993535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:16.029629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077b5a-c098-4317-aba8-b3fabce491ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:16.047465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:16.049236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:16.049747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:16.051274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] PATH_INFO: `/v3/users/687667b3aadf4dd591e1335678be938d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:16.059990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687667b3aadf4dd591e1335678be938d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:16.063271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:16.198107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687667b3aadf4dd591e1335678be938d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:16.212615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687667b3aadf4dd591e1335678be938d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:16.240729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687667b3aadf4dd591e1335678be938d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:16.246657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687667b3aadf4dd591e1335678be938d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:16.247418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687667b3aadf4dd591e1335678be938d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:16.281001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1537/3039] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:07:15 2022] DELETE /identity/v3/users/687667b3aadf4dd591e1335678be938d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:16.285780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:16.286581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:16.286581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:16.302936 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:16.344875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:16.357056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:16.527190 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1503/3040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:16.607400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:16.609917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:16.800714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597eb3f-3129-422b-9f78-63ed9728a6a6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:16.808434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:16.811908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:16.812838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:16.814570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:16.852476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:16.856448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:16.903654 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1538/3041] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:17.427098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:17.429204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:17.467428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5014551-fd16-476a-8c5c-52490e9acff4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:17.500341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:17.501052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:17.501336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:17.501638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] PATH_INFO: `/v3/projects/31eef923c6104d6ea7bb63db20f13dc3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:17.506371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31eef923c6104d6ea7bb63db20f13dc3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:17.512070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:17.683316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31eef923c6104d6ea7bb63db20f13dc3', 'request_id': 'req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:17.705836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31eef923c6104d6ea7bb63db20f13dc3', 'request_id': 'req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:17.716569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31eef923c6104d6ea7bb63db20f13dc3', 'request_id': 'req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:17.743946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] The token cache is being invalidate because project 31eef923c6104d6ea7bb63db20f13dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:07:17.745102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:17.747617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:17.751660 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1504/3042] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:17 2022] DELETE /identity/v3/projects/31eef923c6104d6ea7bb63db20f13dc3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:17.755858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:17.776011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82ddc-de03-4fee-8e35-e9844b3c6025 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:17.813345 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:17.920361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:17.921300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:17.921769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:17.922225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] PATH_INFO: `/v3/users/576f6792fff743518c31742e3df576dd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:17.923691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=576f6792fff743518c31742e3df576dd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:17.926105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:18.040825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576f6792fff743518c31742e3df576dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.058693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576f6792fff743518c31742e3df576dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.091033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576f6792fff743518c31742e3df576dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.093293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576f6792fff743518c31742e3df576dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.096671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14f611e0-f812-41e2-aec9-24e4f006f8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576f6792fff743518c31742e3df576dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.135971 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1539/3043] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:07:17 2022] DELETE /identity/v3/users/576f6792fff743518c31742e3df576dd => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:18.572711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:18.575145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:18.614603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4a1dd-ffd5-4515-a630-58e48ac3d026 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:18.734512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:18.735793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:18.736303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:18.736830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] PATH_INFO: `/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:18.739016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a642e38bcd3c41b093ba9ed920eb3e23)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:18.741958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:18.792963 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:18.831713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a642e38bcd3c41b093ba9ed920eb3e23', 'request_id': 'req-edb876cb-2754-40ea-a99f-70f5973a4506'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.840223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a642e38bcd3c41b093ba9ed920eb3e23', 'request_id': 'req-edb876cb-2754-40ea-a99f-70f5973a4506'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.847266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a642e38bcd3c41b093ba9ed920eb3e23', 'request_id': 'req-edb876cb-2754-40ea-a99f-70f5973a4506'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.868399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] The token cache is being invalidate because project a642e38bcd3c41b093ba9ed920eb3e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:07:18.868806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.869663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edb876cb-2754-40ea-a99f-70f5973a4506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:18.880485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:18.881544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:18.882293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:18.884193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1505/3044] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:18 2022] DELETE /identity/v3/projects/a642e38bcd3c41b093ba9ed920eb3e23 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:18.910335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:18.911995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:19.079082 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1540/3045] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:19.086900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.087449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.087915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.139723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:19.141029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:19.164324 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1506/3046] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:19.166198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.211224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5682-52e8-4527-b983-10b08ec7af2d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.249669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.250334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.250619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.250896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.251562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:07:19.251867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:19.261756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:19.351642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.368482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e21b8-9346-4862-bea5-079b28c0aa27 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.369437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1541/3047] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:07:19.382056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.382854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.383142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.390546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.390546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:19.390546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:19.466512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.473145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1507/3048] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:07:19 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:19.492164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7617ea-f846-403a-a8f0-8981a0e3f78c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.588200 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:19.689217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.690373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.690656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.690928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.691670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:19.696809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:19.761977 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1542/3049] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:07:19 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:19.778298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.809879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf790d2-842e-441d-850e-5657e7cee5e9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.816421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.817427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.817950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.818570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.819457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:19.821604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:19.845328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1508/3050] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:19.846332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.864998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6df9-8b94-4924-895e-6bee8cd86059 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.883405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.884817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.885113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.885389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:19.886413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:19.893751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b0bd5-f873-4b9a-b6d8-5d854e0651e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:19.927016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1543/3051] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:19.928219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:19.949108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804419f-be5b-49fb-971e-443fab1116e2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:19.964047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:19.965729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:19.966066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:19.966550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] PATH_INFO: `/v3/projects/4131663ab3574002b589848f67fbb78d/users/7f09255419184d11b8379c6bd0a338b0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:20.022710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4131663ab3574002b589848f67fbb78d, user_id=7f09255419184d11b8379c6bd0a338b0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:20.032178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:20.067736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1509/3052] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:19 2022] PUT /identity/v3/projects/4131663ab3574002b589848f67fbb78d/users/7f09255419184d11b8379c6bd0a338b0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:20.070354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:20.070901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:20.071409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:20.101978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:20.104441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:20.270684 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1544/3053] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:20.308242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:20.310827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:20.395058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905430ab-6d9c-434c-9dbc-8d0ec5373127 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:20.399944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:20.400565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:20.401108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:20.401389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:20.434409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:20.437094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:20.454029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1510/3054] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:21.555403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:21.557059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:21.639232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49180490-94e2-4a7a-95a1-d6d5619d59ea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:21.644698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:21.645572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:21.645958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:21.646338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:21.648252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:21.866790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:21.868553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460640e0-5fb1-47df-8ba8-5a1a5646b493 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:21.876928 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:21.914258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1545/3055] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:23.536959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:23.538682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:23.570273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed9e5-d229-43ab-9ca9-742883f23909 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:23.587807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:23.588687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:23.589071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:23.589647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] PATH_INFO: `/v3/users/46ba0c28dade4f7abf4e3ef3dcafa957` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:23.592000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ba0c28dade4f7abf4e3ef3dcafa957)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:23.594416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:23.675268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ba0c28dade4f7abf4e3ef3dcafa957'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:23.676094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ba0c28dade4f7abf4e3ef3dcafa957'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:23.681915 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:23.689418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ba0c28dade4f7abf4e3ef3dcafa957'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:23.708226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ba0c28dade4f7abf4e3ef3dcafa957'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:23.709117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ba0c28dade4f7abf4e3ef3dcafa957'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:23.750077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1511/3056] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:07:23 2022] DELETE /identity/v3/users/46ba0c28dade4f7abf4e3ef3dcafa957 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:23.756363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:23.758100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:23.759720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:23.818551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:23.822564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:23.987338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1546/3057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:24.023373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:24.035798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:24.234660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22819b-ff11-4292-9e71-8eafc204094b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:24.250784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:24.251552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:24.251908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:24.252257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:24.279309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:24.289292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99bc4-33e2-4cba-ad90-2a29f205d595 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:24.319612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1512/3058] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:26.156023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:26.158330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:26.192962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a10ff-555f-49e8-bdb6-49d283b2c147 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:26.213310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:26.214392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:26.214966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:26.216196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] PATH_INFO: `/v3/projects/e3b524092c484ec3b22d1ce29930fa58` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:26.220035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b524092c484ec3b22d1ce29930fa58)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:26.222418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:26.359740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b524092c484ec3b22d1ce29930fa58', 'request_id': 'req-692eb225-fe3c-4008-b6e5-5be61aa16743'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:26.380674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b524092c484ec3b22d1ce29930fa58', 'request_id': 'req-692eb225-fe3c-4008-b6e5-5be61aa16743'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:26.395821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b524092c484ec3b22d1ce29930fa58', 'request_id': 'req-692eb225-fe3c-4008-b6e5-5be61aa16743'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:26.421857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] The token cache is being invalidate because project e3b524092c484ec3b22d1ce29930fa58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:07:26.422156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:26.422852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692eb225-fe3c-4008-b6e5-5be61aa16743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:07:26.425847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1547/3059] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:26 2022] DELETE /identity/v3/projects/e3b524092c484ec3b22d1ce29930fa58 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:26.433195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:26.434336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:26.434455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:26.522129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:26.528072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:26.654414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1513/3060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:26.662797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:26.663094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:26.663195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:26.705264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:26.706119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:26.718460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1548/3061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:26.719759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:26.732111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fbac6-5bbe-4746-8575-acda4fa5c0ce None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:26.741746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:26.747196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:26.747967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:26.748265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:26.748978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:07:26.749287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:26.750999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:26.792991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:26.799703 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1514/3062] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:07:26.811881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70c80a-26d6-46e6-a97b-985185d13e54 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:26.821650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:26.822586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:26.822586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:26.822904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:26.823469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:26.826027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:26.904405 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1549/3063] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:07:26 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:26.908623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:26.920038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b9870-59e8-4b8d-b172-3f7c5c0a6424 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:27.019715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:27.020365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.020649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.020932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.021633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:27.023708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:27.034042 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:27.061253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:27.069035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1515/3064] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:07:26 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:27.073148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ea08-d2eb-421f-8e93-92a5f8a95c26 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:27.081554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:27.082451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.082740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.083016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.083707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:27.085441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:27.103177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:27.113279 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1550/3065] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:07:27.116003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d435b-f9ae-472a-ac05-cd458d45a7ca admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:27.122758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:27.123404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.123685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.123962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.124630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:27.126428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1d4f2-0e43-4349-8cb2-5ef761741686 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:27.144408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:27.160257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1516/3066] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:27.165039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dfcf-e341-427a-8e6a-9c7725a80412 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:27.172243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:27.173379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.173896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.174700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] PATH_INFO: `/v3/projects/ffd0399886514da993711579e359b8a8/users/a67cebe536d64cca984a9c90d3a59589/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.201323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd0399886514da993711579e359b8a8, user_id=a67cebe536d64cca984a9c90d3a59589, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:27.205456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:27.229909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021202-808e-4737-a9dc-7ddc40eec18a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.230297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021202-808e-4737-a9dc-7ddc40eec18a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.230844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021202-808e-4737-a9dc-7ddc40eec18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.234515 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1551/3067] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:27 2022] PUT /identity/v3/projects/ffd0399886514da993711579e359b8a8/users/a67cebe536d64cca984a9c90d3a59589/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:27.268057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5e021202-808e-4737-a9dc-7ddc40eec18a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:27.272162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e021202-808e-4737-a9dc-7ddc40eec18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:27.470656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1517/3068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:27.530148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:27.532102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:27.580223 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:27.685782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8ef8-f759-4584-87f6-b94325460fe7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:27.692323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:27.695029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.695607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.696148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:27.708464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:27.710538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:27.723362 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1552/3069] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:27.915794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:27.916263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:27.916377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.001414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] MFA Rules not processed for user `9164864381494d9991fd97410bedea72`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:28.003308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:28.182304 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1518/3070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:28.187937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:28.189641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:28.215794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99c9-85d6-42a4-ba5a-b0c872793ae4 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:28.229189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:28.231914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:28.232626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:28.233665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.235356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:28.241262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:28.322879 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1553/3071] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:07:28 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:28.323687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:28.354900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87ebf-dbdf-4753-ba04-434fd16e0fd8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:28.546254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:28.547954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:28.548522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:28.548995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.550080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:28.555473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:28.592416 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:28.610673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:28.617001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1519/3072] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:07:28 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:28.627074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a248b2-34fc-42c4-a621-9642c572e04c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:28.639103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:28.639960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:28.640235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:28.640607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.641840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:28.646593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:28.678059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1554/3073] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:07:28.681842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:28.698970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409d86-ab26-4586-9144-a76828ac19f4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:28.712444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:28.713887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:28.714284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:28.714600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] PATH_INFO: `/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6/users/3cd257c12de5431090ac50cead0d988b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.757170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c0e0fce5fe4b5d86a0f0f2bb7c1fd6, user_id=3cd257c12de5431090ac50cead0d988b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:28.764175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:28.805567 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1520/3074] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:28 2022] PUT /identity/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6/users/3cd257c12de5431090ac50cead0d988b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:28.810346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:28.833844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32c3d-c511-4a4b-bd64-7c424f988ab2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:28.983425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:28.986170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:28.986461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:28.986741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:28.994859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:29.002381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efca2a7-7eeb-4462-91df-4443c7e9a6a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:29.035118 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1555/3075] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:29.043310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:29.065492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2569f-e56c-4b13-8fa0-653b1580bfc5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:29.077497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:29.078253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:29.078544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:29.078864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] PATH_INFO: `/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6/users/3cd257c12de5431090ac50cead0d988b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:29.082866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c0e0fce5fe4b5d86a0f0f2bb7c1fd6, user_id=3cd257c12de5431090ac50cead0d988b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:29.090868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:29.140804 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1521/3076] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:29 2022] PUT /identity/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6/users/3cd257c12de5431090ac50cead0d988b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:38.462874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:38.463483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:38.463483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:38.539329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] MFA Rules not processed for user `7f09255419184d11b8379c6bd0a338b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:38.545772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:38.631986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1556/3077] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:38.636900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:38.640027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:38.756901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb116042-fcdc-455b-bd77-b51563e60d39 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:38.763588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:38.764230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:38.764512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:38.764780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:38.765512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:38.769683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:38.834509 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1522/3078] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:07:38.839513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:38.863508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f26e-87b7-4a01-82b4-4b98777a5147 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:38.894222 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:38.988421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:38.989058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:38.989339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:38.989635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:38.990293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:38.992439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:39.027074 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1557/3079] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:07:38 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:07:39.029316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:39.043229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5139-86b9-497b-93f4-c5f00c9ca3c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:39.055221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:39.055762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:39.056044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:39.056319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:39.056975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:39.059162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:39.086139 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1523/3080] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:39.090846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:39.110782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e0f8-796b-4e98-ab48-9577275d0443 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:39.125874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:39.126586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:39.126867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:39.127147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] PATH_INFO: `/v3/projects/ddfc98737e554a74a138eb2fe8bf5092/users/c8bfed82c804419eaddc0aae23f34b70/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:39.159929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfc98737e554a74a138eb2fe8bf5092, user_id=c8bfed82c804419eaddc0aae23f34b70, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:39.163276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:39.190516 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1558/3081] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:39 2022] PUT /identity/v3/projects/ddfc98737e554a74a138eb2fe8bf5092/users/c8bfed82c804419eaddc0aae23f34b70/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:39.196387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:39.222791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42560d4-2199-41c0-b338-109de7594baf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:39.416291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:39.420686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:39.421363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:39.422012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:39.423898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:39.433196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fdba8-62ef-4413-a853-3e735714dc41 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:39.463373 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1524/3082] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:07:39.468178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:39.491866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bb29c-6bf1-4e81-acd7-c68641e84c8c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:39.519273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:39.520064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:39.520415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:39.520762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] PATH_INFO: `/v3/projects/ddfc98737e554a74a138eb2fe8bf5092/users/c8bfed82c804419eaddc0aae23f34b70/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:39.532553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfc98737e554a74a138eb2fe8bf5092, user_id=c8bfed82c804419eaddc0aae23f34b70, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:39.535508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:39.568583 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1559/3083] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:07:39 2022] PUT /identity/v3/projects/ddfc98737e554a74a138eb2fe8bf5092/users/c8bfed82c804419eaddc0aae23f34b70/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:07:42.410500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f86a8a-9ad2-4f9b-b357-64c9fd4ea3a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:42.411076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f86a8a-9ad2-4f9b-b357-64c9fd4ea3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:42.411076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f86a8a-9ad2-4f9b-b357-64c9fd4ea3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:42.501915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f5f86a8a-9ad2-4f9b-b357-64c9fd4ea3a3 None None] MFA Rules not processed for user `a67cebe536d64cca984a9c90d3a59589`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:42.503641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f5f86a8a-9ad2-4f9b-b357-64c9fd4ea3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:42.556579 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:42.694207 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1525/3084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:43.184706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:43.187025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:43.304923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06687890-a0fb-42d9-a6d4-c63c4b17d26e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:43.332736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:43.334741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:43.335749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:43.336306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:43.379513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:43.382120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:43.429774 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1560/3085] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:43.769199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d81ff-300f-4454-bb6f-671b1aa0fe3b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:43.769820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d81ff-300f-4454-bb6f-671b1aa0fe3b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:43.769820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d81ff-300f-4454-bb6f-671b1aa0fe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:43.825797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4f6d81ff-300f-4454-bb6f-671b1aa0fe3b None None] MFA Rules not processed for user `3cd257c12de5431090ac50cead0d988b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:43.827519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f6d81ff-300f-4454-bb6f-671b1aa0fe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:43.974607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1526/3086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:43.994021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:43.996673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:44.200909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43467-d832-4b62-a1eb-963880c2891c service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:44.216739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:44.219539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:44.221314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:44.225161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:44.240287 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:44.247668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:44.250281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:44.266316 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1561/3087] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:53.965386 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=52 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:54.079279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d117ce-dfce-4d21-ae99-45dddf631334 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:54.080408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d117ce-dfce-4d21-ae99-45dddf631334 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:54.081043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d117ce-dfce-4d21-ae99-45dddf631334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:54.184516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-54d117ce-dfce-4d21-ae99-45dddf631334 None None] MFA Rules not processed for user `c8bfed82c804419eaddc0aae23f34b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:54.186810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-54d117ce-dfce-4d21-ae99-45dddf631334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:54.257920 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:54.442375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1527/3088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:55.019586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:55.054120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabcae-9946-4505-8031-a8a762dd5c5e service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:55.066528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:55.070241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:55.076175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:55.076856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:55.259965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:55.261605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c6d2b-e079-4ec2-98af-db4f6b28607d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:55.288440 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1562/3089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:07:58.834462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:58.835168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:58.835288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:58.883374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] MFA Rules not processed for user `7f09255419184d11b8379c6bd0a338b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:58.888352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:58.911729 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1528/3090] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:59.102225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:59.102853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:59.102853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:59.152304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:07:59.153963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:59.242687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1563/3091] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:07:59.258682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:07:59.260474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:07:59.463823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20996538-b452-4eda-9860-aa6d8f6b37a6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:07:59.481492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:07:59.482048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:07:59.482400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:07:59.482681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:07:59.504838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:07:59.509865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:07:59.534010 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1529/3092] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:03.890364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:03.896028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:04.124864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65724133-05c6-409a-8a1e-a1ff770c0d70 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:04.152616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:04.154515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:04.154826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:04.155108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:04.167023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:04.400246 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:04.413462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:04.414833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509852-a6d1-4521-b023-a75701f2c7cf service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:04.475827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1564/3093] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:08.418624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:08.420927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:08.587180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6334-7581-410f-b20c-ea376534942e service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:08.602672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:08.603583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:08.604029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:08.604512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:08.606812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:08.637493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:08.640237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225897a1-690c-4e78-bf22-b79e70570b42 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:08.657878 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:08.697870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1530/3094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:14.440142 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:15.762695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746116-2c79-4436-af14-f1e9fd28e6f5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:15.763419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746116-2c79-4436-af14-f1e9fd28e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:15.763419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746116-2c79-4436-af14-f1e9fd28e6f5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:15.764719 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1565/3095] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:08:15.776628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:15.777196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:15.777196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:15.835773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:15.837010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:16.003356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1531/3096] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:16.040556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746116-2c79-4436-af14-f1e9fd28e6f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:16.061549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746116-2c79-4436-af14-f1e9fd28e6f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:16.071748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:16.072420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:16.081012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:16.082334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:16.102316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:16.103836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0a85-f3dd-49d3-bcd8-7322088ed327 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:16.138822 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1566/3097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:18.029549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:18.053452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbde87-b368-47dc-b742-8e7a1df54f72 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:18.062896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:18.063724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:18.064164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:18.064589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:18.066655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:18.181090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:18.190393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:18.209516 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1532/3098] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:20.612330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:20.613271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:20.613815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:20.650305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] MFA Rules not processed for user `545456a4a4e540be9138c47b0df77bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:20.652130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:20.679272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1567/3099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:24.087768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:24.090315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:24.113367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b331d-6d87-4e6c-ac3d-c5b46824ef81 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:24.121432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:24.122370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:24.122860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:24.123303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:24.215671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:24.218792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:24.234159 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1533/3100] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:24.346398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:24.347861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:24.504356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f7a7-ce9b-4b47-b1a4-7ca9b407d29e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:24.512187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:24.513337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:24.513799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:24.514293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] PATH_INFO: `/v3/users/1f85ae026362410fb573c81bef57159e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:24.515934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f85ae026362410fb573c81bef57159e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:24.518663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:24.619274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f85ae026362410fb573c81bef57159e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:24.629718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f85ae026362410fb573c81bef57159e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:24.654846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f85ae026362410fb573c81bef57159e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:24.655694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f85ae026362410fb573c81bef57159e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:24.656310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d703c6b-02c5-43c1-a33d-c55b1c4ae3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f85ae026362410fb573c81bef57159e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:24.680377 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1568/3101] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:08:24 2022] DELETE /identity/v3/users/1f85ae026362410fb573c81bef57159e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:25.561126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:25.602809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1bb8-6058-4fd3-992b-ee42f957f5ee service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:25.743574 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:25.784751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:25.785635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:25.785984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:25.786253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] PATH_INFO: `/v3/projects/afce265709264879a2e1cafb56ea22f7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:25.787870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afce265709264879a2e1cafb56ea22f7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:25.789939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:25.867344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afce265709264879a2e1cafb56ea22f7', 'request_id': 'req-0863c6a2-6c30-4efc-9b61-a095934a043d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:25.883058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afce265709264879a2e1cafb56ea22f7', 'request_id': 'req-0863c6a2-6c30-4efc-9b61-a095934a043d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:25.913166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afce265709264879a2e1cafb56ea22f7', 'request_id': 'req-0863c6a2-6c30-4efc-9b61-a095934a043d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:25.952306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] The token cache is being invalidate because project afce265709264879a2e1cafb56ea22f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:08:25.952989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:25.953991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0863c6a2-6c30-4efc-9b61-a095934a043d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:25.956359 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1534/3102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:08:25 2022] DELETE /identity/v3/projects/afce265709264879a2e1cafb56ea22f7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:25.961668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:25.962266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:25.962266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.013805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:26.020170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:26.159476 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:26.185936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.186367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.186752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.195065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1569/3103] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:26.230207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:26.231974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:26.252197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1535/3104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:26.253392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.265224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4fc9f-45f2-45d4-8175-ca0bb4c54be2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.282541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.284063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.284591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.285086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.286254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:08:26.287528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.292841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.332285 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1570/3105] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:08:26.336683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.351050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8787de-bacd-4fb9-9e0d-65995213f74d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.366707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.367341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.367765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.369633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.370674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.372939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.440084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1536/3106] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:08:26 2022] POST /identity/v3/projects => generated 395 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:26.444488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.461013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3ccdb-f42b-4e07-90c9-69058906b528 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.603153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.603470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.603673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.604545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.605803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.608734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.652113 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1571/3107] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:08:26 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:26.656110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.676169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ead0-9101-472e-ad1c-d1bacb480e91 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.684439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.694350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.694635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.694920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.695597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.698110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.709346 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1537/3108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:08:26.713556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.725606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16220c-f411-4eb7-a8fb-75b03f35bf83 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.731797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.732535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.732822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.733099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.733797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.735439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2955f8-549e-4081-a871-e19eb836c925 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.781389 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1572/3109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:08:26.785811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:26.802560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b983-4c99-4383-b765-71b30a18b12d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:26.815347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:26.816051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.816333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.816613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] PATH_INFO: `/v3/projects/cf45958b75704ca785e000efe1060c47/users/c3512a52716f45cd9998337fb133c84f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.853315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf45958b75704ca785e000efe1060c47, user_id=c3512a52716f45cd9998337fb133c84f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:26.857285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:26.883075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1538/3110] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:08:26 2022] PUT /identity/v3/projects/cf45958b75704ca785e000efe1060c47/users/c3512a52716f45cd9998337fb133c84f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:26.895138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:26.895509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:26.895794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:26.924357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:26.926251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:27.108868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1573/3111] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:27.176429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:27.180017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:27.380050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6ffd-d1be-4988-a258-09b731226a96 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:27.390893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:27.391543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:27.391826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:27.392158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:27.419170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:27.420664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:27.449067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1539/3112] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:28.268885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:28.270846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:28.321255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbb99-8621-42b3-af1a-d6b6f0ef1534 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:28.348067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:28.350606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:28.350606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:28.350606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] PATH_INFO: `/v3/users/53d16cedecbe4634bf384effd09ca0a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:28.361300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d16cedecbe4634bf384effd09ca0a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:28.364222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:28.472925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d16cedecbe4634bf384effd09ca0a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:28.485495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d16cedecbe4634bf384effd09ca0a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:28.493316 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:28.523441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d16cedecbe4634bf384effd09ca0a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:28.524772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d16cedecbe4634bf384effd09ca0a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:28.527176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc818166-6d55-4d47-87b7-e574180e9d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d16cedecbe4634bf384effd09ca0a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:28.551206 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1574/3113] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:08:28 2022] DELETE /identity/v3/users/53d16cedecbe4634bf384effd09ca0a9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:29.734843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:29.781671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc038e6-57be-47cb-b250-409ded61df60 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:29.830871 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:30.119976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:30.121717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:30.122332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:30.124808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] PATH_INFO: `/v3/projects/740928060bf443508f8165c0dfa50514` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:30.130876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740928060bf443508f8165c0dfa50514)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:30.142012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:30.304648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740928060bf443508f8165c0dfa50514', 'request_id': 'req-5a84e922-0454-4393-97af-b98654b7d6a2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:30.321883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740928060bf443508f8165c0dfa50514', 'request_id': 'req-5a84e922-0454-4393-97af-b98654b7d6a2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:30.352547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740928060bf443508f8165c0dfa50514', 'request_id': 'req-5a84e922-0454-4393-97af-b98654b7d6a2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:30.396917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] The token cache is being invalidate because project 740928060bf443508f8165c0dfa50514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:08:30.399052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:30.400406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a84e922-0454-4393-97af-b98654b7d6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:30.416206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412df5e-a6ca-4659-8da0-4ab12a16bfe6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:30.417725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412df5e-a6ca-4659-8da0-4ab12a16bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:30.418443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412df5e-a6ca-4659-8da0-4ab12a16bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:30.424660 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1540/3114] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:08:29 2022] DELETE /identity/v3/projects/740928060bf443508f8165c0dfa50514 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:30.489956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c412df5e-a6ca-4659-8da0-4ab12a16bfe6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:30.492148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c412df5e-a6ca-4659-8da0-4ab12a16bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:30.602537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:30.602972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:30.603421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:30.659247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] MFA Rules not processed for user `9164864381494d9991fd97410bedea72`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:30.661526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:30.826193 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1575/3115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:30.837369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:30.837918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:30.839542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:30.875117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:30.877791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:30.915591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1541/3116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:30.926972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1576/3117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:30.928186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:30.962113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef208-deb0-45e0-a1c4-c32c862887e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:30.974243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:30.975628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:30.976317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:30.977868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:30.980199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:08:30.980996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:30.985243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.029204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1542/3118] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:08:31.033386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:31.077805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882847-b04d-4eaf-99fd-99a56fe64a2f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:31.111728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:31.112622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.114107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.116336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.118910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:31.122566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.249275 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1577/3119] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:08:31 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:31.252950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:31.286961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96385-f3e1-4e5e-951e-1a099037fd8e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:31.443467 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:31.559759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:31.560825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.565430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.565950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.567210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:31.571013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.691714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:31.693531 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1543/3120] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:08:31 2022] POST /identity/v3/users => generated 292 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:31.710804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414588-a1df-4693-a6bf-b1895465aa5d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:31.748078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:31.750289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.750832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.751109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.751796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:31.754375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.772184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1578/3121] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:08:31.773452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:31.786569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b757775-7230-449e-845e-41779bb941f6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:31.792484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:31.793172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.793508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.794011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.794985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:31.796776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b0ec-76c2-49df-b337-53cc0b568668 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.816157 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1544/3122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:08:31.817193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:31.828904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229730-5348-4cc1-a711-07472a32b328 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:31.851053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:31.852425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.853132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.854079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] PATH_INFO: `/v3/projects/e310970d7ec54c99a3d719824c6be1ee/users/f3931162a615421f8843396650368870/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.877445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310970d7ec54c99a3d719824c6be1ee, user_id=f3931162a615421f8843396650368870, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:31.884051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:31.909590 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1579/3123] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:08:31 2022] PUT /identity/v3/projects/e310970d7ec54c99a3d719824c6be1ee/users/f3931162a615421f8843396650368870/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:08:31.912312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b58ea-fc26-4b20-b349-a775fbb1900d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:31.913038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b58ea-fc26-4b20-b349-a775fbb1900d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:31.914301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b58ea-fc26-4b20-b349-a775fbb1900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:31.950561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-370b58ea-fc26-4b20-b349-a775fbb1900d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:31.957556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-370b58ea-fc26-4b20-b349-a775fbb1900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:32.141460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1545/3124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:32.190400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:32.192462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:32.344333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184967c9-7ce9-47f8-8023-66e692ea2300 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:32.358676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:32.360166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:32.361205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:32.361614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:32.386755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:32.388359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:32.411003 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1580/3125] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:36.743222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:36.743819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:36.743819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:36.766044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:36.768520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:36.849729 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:36.901298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:36.904121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:36.937948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24909724-eeff-4ab3-b7e4-eaf251b260fd service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:36.955380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:36.956054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:36.956339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:36.956872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] PATH_INFO: `/v3/users/a67cebe536d64cca984a9c90d3a59589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:36.958491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67cebe536d64cca984a9c90d3a59589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:36.967185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:37.074320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67cebe536d64cca984a9c90d3a59589'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:37.111424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67cebe536d64cca984a9c90d3a59589'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:37.174359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67cebe536d64cca984a9c90d3a59589'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:37.181204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67cebe536d64cca984a9c90d3a59589'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:37.184896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67cebe536d64cca984a9c90d3a59589'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:37.207094 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1546/3126] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:37.226622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:37.228125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:37.247641 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1581/3127] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:08:36 2022] DELETE /identity/v3/users/a67cebe536d64cca984a9c90d3a59589 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:37.390717 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:37.563183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5251eea-34eb-4390-bd81-86f19c6b37bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:37.725436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:37.726163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:37.726575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:37.727442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:37.846470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:37.850281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:37.883226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:37.885900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7dd39-c0ce-4a49-8908-7e2bad03e3f8 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:37.898614 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1547/3128] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:08:38.238600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e6dd8-790a-4180-be30-3b9bb7e77b20 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:38.265895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:38.266643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:38.266931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:38.267209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] PATH_INFO: `/v3/projects/ffd0399886514da993711579e359b8a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:38.286233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd0399886514da993711579e359b8a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:38.291754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:38.479332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd0399886514da993711579e359b8a8', 'request_id': 'req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:38.506383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd0399886514da993711579e359b8a8', 'request_id': 'req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:38.524263 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:38.531739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd0399886514da993711579e359b8a8', 'request_id': 'req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:38.570532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] The token cache is being invalidate because project ffd0399886514da993711579e359b8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:08:38.570807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:38.574495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da1cf04c-0c03-4370-83b2-e3ecb1632d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:08:38.586165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:38.586537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:38.586731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:38.593384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1582/3129] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:08:37 2022] DELETE /identity/v3/projects/ffd0399886514da993711579e359b8a8 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:08:38.703305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:38.706940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:39.004848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.005395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.005395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.013886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1548/3130] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:39.042484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:39.045857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:39.071240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.078676 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:39.091309 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1583/3131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:08:39.093347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d93748-357d-4844-8a70-3efd59d9f945 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.101395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.102058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.102340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.102774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.103840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:08:39.104333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:39.131555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:39.173984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.183590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1549/3132] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:08:39.207553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653ed80-296a-455b-a9ee-fa2a7d21c80b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.223891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.226070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.226544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.226979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.227844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:39.237234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:39.315464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.326239 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1584/3133] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:08:39 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:39.330357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71da6-e8f3-4b51-80e7-97e32cc5d83c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.576025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.576660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.576938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.577211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.577877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:39.593559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:39.661698 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1550/3134] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:08:39 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:08:39.662503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.691859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a128c1-64f1-4079-b64e-db692433f7aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.698866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.699509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.699819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.700061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.701604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:39.718657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:39.770697 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1585/3135] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:08:39.773267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.819456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b825-1d13-46e1-baf9-7d4a6c3d6b54 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.847044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.850270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.850957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.857253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:39.858602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:39.871514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85c95-5ece-4049-b02c-0b6490583bdc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:39.932433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1551/3136] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:08:39.934210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:39.962113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef177c7b-976b-46cf-9ce5-8eed43d008c8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:39.977693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:39.979710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:39.980115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:39.980399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] PATH_INFO: `/v3/projects/fd330b26476d45a49805765808323420/users/7f9c70d4db7246bf97a29ec68f86c92a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:40.069500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd330b26476d45a49805765808323420, user_id=7f9c70d4db7246bf97a29ec68f86c92a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:40.079477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:40.152872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2ab14-49b2-46aa-bf07-8772ec17d78a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:40.153707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2ab14-49b2-46aa-bf07-8772ec17d78a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:40.153707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2ab14-49b2-46aa-bf07-8772ec17d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:40.154227 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1586/3137] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:08:39 2022] PUT /identity/v3/projects/fd330b26476d45a49805765808323420/users/7f9c70d4db7246bf97a29ec68f86c92a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:08:40.246704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-52b2ab14-49b2-46aa-bf07-8772ec17d78a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:40.248081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-52b2ab14-49b2-46aa-bf07-8772ec17d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:40.431315 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1552/3138] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:40.444938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:40.450187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:40.777808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49f916-a379-4298-b29d-7c4c6435cbec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:40.796562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:40.797721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:40.797966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:40.799514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:40.829936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:40.834098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66905537-b265-46fb-b233-c1bbf0cc24f9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:40.890430 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1587/3139] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:49.102088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:49.102620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:49.102620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:49.138602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] MFA Rules not processed for user `fe77600029ff40f8b738c097bf184495`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:49.139857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:49.314726 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1553/3140] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:50.860679 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:54.977061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049343-7f7c-438f-bdad-4a3276d61fed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:54.978257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049343-7f7c-438f-bdad-4a3276d61fed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:54.978257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049343-7f7c-438f-bdad-4a3276d61fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:55.072545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf049343-7f7c-438f-bdad-4a3276d61fed None None] MFA Rules not processed for user `7f9c70d4db7246bf97a29ec68f86c92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:55.073861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf049343-7f7c-438f-bdad-4a3276d61fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:55.211578 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1588/3141] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:55.237462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:55.237462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:55.259669 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:55.422336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b917-2dfb-401c-b283-aa670b701a2b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:55.455281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:55.456362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:55.456821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:55.457260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:55.474213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:55.476117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460fe2f-b0b6-4873-b0d9-2aa973dfdce0 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:55.514844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1554/3142] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:55.643023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:55.643339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:55.643576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:55.706777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] MFA Rules not processed for user `c3512a52716f45cd9998337fb133c84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:55.708355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:55.906018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df33d-642c-431f-aa96-78e42b80b64d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:55.906301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df33d-642c-431f-aa96-78e42b80b64d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:55.906763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df33d-642c-431f-aa96-78e42b80b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:55.907006 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1589/3143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:55.958212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-657df33d-642c-431f-aa96-78e42b80b64d None None] MFA Rules not processed for user `c3512a52716f45cd9998337fb133c84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:55.959502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-657df33d-642c-431f-aa96-78e42b80b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:55.983710 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1555/3144] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:08:56.401175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:56.404005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:56.437683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a94f-0cfb-49c4-a968-d1d361770af7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:08:56.449567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:08:56.450736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:56.451748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:56.452255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:56.484799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:08:56.486475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:08:56.512380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1590/3145] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:08:57.799979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44488-213e-44ed-b2b9-683ea3b8b1cd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:08:57.800664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44488-213e-44ed-b2b9-683ea3b8b1cd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:08:57.800664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44488-213e-44ed-b2b9-683ea3b8b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:08:57.850499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-03b44488-213e-44ed-b2b9-683ea3b8b1cd None None] MFA Rules not processed for user `7f9c70d4db7246bf97a29ec68f86c92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:08:57.854669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-03b44488-213e-44ed-b2b9-683ea3b8b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:08:57.878882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1556/3146] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:08:59.863840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:08:59.865303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:00.176671 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:00.256934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe972c-fce2-4a61-a563-8f514e3ee7b2 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:00.272129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:00.274203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:00.276331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:00.277772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:00.279898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:00.320625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:00.322968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae2c6-a455-46ee-8855-f8f3319bd474 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:00.363367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1591/3147] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:02.213157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:02.214086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:02.214329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:02.314606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] MFA Rules not processed for user `f3931162a615421f8843396650368870`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:02.323520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:02.548130 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1557/3148] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:02.560586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:02.561162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:02.561162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:02.621070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] MFA Rules not processed for user `f3931162a615421f8843396650368870`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:02.624632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:02.652866 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1592/3149] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:02.694073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:02.786632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98dbb-c112-4d82-ae1d-421df0ca6768 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:02.802297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:02.804665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:02.804953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:02.805272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:02.833657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:02.839460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:02.897013 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1558/3150] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:05.509232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:05.511206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:05.592496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef50d9-2465-4e93-a3bf-b520bcc00859 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:05.600957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:05.601621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:05.601907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:05.602184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:05.608545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:05.647742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:05.653492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8481-6949-40ff-a609-255cf244dea1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:05.677096 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1593/3151] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:12.867523 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=79 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:15.670089 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=29 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:32.758944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:32.778891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da19-ffd9-432e-a727-c108c6a192ba service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:32.786308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:32.787322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:32.787807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:32.788310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:32.790819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:32.957838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:32.959978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:32.973323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1559/3152] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:33.663593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:33.665938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:33.666721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:33.706337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] MFA Rules not processed for user `7f9c70d4db7246bf97a29ec68f86c92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:33.709317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:33.733891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1594/3153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:34.379803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:34.382133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:34.400881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba5cd-ac12-49b8-a003-7828ea7a39dd service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:34.407887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:34.408837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:34.409279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:34.409800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:34.420094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:34.447412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:34.449345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:34.465833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1560/3154] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:09:35.393179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:35.407414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7eec9-49b1-4a6e-bc7a-666f40758dff None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:35.421380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:35.422478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:35.422937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:35.423424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:35.425588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:35.462530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:35.464229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:35.479815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1595/3155] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:35.525810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:35.541817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86dbb-ae4a-4582-b92b-584e19524048 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:35.553667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:35.554708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:35.555208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:35.556906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:35.559358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:35.583875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:35.589962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:35.612050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1561/3156] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:36.181218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:36.215851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ad9b-c616-4b7a-b04d-41329221f5ee service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:36.233455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:36.236643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:36.237739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:36.238725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:36.247195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:36.280091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:36.286549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:36.307665 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1596/3157] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:36.375575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:36.377537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:36.474105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6dd7-4964-40b1-a14a-3b25407581cb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:36.483926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:36.484579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:36.484853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:36.485334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] PATH_INFO: `/v3/users/c3512a52716f45cd9998337fb133c84f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:36.487214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3512a52716f45cd9998337fb133c84f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:36.489387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:36.586522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3512a52716f45cd9998337fb133c84f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:36.588518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3512a52716f45cd9998337fb133c84f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:36.597877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3512a52716f45cd9998337fb133c84f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:36.612377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3512a52716f45cd9998337fb133c84f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:36.613437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-249713a4-bd29-4c73-a4d7-3271d6698424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3512a52716f45cd9998337fb133c84f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:36.646072 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1562/3158] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:09:36 2022] DELETE /identity/v3/users/c3512a52716f45cd9998337fb133c84f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:09:36.899180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:36.918608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68e4bd-71f0-4b0f-a784-b8105260f93d service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.020539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.021321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.022049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.022623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] PATH_INFO: `/v3/projects/cf45958b75704ca785e000efe1060c47` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.025149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf45958b75704ca785e000efe1060c47)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.027518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.087774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf45958b75704ca785e000efe1060c47', 'request_id': 'req-d4c9a331-f010-4c57-96ba-7ed862a8a08c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:37.094579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf45958b75704ca785e000efe1060c47', 'request_id': 'req-d4c9a331-f010-4c57-96ba-7ed862a8a08c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:37.100745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf45958b75704ca785e000efe1060c47', 'request_id': 'req-d4c9a331-f010-4c57-96ba-7ed862a8a08c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:37.114312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] The token cache is being invalidate because project cf45958b75704ca785e000efe1060c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:09:37.114613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:37.115257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d4c9a331-f010-4c57-96ba-7ed862a8a08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:09:37.116756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1597/3159] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:09:36 2022] DELETE /identity/v3/projects/cf45958b75704ca785e000efe1060c47 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:09:37.122588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.122887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.123458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.144315 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:37.186788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:37.187893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:37.260046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1563/3160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:37.269081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.269510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.269974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.294476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:37.295759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:37.306905 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1598/3161] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:37.311051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.321994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d214-2020-49d2-abb8-71b45e5502c5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.327058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.328131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.328595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.329115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.330323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:09:37.331033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.334158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.361675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1564/3162] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:09:37.367429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.385725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df20539-5b5d-463b-b8e4-07c5add795db None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.392034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.393176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.393914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.394323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.395638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.397819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.439722 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1599/3163] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:09:37 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:09:37.443997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.460035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd74f1-fdd3-4174-916e-773cf48624d7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.540723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.541646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.542170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.542641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.543933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.545446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.582457 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1565/3164] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:09:37 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:09:37.588116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.610355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23460-ac68-4b9a-b026-07ce332b2d65 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.616046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.617034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.617340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.618103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.618937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.620747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.650339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1600/3165] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:09:37.654655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.669662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f9c1-c49f-4a32-9c6e-174c4bab3128 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.676985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.677978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.678505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.679184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.684441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.699980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7824-a34c-4502-9191-f2be83141390 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.717048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1566/3166] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:09:37.721677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.736215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec8dd-cab0-48d2-ba12-f20ba90da56c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:37.743970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:37.744980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.745527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.745660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] PATH_INFO: `/v3/projects/3f5c70f93bfe400eb0b65480498af9e8/users/552a5b16cc6644c7b0249f6dee152d15/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.748981 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:37.770639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5c70f93bfe400eb0b65480498af9e8, user_id=552a5b16cc6644c7b0249f6dee152d15, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:37.775429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:37.794315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1601/3167] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:09:37 2022] PUT /identity/v3/projects/3f5c70f93bfe400eb0b65480498af9e8/users/552a5b16cc6644c7b0249f6dee152d15/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:09:37.800379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c781a4-8709-47fe-b8ac-9ef9258626d2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:37.800740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c781a4-8709-47fe-b8ac-9ef9258626d2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:37.800947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c781a4-8709-47fe-b8ac-9ef9258626d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:37.826520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-16c781a4-8709-47fe-b8ac-9ef9258626d2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:37.827803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16c781a4-8709-47fe-b8ac-9ef9258626d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:37.894904 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:37.910812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1567/3168] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:37.923374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:37.925514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:37.997938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7ba3-6ae1-49e3-8f65-85c3134b3523 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:38.001649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:38.002276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:38.002552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:38.002823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:38.012985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:38.014533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308142c0-8b35-4dbb-82a3-5d7e9b988a4d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:38.026630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1602/3169] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:44.738691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:44.740736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:44.741311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:44.831840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:44.833459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:44.985646 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1568/3170] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:45.000573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:45.001775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:45.002460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:45.040439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:09:45.044258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:45.058874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1603/3171] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:09:45.431149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:45.433437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:45.636529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367d1e7-b1d4-4564-ae79-c2db24477afd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:45.661486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:45.666494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:45.666865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:45.667145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:45.696658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:45.698622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:45.732715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1569/3172] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:46.260268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:46.261877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:46.408773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a109ea1-cbe2-4010-bb7e-dc32f19a0bdd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:46.418109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:46.418921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:46.419298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:46.419665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:46.422703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:46.437073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:46.438962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:46.452361 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1604/3173] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:09:50.559990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:50.561717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:50.590351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295ed2-51bc-48d5-b65e-2a9280e317e5 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:50.597539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:50.598525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:50.600173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:50.600631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:50.605256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:50.643511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:50.645754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170b72-6850-40db-a5dc-5690c8341d3a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:50.679807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1570/3174] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:09:50.736778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:09:50.753535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3723c-4115-49be-a49d-08c8f803ce3a service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:09:50.760868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:09:50.762145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:09:50.762643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:09:50.763155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:09:50.768586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:09:50.800841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:09:50.803082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c7404-d372-4577-9027-25d6485d5d6c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:09:50.828041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1605/3175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:00.664411 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=74 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:00.812658 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:02.678940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3dca-2c5d-4e7e-94fa-eaaae11a16bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:02.679567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3dca-2c5d-4e7e-94fa-eaaae11a16bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:02.679567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3dca-2c5d-4e7e-94fa-eaaae11a16bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:02.699094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-344c3dca-2c5d-4e7e-94fa-eaaae11a16bd None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:02.700303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-344c3dca-2c5d-4e7e-94fa-eaaae11a16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:02.710699 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1571/3176] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:10:02.764054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a7cf-84cd-4a56-a749-33edd65a2bfd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:02.764592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a7cf-84cd-4a56-a749-33edd65a2bfd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:02.764592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a7cf-84cd-4a56-a749-33edd65a2bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:02.784941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7319a7cf-84cd-4a56-a749-33edd65a2bfd None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:02.786207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7319a7cf-84cd-4a56-a749-33edd65a2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:02.794667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1606/3177] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:02.820593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4812-6d8d-4c32-8202-f3367035249a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:02.820873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4812-6d8d-4c32-8202-f3367035249a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:02.821145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df4812-6d8d-4c32-8202-f3367035249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:02.842753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-43df4812-6d8d-4c32-8202-f3367035249a None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:02.843897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-43df4812-6d8d-4c32-8202-f3367035249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:02.852234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1572/3178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:02.879146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:02.879530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:02.879812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:02.902949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:02.904179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:02.911777 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1607/3179] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:02.941056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:02.941589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:02.941872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:02.963283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] MFA Rules not processed for user `552a5b16cc6644c7b0249f6dee152d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:02.964511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:02.973341 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1573/3180] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:08.488253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:08.503627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201072e1-dea6-4b7b-ae17-48684a2f36df None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:08.511856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:08.512795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:08.513239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:08.513748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:08.516137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:08.639463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:08.641103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557ae5-3e5a-4859-bc18-8259a0a4255a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:08.687627 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1608/3181] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:12.957085 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:14.000377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:14.012733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fc7aa-645a-47d9-8bb4-2da9b95c812b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:14.018906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:14.019584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:14.020157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:14.020449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] PATH_INFO: `/v3/users/552a5b16cc6644c7b0249f6dee152d15` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:14.022390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=552a5b16cc6644c7b0249f6dee152d15)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:14.024500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:14.145161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552a5b16cc6644c7b0249f6dee152d15'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.147612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552a5b16cc6644c7b0249f6dee152d15'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.167990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552a5b16cc6644c7b0249f6dee152d15'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.192687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552a5b16cc6644c7b0249f6dee152d15'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.194821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552a5b16cc6644c7b0249f6dee152d15'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.217807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1574/3182] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:10:13 2022] DELETE /identity/v3/users/552a5b16cc6644c7b0249f6dee152d15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:10:14.540992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8aa4-fc9d-4cde-9fb9-18b993df39c4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:14.540992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8aa4-fc9d-4cde-9fb9-18b993df39c4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:14.540992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8aa4-fc9d-4cde-9fb9-18b993df39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:14.560770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-067e8aa4-fc9d-4cde-9fb9-18b993df39c4 None None] MFA Rules not processed for user `f3931162a615421f8843396650368870`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:14.562232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-067e8aa4-fc9d-4cde-9fb9-18b993df39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:14.653007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:14.654432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:14.664193 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1609/3183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:14.827537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2d38-631d-4932-8f80-16d4939f9c4b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:14.835044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:14.836024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:14.836760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:14.837204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] PATH_INFO: `/v3/projects/3f5c70f93bfe400eb0b65480498af9e8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:14.838772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5c70f93bfe400eb0b65480498af9e8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:14.841083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:14.899452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5c70f93bfe400eb0b65480498af9e8', 'request_id': 'req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.907368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5c70f93bfe400eb0b65480498af9e8', 'request_id': 'req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.919233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5c70f93bfe400eb0b65480498af9e8', 'request_id': 'req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.937054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] The token cache is being invalidate because project 3f5c70f93bfe400eb0b65480498af9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:10:14.938591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.939481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0acae0bc-a4ec-4c3a-b648-61900b3c11c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:14.941827 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1575/3184] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:10:14 2022] DELETE /identity/v3/projects/3f5c70f93bfe400eb0b65480498af9e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:10:14.950077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:14.950643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:14.952266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:14.978132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:14.979860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:15.061004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1610/3185] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:15.069597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.070588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.071058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.079656 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:15.095480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:15.097145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:15.106689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1576/3186] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:15.110551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.129643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf89e8-937c-46e8-a678-a4a1a292b783 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.137069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.137947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.138426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.138866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.139840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:10:15.140317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.142958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.165311 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1611/3187] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:10:15.169671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.185154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4688-8c5f-4d95-8db8-d0b5af4ff2f1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.197861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.198740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.199022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.199292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.199948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.201914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.241256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1577/3188] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:10:15 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:10:15.246132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.259704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb5fba-4bd2-4abd-bade-1414a55a83ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.274788 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:15.342083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.342624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.400110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.400110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.400110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.400110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.404948 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1612/3189] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:10:15 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:10:15.407546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.430974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79578-cf5e-4800-8b5f-f6f0b33f6efa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.437636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.438400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.438998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.439365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.440574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.442794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.463641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.464538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1578/3190] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:10:15.481967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b939-dab7-4609-8179-b8b72b6ab98d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.496140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.496761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.497045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.497320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.498026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.499741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695420da-b93a-4fa4-a984-025413584ec4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.542289 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1613/3191] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:10:15.547024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.561083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834d231-8dab-4a2f-8605-39df4b27c645 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:15.589446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:15.590336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.590625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.590902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] PATH_INFO: `/v3/projects/82fcf2dd9b2c41f5a87eda0402682069/users/bb85bd8db516469abb729c1fdc0a1ba1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.617310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fcf2dd9b2c41f5a87eda0402682069, user_id=bb85bd8db516469abb729c1fdc0a1ba1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:15.621116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:15.644053 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1579/3192] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:10:15 2022] PUT /identity/v3/projects/82fcf2dd9b2c41f5a87eda0402682069/users/bb85bd8db516469abb729c1fdc0a1ba1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:10:15.650756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:15.651478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:15.651981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:15.692953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:15.695084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:15.811897 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1614/3193] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:15.825861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:15.827799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:16.013267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368391ce-7db1-4510-b739-5e85c93c9ff5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:16.026872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:16.027621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:16.028157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:16.028378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:16.050126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:16.053632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d8398-11bc-46bc-bce2-c7f3e7908a03 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:16.075602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1580/3194] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:10:19.064079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:19.065684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:19.204716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543abd5b-b088-4243-a4b4-42f947301a97 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:19.213247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98838786-375f-4374-a6ea-df058f02257b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:19.213856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838786-375f-4374-a6ea-df058f02257b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:19.214140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838786-375f-4374-a6ea-df058f02257b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:19.214414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838786-375f-4374-a6ea-df058f02257b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:19.216363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98838786-375f-4374-a6ea-df058f02257b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:19.315041 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:19.423486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98838786-375f-4374-a6ea-df058f02257b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:19.430238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98838786-375f-4374-a6ea-df058f02257b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:19.499517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1615/3195] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:26.066951 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:28.471582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:28.472220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:28.472220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:28.516110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] MFA Rules not processed for user `7f09255419184d11b8379c6bd0a338b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:28.517476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:28.647982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1581/3196] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:29.463453 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=14 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:32.649804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921853-8ea0-4dd2-b7ba-58a72aab04d5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:32.650352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921853-8ea0-4dd2-b7ba-58a72aab04d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:32.650631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921853-8ea0-4dd2-b7ba-58a72aab04d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:32.692418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66921853-8ea0-4dd2-b7ba-58a72aab04d5 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:32.694045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66921853-8ea0-4dd2-b7ba-58a72aab04d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:32.829826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1616/3197] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:32.927076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:32.928724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:33.103199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7690-7c2a-4011-bde5-4661d2b5237a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:33.116409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:33.117810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:33.118256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:33.118792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:33.139513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:33.141745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:33.197183 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1582/3198] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:10:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:35.363301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:35.366150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:35.366580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:35.464491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] MFA Rules not processed for user `bb85bd8db516469abb729c1fdc0a1ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:35.465679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:35.679166 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1617/3199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:35.695803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:35.697232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:35.738969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b405-bae7-40a7-9323-0c2da8c6072e service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:35.750238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:35.750905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:35.753049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:35.754703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:35.780974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:35.783752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:35.822690 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1583/3200] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:35.916498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:35.918638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:35.944575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb9ed6-83ca-4aea-9fdf-8d991898647c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:35.954090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:35.963241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:35.963846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:35.965354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] PATH_INFO: `/v3/users/7f9c70d4db7246bf97a29ec68f86c92a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:35.967810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9c70d4db7246bf97a29ec68f86c92a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:35.972934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:36.090741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9c70d4db7246bf97a29ec68f86c92a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:36.107613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9c70d4db7246bf97a29ec68f86c92a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:36.138830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9c70d4db7246bf97a29ec68f86c92a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:36.139748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9c70d4db7246bf97a29ec68f86c92a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:36.141820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab6bdbeb-0eac-4862-97bf-7f6895f5f109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9c70d4db7246bf97a29ec68f86c92a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:36.165936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1618/3201] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:10:35 2022] DELETE /identity/v3/users/7f9c70d4db7246bf97a29ec68f86c92a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:10:37.423250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:37.440440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e66c-5133-44d8-9c0d-136d5472671e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:37.687369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:37.709498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:37.709856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:37.710139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] PATH_INFO: `/v3/projects/fd330b26476d45a49805765808323420` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:37.713839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd330b26476d45a49805765808323420)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:37.717728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:37.802709 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:37.866567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd330b26476d45a49805765808323420', 'request_id': 'req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:37.881719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd330b26476d45a49805765808323420', 'request_id': 'req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:37.900246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd330b26476d45a49805765808323420', 'request_id': 'req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:37.941761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] The token cache is being invalidate because project fd330b26476d45a49805765808323420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:10:37.942431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:37.944428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc8c2ec9-0075-48b9-a0c4-40db1a17fa1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:10:37.952656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1584/3202] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:10:37 2022] DELETE /identity/v3/projects/fd330b26476d45a49805765808323420 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:10:37.958183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:37.959539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:37.960169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:37.996469 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:38.013920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:38.015170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:38.268940 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1619/3203] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:38.278284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:38.278966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:38.279426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:38.331449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:38.335806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:38.363755 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1585/3204] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:38.368069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.398253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123101c-1e20-411c-8d97-bc032428c97b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:38.430746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:38.431403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:38.431693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:38.431970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:38.432644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:10:38.433157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:38.435018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:38.465061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1620/3205] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:10:38.470088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.482227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbba5-9b76-424c-ae17-fac3630f39bb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:38.502304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:38.503200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:38.503659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:38.504103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:38.504901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:38.507663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:38.591786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1586/3206] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:10:38 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:10:38.596563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.627267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70d4a-efd7-42ee-a4b1-59493b058ab4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:38.720513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:38.721457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:38.722085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:38.722513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:38.723511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:38.726154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:38.762311 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1621/3207] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:10:38 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:10:38.767347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.834612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.841762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:38.846827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaba7a-2563-4840-9771-cdbeca17ca3f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:38.885031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:38.886380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:38.887028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:38.894094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:38.896043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:38.899295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:38.940454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1587/3208] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:10:38.945549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:38.982807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4c42-186e-42b3-94fd-9a6cda8b12ef admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:39.021502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:39.022475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.022863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.023244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.024007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:39.027904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:39.072682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1588/3209] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:10:39.076923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:39.109668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df75e-fd67-4ef8-b8c2-23cdd3db853a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:39.111946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98517ec-8eb8-4862-82c0-2a5c861483c3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:39.116649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:39.117589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.118017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.118614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] PATH_INFO: `/v3/projects/2767668c8f624a71b787a1334c9091da/users/4a8f4f941c504950b4f8217de48f3f58/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.138645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:39.139465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.139849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.140484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.150118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:39.158959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2767668c8f624a71b787a1334c9091da, user_id=4a8f4f941c504950b4f8217de48f3f58, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:39.162697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f12d0-fa99-4930-9100-5c30167f9d5a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:39.202549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1589/3210] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:10:39 2022] PUT /identity/v3/projects/2767668c8f624a71b787a1334c9091da/users/4a8f4f941c504950b4f8217de48f3f58/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:10:39.204154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f16919-51d0-462c-ac96-927a8547b7d8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.212288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f16919-51d0-462c-ac96-927a8547b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.221584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f16919-51d0-462c-ac96-927a8547b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.263811 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:39.274676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-93f16919-51d0-462c-ac96-927a8547b7d8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:39.276731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-93f16919-51d0-462c-ac96-927a8547b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:39.369007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:39.372359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:39.405930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1622/3211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:39.473297 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1590/3212] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:39.534520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:39.536006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:39.550466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.550904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.551408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.563580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0fdd7-f610-488f-92ef-a7f3cc639585 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:39.611630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] MFA Rules not processed for user `bb85bd8db516469abb729c1fdc0a1ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:39.613188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:39.690929 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:39.747069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:39.749823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.750174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.751471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.786038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:39.790429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:39.792109 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1591/3213] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:10:39.792995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:39.814520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c461d-b977-46eb-a4d7-63445e8d7b0f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:39.829031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1623/3214] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:39.839947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:39.842909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:39.843861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:39.845367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:39.850898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:40.098959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:40.101199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:40.125979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1592/3215] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:45.396350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:45.402693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:45.592625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:45.605767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773670-c461-472a-b0c3-dfe553e207be service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:45.613643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:45.614271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:45.618674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:45.618972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:45.622223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:45.634578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab8a-7846-4d10-b314-988e0da679be service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:45.643069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:45.643939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:45.644365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:45.644782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:45.645321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:45.648094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb313-f459-41ef-8881-ae57e3062cfd service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:45.648434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:45.671407 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1593/3216] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:10:45.695475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:45.697367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:45.713504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1624/3217] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:49.993294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:49.994218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:49.994672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:50.073422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] MFA Rules not processed for user `4a8f4f941c504950b4f8217de48f3f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:50.074669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:50.258509 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1594/3218] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:10:51.409970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:51.412008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:51.448188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ae71-8186-490b-885c-5ac676d8c700 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:51.469426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:51.470063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:51.470345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:51.470618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:51.492536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:51.494065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca187b8-fadb-43ae-a866-8f30c8b9d91a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:51.516690 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1625/3219] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:55.476626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:10:55.478668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:55.503122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac9b2e-73cb-4cf6-96a8-52eb562008ac None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:10:55.524469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:10:55.524469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:55.524469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:55.524469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:55.524773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:55.537567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:10:55.539212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:10:55.584930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1595/3220] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:10:58.761494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:10:58.762010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:10:58.762112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:10:58.787155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] MFA Rules not processed for user `4a8f4f941c504950b4f8217de48f3f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:10:58.788572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:10:58.802883 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1626/3221] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:02.831035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:02.850807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aedf7f-73d5-4553-ac9b-375b385fef48 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:02.858208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:02.858943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:02.861007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:02.861255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:02.867838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:02.892817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:02.895885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:02.908664 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1596/3222] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:06.557831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:06.559979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:06.592426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816659d2-48d9-4583-ab17-21ff964b19d0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:06.607024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:06.607793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:06.608145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:06.608490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] PATH_INFO: `/v3/users/9164864381494d9991fd97410bedea72` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:06.610120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9164864381494d9991fd97410bedea72)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:06.612321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:06.682455 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:06.706691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9164864381494d9991fd97410bedea72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:06.722040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9164864381494d9991fd97410bedea72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:06.759833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9164864381494d9991fd97410bedea72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:06.760976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9164864381494d9991fd97410bedea72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:06.761847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9164864381494d9991fd97410bedea72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:06.786437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1627/3223] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:11:06 2022] DELETE /identity/v3/users/9164864381494d9991fd97410bedea72 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:07.261452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:07.280402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1857-9ae7-48ec-8b98-dfdcefe42d59 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:07.294113 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:07.400511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:07.402673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:07.406301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:07.406788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] PATH_INFO: `/v3/projects/ece9c2b6ca644160ad4c5fb7e1131c14` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:07.409362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece9c2b6ca644160ad4c5fb7e1131c14)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:07.412889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:07.535572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'request_id': 'req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.545150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'request_id': 'req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.556333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'request_id': 'req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.590909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] The token cache is being invalidate because project ece9c2b6ca644160ad4c5fb7e1131c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:11:07.591225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.591922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.593825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1597/3224] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:11:07 2022] DELETE /identity/v3/projects/ece9c2b6ca644160ad4c5fb7e1131c14 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:07.597575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:07.599141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:07.613111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43526b-c426-4f01-8f3e-5817422bee97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:07.747261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:07.747643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:07.747932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:07.748207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] PATH_INFO: `/v3/users/3cd257c12de5431090ac50cead0d988b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:07.749430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd257c12de5431090ac50cead0d988b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:07.752905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:07.899646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd257c12de5431090ac50cead0d988b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.918507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd257c12de5431090ac50cead0d988b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.960662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd257c12de5431090ac50cead0d988b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.961624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd257c12de5431090ac50cead0d988b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:07.962449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cff1a5ab-2ff6-44c0-8781-a16316bfa799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd257c12de5431090ac50cead0d988b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.000405 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1628/3225] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:11:07 2022] DELETE /identity/v3/users/3cd257c12de5431090ac50cead0d988b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:08.540534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:08.543945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:08.574121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559451c-61d4-4a69-bbe3-fe60d48f0bf3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:08.714135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:08.715050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:08.715334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:08.715666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] PATH_INFO: `/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:08.718807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c0e0fce5fe4b5d86a0f0f2bb7c1fd6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:08.725095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:08.799613 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:08.818425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c0e0fce5fe4b5d86a0f0f2bb7c1fd6', 'request_id': 'req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.844419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c0e0fce5fe4b5d86a0f0f2bb7c1fd6', 'request_id': 'req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.860939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c0e0fce5fe4b5d86a0f0f2bb7c1fd6', 'request_id': 'req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.884862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] The token cache is being invalidate because project 46c0e0fce5fe4b5d86a0f0f2bb7c1fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:11:08.886082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.887216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb48969-d6c7-47b8-b2e8-79ee2a5d80a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:08.890119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1598/3226] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:11:08 2022] DELETE /identity/v3/projects/46c0e0fce5fe4b5d86a0f0f2bb7c1fd6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:08.895896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:08.896401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:08.896573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:08.919772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:08.920997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:08.954840 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:09.025474 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1629/3227] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:09.034072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.034363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.034642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.068069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:09.069928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:09.085545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.085755 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1599/3228] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:09.100991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64b60-c08e-4157-b8ce-4b12a57ba12f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.114648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.115315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.115583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.119213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.119940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:11:09.120252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.122629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.154059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1630/3229] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:11:09.165050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.189552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00e391-acd3-44fb-90f1-a680a4cc0647 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.200247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.201125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.201610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.202054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.202864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.205109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.223793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.225803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:09.335718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1600/3230] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:11:09 2022] POST /identity/v3/projects => generated 399 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:09.339923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.374841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84329690-da03-4e19-a263-86044b317a2a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.477956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.478857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.479801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.480221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.486785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:09.562124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe2703-8393-4e05-9627-1bbd42e52963 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.580321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.581340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.581789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.582128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.583652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.588567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.600548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.602453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.621261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1631/3231] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:09.643892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1601/3232] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:11:09 2022] POST /identity/v3/users => generated 300 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:09.648786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.664976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37cd62-b493-4dd8-bc35-1791509e97dd service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.673827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.674729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.677162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.677656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.678500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.683543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.724449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.740044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a4efd-fd4f-4e04-8298-960aaa62f5ae admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.743869 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1632/3233] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:09.766953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.774161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.774621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.774958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.775673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.777551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac385-2c26-4864-a68d-6b7046bf8e29 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.825973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:09.838347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a921c4-fbe6-4b39-b300-8c9b79c73dd4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:09.845563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1602/3234] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:09.866584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:09.867567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.869848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.870602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] PATH_INFO: `/v3/projects/56773bfde588477493c4d44b0d3e74b9/users/1cc384987bb247d88d0027e60d600ed1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.891999 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:09.907418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56773bfde588477493c4d44b0d3e74b9, user_id=1cc384987bb247d88d0027e60d600ed1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:09.914287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:09.940036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1633/3235] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:11:09 2022] PUT /identity/v3/projects/56773bfde588477493c4d44b0d3e74b9/users/1cc384987bb247d88d0027e60d600ed1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:09.945165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5ff2-0d90-4832-8a43-80958fd381a2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:09.945455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5ff2-0d90-4832-8a43-80958fd381a2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:09.945742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5ff2-0d90-4832-8a43-80958fd381a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:09.980102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e4ff5ff2-0d90-4832-8a43-80958fd381a2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:09.981336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e4ff5ff2-0d90-4832-8a43-80958fd381a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:10.154492 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1603/3236] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:10.195477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:10.317332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9524b0-e507-4152-a98d-fcc624a2c9a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:10.327201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:10.327872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:10.328177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:10.328438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:10.353269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:10.354786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:10.377591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1634/3237] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:19.589846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eeed-771c-40ea-ae12-9796c116e4f6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:19.590319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eeed-771c-40ea-ae12-9796c116e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:19.590398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067eeed-771c-40ea-ae12-9796c116e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:19.622377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9067eeed-771c-40ea-ae12-9796c116e4f6 None None] MFA Rules not processed for user `f3931162a615421f8843396650368870`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:19.623619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9067eeed-771c-40ea-ae12-9796c116e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:19.639534 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:19.710857 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1604/3238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:11:20.367918 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:22.352671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:22.355017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:22.540114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ea74-f625-4fd0-b93f-8340b80cd9bb service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:22.548073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:22.549758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:22.550395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:22.551065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:22.554886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:22.572490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:22.574395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29e3ec-7e60-4ae8-b552-26640c3d94d9 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:22.616945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1635/3239] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:26.108031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:26.108575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:26.108693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:26.183448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] MFA Rules not processed for user `1cc384987bb247d88d0027e60d600ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:26.186141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:26.457369 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1605/3240] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:26.467052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:26.467580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:26.467580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:26.506104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] MFA Rules not processed for user `1cc384987bb247d88d0027e60d600ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:26.507588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:26.524891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1636/3241] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:11:26.536817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:26.561587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6b42-eb51-4ebb-b6a2-884a307b2fb4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:26.578256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:26.578897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:26.579179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:26.579449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:26.591618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:26.593605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:26.619921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1606/3242] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:34.496848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:34.498472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:34.534128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb15c6-be43-443c-a8ab-2b4ed2d502a5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:34.548558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:34.549616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:34.551050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:34.555382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] PATH_INFO: `/v3/users/545456a4a4e540be9138c47b0df77bbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:34.557235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545456a4a4e540be9138c47b0df77bbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:34.559458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:34.692963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545456a4a4e540be9138c47b0df77bbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:34.720708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545456a4a4e540be9138c47b0df77bbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:34.778050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545456a4a4e540be9138c47b0df77bbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:34.779596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545456a4a4e540be9138c47b0df77bbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:34.780309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545456a4a4e540be9138c47b0df77bbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:34.834174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1637/3243] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:11:34 2022] DELETE /identity/v3/users/545456a4a4e540be9138c47b0df77bbf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:36.481825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:36.498466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfbfea-404c-483c-ad62-bd5a94808eb4 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:36.590461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:36.591289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:36.591671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:36.592053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] PATH_INFO: `/v3/projects/868947b52a1d48d6be6e81a2b8718441` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:36.594805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] RBAC: Authorizing `identity:delete_project(project_id=868947b52a1d48d6be6e81a2b8718441)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:36.596964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:36.774519 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:36.783775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868947b52a1d48d6be6e81a2b8718441', 'request_id': 'req-b246e44c-461b-491a-89b9-00a09f0f346e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:36.810577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868947b52a1d48d6be6e81a2b8718441', 'request_id': 'req-b246e44c-461b-491a-89b9-00a09f0f346e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:36.831107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868947b52a1d48d6be6e81a2b8718441', 'request_id': 'req-b246e44c-461b-491a-89b9-00a09f0f346e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:36.854481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] The token cache is being invalidate because project 868947b52a1d48d6be6e81a2b8718441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:11:36.854783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:36.861175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:36.866796 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1607/3244] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:11:36 2022] DELETE /identity/v3/projects/868947b52a1d48d6be6e81a2b8718441 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:36.871392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:36.874175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:36.900578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cecb45-cc77-4fb3-b1c0-b29d53e05d93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:37.009519 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:37.050964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:37.051698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:37.051983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:37.052263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] PATH_INFO: `/v3/users/5854d8d6e34543948c1c3ddea3f0b5a0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:37.053581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5854d8d6e34543948c1c3ddea3f0b5a0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:37.056111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:37.155688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5854d8d6e34543948c1c3ddea3f0b5a0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:37.176191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5854d8d6e34543948c1c3ddea3f0b5a0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:37.201752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5854d8d6e34543948c1c3ddea3f0b5a0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:37.202580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5854d8d6e34543948c1c3ddea3f0b5a0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:37.203830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1d8a0394-94f9-4fac-933c-640fc65b8bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5854d8d6e34543948c1c3ddea3f0b5a0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:37.244219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1638/3245] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:11:36 2022] DELETE /identity/v3/users/5854d8d6e34543948c1c3ddea3f0b5a0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:37.764028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:37.766958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:37.795620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e44c-461b-491a-89b9-00a09f0f346e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:37.953860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:37.954513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:37.955162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:37.955455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] PATH_INFO: `/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:37.956676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d61f03c84f74f68bf62dfd2b52ff083)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:37.961570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.034933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d61f03c84f74f68bf62dfd2b52ff083', 'request_id': 'req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:38.042876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d61f03c84f74f68bf62dfd2b52ff083', 'request_id': 'req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:38.051043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d61f03c84f74f68bf62dfd2b52ff083', 'request_id': 'req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:38.079532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] The token cache is being invalidate because project 9d61f03c84f74f68bf62dfd2b52ff083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:11:38.079927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:38.080696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4524f89c-dda2-4bb0-92db-356c3ebe6f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:11:38.088648 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1608/3246] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:11:37 2022] DELETE /identity/v3/projects/9d61f03c84f74f68bf62dfd2b52ff083 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:38.089145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.090033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.090683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.125999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:38.128052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:38.294856 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1639/3247] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:38.304658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.304954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.305262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.344568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:38.348444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:38.392148 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1609/3248] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:38.395532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.423840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e3e43-9978-4299-b30f-586b20e32164 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.436859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.437600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.438034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.438450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.439217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:11:38.439527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.448957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.469806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.483218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1640/3249] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:11:38.483409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ae988-8eff-493b-923e-c1d319d35b59 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.489864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.490662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.491048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.491455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.492234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.494779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.560721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.561299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1610/3250] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:11:38 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:38.583412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30efa4-1859-4ea6-aae6-28d9afa1dcd3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.723546 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:38.738783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.739907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.740404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.740963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.741908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.744412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.778526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1641/3251] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:11:38 2022] POST /identity/v3/users => generated 303 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:38.781662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.802869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da40e-b8cf-49fb-9255-a50ea676a5fc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.813821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.814771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.815272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.815897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.816867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.821538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.845559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1611/3252] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:38.852042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.871490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0e53-4295-44c4-9c90-c948920c6e9e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.878614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.879810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.880424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.880887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.881994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.883947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a5d0d-93fa-47f0-b5cf-d4e8b43d800b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.905264 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1642/3253] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:38.909201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:38.920510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523b3f0-b464-4d51-bce0-4eb595e7ccea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:38.939424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:38.940400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:38.940840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:38.941195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] PATH_INFO: `/v3/projects/985a702f5bbd4fe581b4cd6d1745edf9/users/a0ab066b8b314936b036e1cde20e17c0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:38.970690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985a702f5bbd4fe581b4cd6d1745edf9, user_id=a0ab066b8b314936b036e1cde20e17c0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:38.981735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:38.994980 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:39.010263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1612/3254] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:11:38 2022] PUT /identity/v3/projects/985a702f5bbd4fe581b4cd6d1745edf9/users/a0ab066b8b314936b036e1cde20e17c0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:39.015154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aeaf-a25d-4bad-a991-a3381af63fb2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:39.015534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aeaf-a25d-4bad-a991-a3381af63fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:39.016729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aeaf-a25d-4bad-a991-a3381af63fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:39.043779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ab5aeaf-a25d-4bad-a991-a3381af63fb2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:39.045218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ab5aeaf-a25d-4bad-a991-a3381af63fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:39.140392 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1643/3255] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:39.178893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:39.181458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:39.269273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0fc0a-32a8-42e5-93c2-d53647f4f9a4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:39.288720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:39.289705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:39.290355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:39.292503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:39.308282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:39.309989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:39.325758 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1613/3256] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:49.127718 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=35,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:49.319551 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=27 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:51.575870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:51.576386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:51.576462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:51.643390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] MFA Rules not processed for user `a0ab066b8b314936b036e1cde20e17c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:11:51.645838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:51.805051 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1644/3257] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:11:51.809935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:51.824840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dada7-cb3f-4834-89d9-7a586aa0894b service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:51.830318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:51.831222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:51.831511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:51.831906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:51.833662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:51.835563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:51.876087 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1614/3258] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:11:51 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:51.877247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:51.891443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8d61-54c2-412d-aaaa-e602724da09b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:51.957736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:51.959734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:51.974719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:51.975609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:51.976049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:51.976475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:51.977803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:51.980196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.009912 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1645/3259] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:11:51 2022] POST /identity/v3/users => generated 308 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:11:52.017200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:52.030028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce749-8183-469c-bbdf-86a85fd1e1b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:52.036190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:52.037100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:52.037611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:52.038141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:52.039272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:52.041279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.077340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1646/3260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:52.081686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:52.095510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef967-f5c0-48d3-b0b1-d857cab604da admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:52.103041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:52.103921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:52.104304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:52.104841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:52.107424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5906a-d058-4988-abea-409ffa02ad57 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:52.107871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:52.118928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:52.123599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:52.125312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:52.126131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:52.126532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] PATH_INFO: `/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130/users/dcd5e1e7009441c882b446e43722da34/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:52.130777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.166032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1615/3261] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:11:52.170243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc73235b39ca4ab3ba34ec0762ef2130, user_id=dcd5e1e7009441c882b446e43722da34, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:52.179364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.210008 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1647/3262] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:11:52 2022] PUT /identity/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130/users/dcd5e1e7009441c882b446e43722da34/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:11:52.214231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:52.236809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4fc14-a18e-4169-a307-4a38eca10585 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:52.402323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:52.403540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:52.404166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:52.404650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:52.405565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:52.408470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.423978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1616/3263] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:11:52.428554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:52.455391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358e61-8d05-4b5d-9a71-7cc8b219853b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:52.470370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:52.472179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:52.477005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:52.478449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] PATH_INFO: `/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130/users/dcd5e1e7009441c882b446e43722da34/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:52.488611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc73235b39ca4ab3ba34ec0762ef2130, user_id=dcd5e1e7009441c882b446e43722da34, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:52.500499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:52.543670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1648/3264] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:11:52 2022] PUT /identity/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130/users/dcd5e1e7009441c882b446e43722da34/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:11:57.619333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:11:57.788645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91373-4004-4c47-8a2f-1f7fbfcf14c0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:11:57.851803 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:57.886747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:11:57.887508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:11:57.887900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:11:57.888418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:11:57.893366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:11:58.037231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:11:58.039787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:11:58.070831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1617/3265] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:02.526120 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:02.965433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:02.967871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:02.991943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ea68-6cd2-4c9d-844c-bcd524115ca7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:02.999170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:02.999840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:03.000122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:03.000401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] PATH_INFO: `/v3/users/7f09255419184d11b8379c6bd0a338b0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:03.001644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f09255419184d11b8379c6bd0a338b0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:03.004919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:03.109679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f09255419184d11b8379c6bd0a338b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:03.132714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f09255419184d11b8379c6bd0a338b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:03.169509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f09255419184d11b8379c6bd0a338b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:03.170120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f09255419184d11b8379c6bd0a338b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:03.170737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f09255419184d11b8379c6bd0a338b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:03.203868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1649/3266] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:02 2022] DELETE /identity/v3/users/7f09255419184d11b8379c6bd0a338b0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:04.009748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:04.030885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620cbaf-19b7-467c-8ee6-0ff3162012ea service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:04.244663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:04.245341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:04.246228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:04.246509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] PATH_INFO: `/v3/projects/4131663ab3574002b589848f67fbb78d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:04.247793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4131663ab3574002b589848f67fbb78d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:04.250085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:04.455151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4131663ab3574002b589848f67fbb78d', 'request_id': 'req-877ed099-69b5-44ca-875c-567fb72a9b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.479518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4131663ab3574002b589848f67fbb78d', 'request_id': 'req-877ed099-69b5-44ca-875c-567fb72a9b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.510910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4131663ab3574002b589848f67fbb78d', 'request_id': 'req-877ed099-69b5-44ca-875c-567fb72a9b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.601625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] The token cache is being invalidate because project 4131663ab3574002b589848f67fbb78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:04.604600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.613483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.622812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1618/3267] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:04 2022] DELETE /identity/v3/projects/4131663ab3574002b589848f67fbb78d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:04.624116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:04.625810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:04.666652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b0b-d576-4304-8c87-341469a97b8a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:04.799613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:04.800668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:04.800963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:04.801240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] PATH_INFO: `/v3/users/c8bfed82c804419eaddc0aae23f34b70` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:04.803379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bfed82c804419eaddc0aae23f34b70)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:04.805798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:04.935729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bfed82c804419eaddc0aae23f34b70'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.953121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bfed82c804419eaddc0aae23f34b70'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.972918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bfed82c804419eaddc0aae23f34b70'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.973723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bfed82c804419eaddc0aae23f34b70'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.974845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bfed82c804419eaddc0aae23f34b70'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:04.977962 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:05.050714 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1650/3268] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:04 2022] DELETE /identity/v3/users/c8bfed82c804419eaddc0aae23f34b70 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:05.381198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:05.383183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:05.420246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed099-69b5-44ca-875c-567fb72a9b9c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:05.470483 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:05.653040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:05.654104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:05.654104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:05.654315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] PATH_INFO: `/v3/projects/ddfc98737e554a74a138eb2fe8bf5092` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:05.656282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfc98737e554a74a138eb2fe8bf5092)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:05.658518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:05.756803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:05.760082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:05.807717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfc98737e554a74a138eb2fe8bf5092', 'request_id': 'req-66020c96-b584-4034-ad78-586471ef9263'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:05.827723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfc98737e554a74a138eb2fe8bf5092', 'request_id': 'req-66020c96-b584-4034-ad78-586471ef9263'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:05.844716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfc98737e554a74a138eb2fe8bf5092', 'request_id': 'req-66020c96-b584-4034-ad78-586471ef9263'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:05.871611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] The token cache is being invalidate because project ddfc98737e554a74a138eb2fe8bf5092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:05.874128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:05.877130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66020c96-b584-4034-ad78-586471ef9263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:05.880792 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1619/3269] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:05 2022] DELETE /identity/v3/projects/ddfc98737e554a74a138eb2fe8bf5092 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:05.885937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde172e8-9412-470a-abf1-022ba2b08bf1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:05.886228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde172e8-9412-470a-abf1-022ba2b08bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:05.886507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde172e8-9412-470a-abf1-022ba2b08bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:05.937438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cde172e8-9412-470a-abf1-022ba2b08bf1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:05.940253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cde172e8-9412-470a-abf1-022ba2b08bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:06.031045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718ff4-f927-4a54-9e38-4c97683e6396 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.093757 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1620/3270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:06.102771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.103142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.103468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.163510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:06.165337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:06.194667 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1621/3271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:06.200310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.240365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1abfd2-9d41-4367-8d5c-fb9942e4823a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.257218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.258011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.258134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.258710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.259452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:06.259668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.261282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.297367 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1622/3272] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:06.301723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.322539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18ee86-5e03-46b9-ad7a-43ddf139758c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.323544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.324403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.324842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.325270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.327402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:06.336099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.336732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.337016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.337290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.337970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.339902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.358356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.362056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.400940 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1651/3273] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:06.426504 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1623/3274] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:06 2022] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:06.431040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.454764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720ded-5084-4c28-9e88-1762e86b77ee service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.596442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.598322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.598896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.599397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.601002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.603772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.679750 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1652/3275] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:06 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:06.682757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.688642 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:06.699072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d2c-2640-4af0-9a0f-a7ffffec9776 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.714419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.715491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.715784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.716059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.716961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.719479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.764654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1624/3276] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:06.766800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.776732 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:06.796590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9259cb5-4697-4c4b-92f0-1803840ac32d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.808775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.812043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.812539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.812834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:06.813616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:06.818863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcea34-d760-432e-998d-eda8dd698c8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:06.898091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1653/3277] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:06.899628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:06.960451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049b1e6-78bf-4847-99f6-8b29bb0b9ccb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:06.982332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:06.983192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:06.985627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:06.986615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] PATH_INFO: `/v3/projects/becc007596364d5fac8bf17571458d83/users/829a6360f61f4d47afc21aac640b9c2e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:07.031415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becc007596364d5fac8bf17571458d83, user_id=829a6360f61f4d47afc21aac640b9c2e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:07.035601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:07.059598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1625/3278] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:06 2022] PUT /identity/v3/projects/becc007596364d5fac8bf17571458d83/users/829a6360f61f4d47afc21aac640b9c2e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:07.066004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad768-1987-412e-8d4a-e3153f4a05d6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:07.066296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad768-1987-412e-8d4a-e3153f4a05d6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:07.066989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad768-1987-412e-8d4a-e3153f4a05d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:07.108038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4afad768-1987-412e-8d4a-e3153f4a05d6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:07.109490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4afad768-1987-412e-8d4a-e3153f4a05d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:07.241777 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1654/3279] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:07.266571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:07.270206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:07.370662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb938-3e46-4f42-a54b-e57f2a8f8239 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:07.382026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:07.382026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:07.397955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:07.398385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:07.430494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:07.433863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206bfa-c654-4f59-9d38-4c64896a2617 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:07.465396 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1626/3280] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:08.774338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee4fd-8c11-4ca3-aadc-c9886535a12f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:08.776221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee4fd-8c11-4ca3-aadc-c9886535a12f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:08.777602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee4fd-8c11-4ca3-aadc-c9886535a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:08.846930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cdeee4fd-8c11-4ca3-aadc-c9886535a12f None None] MFA Rules not processed for user `bb85bd8db516469abb729c1fdc0a1ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:08.848575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cdeee4fd-8c11-4ca3-aadc-c9886535a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:08.962694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1655/3281] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:09.831638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:09.832233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:09.832366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:09.895281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] MFA Rules not processed for user `dcd5e1e7009441c882b446e43722da34`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:09.899223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:10.159847 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1627/3282] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:14.912783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:14.913892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:14.914388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:14.947849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] MFA Rules not processed for user `1cc384987bb247d88d0027e60d600ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:14.949296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:15.019842 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1656/3283] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:17.134722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:17.154543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc473-c26b-4f9a-ba33-dd1dddee537d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:17.159556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:17.160188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:17.160473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:17.160748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:17.162786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:17.175291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:17.177089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:17.194675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1628/3284] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:17.562901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:17.564933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:17.595470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d47d1-97cd-4df7-a833-ce70e2488f41 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:17.630810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:17.643609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:17.644946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:17.650550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] PATH_INFO: `/v3/users/1e62f0277cf04e87be2017098f3d6327` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:17.666106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e62f0277cf04e87be2017098f3d6327)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:17.677347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:17.825757 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:17.846422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e62f0277cf04e87be2017098f3d6327'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:17.869686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e62f0277cf04e87be2017098f3d6327'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:17.897949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e62f0277cf04e87be2017098f3d6327'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:17.899437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e62f0277cf04e87be2017098f3d6327'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:17.900584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e62f0277cf04e87be2017098f3d6327'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:17.945865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1657/3285] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:17 2022] DELETE /identity/v3/users/1e62f0277cf04e87be2017098f3d6327 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:18.768733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:18.791614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4eec-3c1c-45e0-b3bd-72b7698518a2 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:18.878166 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:18.925715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:18.926949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:18.927191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:18.927474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] PATH_INFO: `/v3/projects/624fa9637d2844fbbce4439455fbe41f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:18.936088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=624fa9637d2844fbbce4439455fbe41f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:18.938124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:19.055214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624fa9637d2844fbbce4439455fbe41f', 'request_id': 'req-cc62644d-b61a-4344-9415-df32f7c052ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.072075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624fa9637d2844fbbce4439455fbe41f', 'request_id': 'req-cc62644d-b61a-4344-9415-df32f7c052ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.086936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624fa9637d2844fbbce4439455fbe41f', 'request_id': 'req-cc62644d-b61a-4344-9415-df32f7c052ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.107955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] The token cache is being invalidate because project 624fa9637d2844fbbce4439455fbe41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:19.108550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.114001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.116663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1629/3286] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:18 2022] DELETE /identity/v3/projects/624fa9637d2844fbbce4439455fbe41f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:19.121393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:19.123927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:19.151932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bff08-2f93-4b40-b664-1d0c36be0c82 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:19.319354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:19.320054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:19.320643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:19.321078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] PATH_INFO: `/v3/users/57fabc03383348fd9f3726513f3007c9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:19.322655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fabc03383348fd9f3726513f3007c9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:19.324869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:19.501885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fabc03383348fd9f3726513f3007c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.535890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fabc03383348fd9f3726513f3007c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.583873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fabc03383348fd9f3726513f3007c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.591374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fabc03383348fd9f3726513f3007c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.592530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fabc03383348fd9f3726513f3007c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:19.628765 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1658/3287] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:19 2022] DELETE /identity/v3/users/57fabc03383348fd9f3726513f3007c9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:20.215669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:20.217177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:20.237173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62644d-b61a-4344-9415-df32f7c052ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:20.405768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:20.406621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:20.407055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:20.407645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] PATH_INFO: `/v3/users/fe77600029ff40f8b738c097bf184495` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:20.432270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:20.433806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:20.464400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd2410-5551-4232-bc70-7dae07b42d6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:20.466785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe77600029ff40f8b738c097bf184495)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:20.468800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:20.488578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:20.492377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:20.492953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:20.493486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] PATH_INFO: `/v3/projects/3fdc8578ba924129bdaf870344fbb0a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:20.495408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdc8578ba924129bdaf870344fbb0a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:20.501592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:20.591035 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:20.607046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe77600029ff40f8b738c097bf184495'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.607971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe77600029ff40f8b738c097bf184495'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.627250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdc8578ba924129bdaf870344fbb0a9', 'request_id': 'req-3fc893aa-16ff-4684-b7da-5096e43753fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.629319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe77600029ff40f8b738c097bf184495'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.638520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdc8578ba924129bdaf870344fbb0a9', 'request_id': 'req-3fc893aa-16ff-4684-b7da-5096e43753fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.643336 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:20.651527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdc8578ba924129bdaf870344fbb0a9', 'request_id': 'req-3fc893aa-16ff-4684-b7da-5096e43753fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.661256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe77600029ff40f8b738c097bf184495'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.664064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f3ad6c9-6e7b-40da-91d7-b41957c23201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe77600029ff40f8b738c097bf184495'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.686111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] The token cache is being invalidate because project 3fdc8578ba924129bdaf870344fbb0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:20.687498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.689853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fc893aa-16ff-4684-b7da-5096e43753fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:20.696503 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1659/3289] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:20 2022] DELETE /identity/v3/projects/3fdc8578ba924129bdaf870344fbb0a9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:20.696963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1630/3289] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:20 2022] DELETE /identity/v3/users/fe77600029ff40f8b738c097bf184495 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:20.698667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:20.698963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:20.699245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:20.729070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:20.730650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:20.847624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1660/3290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:20.856864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:20.856864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:20.856864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:20.889715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:20.890956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:20.912378 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1631/3291] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:20.916830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:20.928388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fe60-a0ed-4265-a5af-fc174fabbf8c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:20.939760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:20.940385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:20.940760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:20.940868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:20.941546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:20.941828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:20.943446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:20.977466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:20.977865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1661/3292] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:20.990096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa69cd-30f4-41a9-a52a-05f9dadbdf07 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.004011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.004649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.004925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.005246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.005924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:21.007861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:21.073779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1632/3293] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:20 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:21.077905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:21.095083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca367-e5f8-4f71-987d-f2a460dbfb3a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.305518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.306164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.306444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.306714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.307357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:21.319024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:21.360678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1662/3294] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:21 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:21.365551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:21.387625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b0ee-3daa-4fd8-abbd-5f17b388f982 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.406873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.407587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.407969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.408308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.409034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:21.410752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:21.436134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1633/3295] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:21.439661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:21.452017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c204-bce7-4bbb-b06d-34117476f3fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.477826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.478889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.479321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.479817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.480693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:21.483674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f278-488f-448c-b961-f39ea1013957 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:21.507525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:21.517198 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1663/3296] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:21.523621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec6fe-5653-406b-bca7-5af20cb6491b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.529656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.530416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.530757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.531269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] PATH_INFO: `/v3/projects/52871d02d6f348c78767e9f62627b539/users/b1bc0ffad726490cb6501becbc822449/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.552975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52871d02d6f348c78767e9f62627b539, user_id=b1bc0ffad726490cb6501becbc822449, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:21.556902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:21.591786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1634/3297] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:21 2022] PUT /identity/v3/projects/52871d02d6f348c78767e9f62627b539/users/b1bc0ffad726490cb6501becbc822449/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:21.595799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74138c-ac68-4351-96ba-2f3e8b70faea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.596202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74138c-ac68-4351-96ba-2f3e8b70faea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.596568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74138c-ac68-4351-96ba-2f3e8b70faea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.663882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9e74138c-ac68-4351-96ba-2f3e8b70faea None None] MFA Rules not processed for user `b1bc0ffad726490cb6501becbc822449`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:21.670991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e74138c-ac68-4351-96ba-2f3e8b70faea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:21.687772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:21.691596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:21.706431 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:21.929571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1664/3298] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:21.931391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.931847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.932119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.942477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0799e9-5aca-49d8-b108-852b37f5f54e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:21.950717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:21.952328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:21.952617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:21.953057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] PATH_INFO: `/v3/projects/ce74d459ddb341569f42818c99cbfcaa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:21.983995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] MFA Rules not processed for user `b1bc0ffad726490cb6501becbc822449`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:21.983995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:21.998302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce74d459ddb341569f42818c99cbfcaa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:22.004917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:22.006325 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1665/3299] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:22.021273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:22.022919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:22.120474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce74d459ddb341569f42818c99cbfcaa', 'request_id': 'req-47144b88-779d-4d18-8146-cc2df1b51c08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.139139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce74d459ddb341569f42818c99cbfcaa', 'request_id': 'req-47144b88-779d-4d18-8146-cc2df1b51c08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.153548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce74d459ddb341569f42818c99cbfcaa', 'request_id': 'req-47144b88-779d-4d18-8146-cc2df1b51c08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.175769 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:22.202128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] The token cache is being invalidate because project ce74d459ddb341569f42818c99cbfcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:22.203655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.206732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.209395 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1635/3300] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:21 2022] DELETE /identity/v3/projects/ce74d459ddb341569f42818c99cbfcaa => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:22.210373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:22.213262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:22.220924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9bfa-1efd-482d-871f-3998ce7a7d65 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:22.416412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144b88-779d-4d18-8146-cc2df1b51c08 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:22.419953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:22.423158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:22.424408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:22.424908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:22.432596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:22.435303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:22.437228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:22.437758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:22.438665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] PATH_INFO: `/v3/users/f3931162a615421f8843396650368870` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:22.441055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3931162a615421f8843396650368870)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:22.446881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:22.528781 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:22.557789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3931162a615421f8843396650368870'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.558317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:22.558753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3931162a615421f8843396650368870'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.566349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:22.580719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3931162a615421f8843396650368870'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.586655 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1666/3301] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:22.587760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:22.589447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:22.622050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3931162a615421f8843396650368870'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.623084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3931162a615421f8843396650368870'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.626265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7524e-d0c5-4b63-b1d2-10de9f9936d8 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:22.639537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:22.643191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:22.643616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:22.645198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] PATH_INFO: `/v3/users/d7f26fd1f30840e9b538809926776cd6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:22.657351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1636/3302] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:22 2022] DELETE /identity/v3/users/f3931162a615421f8843396650368870 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:22.683436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f26fd1f30840e9b538809926776cd6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:22.698732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:22.866089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f26fd1f30840e9b538809926776cd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.883348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f26fd1f30840e9b538809926776cd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.912517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f26fd1f30840e9b538809926776cd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.913353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f26fd1f30840e9b538809926776cd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.914882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f26fd1f30840e9b538809926776cd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:22.947502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1667/3303] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:22 2022] DELETE /identity/v3/users/d7f26fd1f30840e9b538809926776cd6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:23.699797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:23.701852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:23.822014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4762f-cbf9-4e03-88b3-99e1dc48d24c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:23.846302 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:23.902787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:23.903782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:23.904258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:23.904735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] PATH_INFO: `/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:23.918018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d97288012aa41b3bd2bf891ffb18e0c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:23.920317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.003758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d97288012aa41b3bd2bf891ffb18e0c', 'request_id': 'req-a7fdf366-c3bf-4a07-96de-c50cb849e695'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.020645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d97288012aa41b3bd2bf891ffb18e0c', 'request_id': 'req-a7fdf366-c3bf-4a07-96de-c50cb849e695'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.041619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d97288012aa41b3bd2bf891ffb18e0c', 'request_id': 'req-a7fdf366-c3bf-4a07-96de-c50cb849e695'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.054619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.056599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:24.068279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] The token cache is being invalidate because project 2d97288012aa41b3bd2bf891ffb18e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:24.068932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.070865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7fdf366-c3bf-4a07-96de-c50cb849e695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.073137 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1637/3304] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:23 2022] DELETE /identity/v3/projects/2d97288012aa41b3bd2bf891ffb18e0c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:24.075865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6845-6fe3-44b7-a3a9-32e6340cd1ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.081800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d32b-93b6-40e0-b20a-595dbadb42e5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.082356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d32b-93b6-40e0-b20a-595dbadb42e5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.082756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d32b-93b6-40e0-b20a-595dbadb42e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.122599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc54d32b-93b6-40e0-b20a-595dbadb42e5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:24.124129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc54d32b-93b6-40e0-b20a-595dbadb42e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:24.252701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.254745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.255036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.255322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] PATH_INFO: `/v3/projects/e310970d7ec54c99a3d719824c6be1ee` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.259326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e310970d7ec54c99a3d719824c6be1ee)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.261469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.282322 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1638/3305] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:24.290868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.291296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.291797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.371180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:24.372531 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:24.377356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:24.380642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e310970d7ec54c99a3d719824c6be1ee', 'request_id': 'req-3fcfb15b-cc77-4f92-a980-61b7f238915a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.395419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e310970d7ec54c99a3d719824c6be1ee', 'request_id': 'req-3fcfb15b-cc77-4f92-a980-61b7f238915a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.420207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e310970d7ec54c99a3d719824c6be1ee', 'request_id': 'req-3fcfb15b-cc77-4f92-a980-61b7f238915a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.438741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] The token cache is being invalidate because project e310970d7ec54c99a3d719824c6be1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:24.438741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.440085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3fcfb15b-cc77-4f92-a980-61b7f238915a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:24.443081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1668/3306] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:24 2022] DELETE /identity/v3/projects/e310970d7ec54c99a3d719824c6be1ee => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:24.452539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61408-2fef-4861-8e01-d6bc6bc96961 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.452991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61408-2fef-4861-8e01-d6bc6bc96961 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.453700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61408-2fef-4861-8e01-d6bc6bc96961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.499166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cbd61408-2fef-4861-8e01-d6bc6bc96961 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:24.511714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cbd61408-2fef-4861-8e01-d6bc6bc96961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:24.525659 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:24.555788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1639/3307] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:24.560914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.585618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9211549-36a9-486d-8233-bab4a487a53a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.593878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.594442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.594858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.595143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.597018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:24.597246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.598921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.617501 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1640/3308] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:24.622661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.643521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c010d0-cd19-429f-9471-0e3b0a9f709a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.649276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.650079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.650523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.651259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.651948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.654428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.713246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1641/3309] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:24.714282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.732582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1669/3310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:24.750456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.750778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.751066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.835807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:24.841067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:24.855188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc99ed-e0f8-4428-b438-f9e3b248c52c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.863807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.864618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.864978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.865372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.866134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.869744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.880461 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1670/3311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:24.884713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.901973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d5f1-4682-44ca-a7e6-9c803d54175e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.906598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1642/3312] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:24.910504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.911769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.912479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.912852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.913202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.914605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:24.914984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.916953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.940456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1671/3313] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:12:24.944644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:24.959625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b08f9-f0ba-4017-8b5a-147ee0c6a641 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.964118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72630b-3286-4a6c-8b7d-931ab277d0c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:24.967380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.968846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.969307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.969674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.970549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.970844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:24.972748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:24.973177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:24.973573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:24.974316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:24.975361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.983820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:24.995780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1643/3314] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:25.000547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.042787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bb60-5c7a-4e82-a294-42d4c32d6fdc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.061651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.062416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.062869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.063790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.066007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.066575 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1672/3315] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:24 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:25.070286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.071296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.090926 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1644/3316] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:25.092536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.132596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eef05d-8ed0-441b-a83e-6faff4778a9a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.212378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a05d-9ff2-4908-86e5-7f4642b1fa94 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.220655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.222923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.224360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.224640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.229660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.238639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.281486 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1673/3317] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:25.284676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.293335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.294056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.294343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.294622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] PATH_INFO: `/v3/projects/82faf0d0b44b443e8da6999cebb3b332/users/33ad1f2d9cd94377b917124fe608112a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.299075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9f44-fb5a-448f-a161-25aa8b5cd2bd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.305882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.307761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.308042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.308315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.308988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.310653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.325374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82faf0d0b44b443e8da6999cebb3b332, user_id=33ad1f2d9cd94377b917124fe608112a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.328388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965ba0c-b5f8-43cd-9822-48a0f7f54877 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.329688 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1674/3318] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:25.332289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.364284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a884e-29d0-40ec-9a48-0e1a938949ad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.365266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1645/3319] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:25 2022] PUT /identity/v3/projects/82faf0d0b44b443e8da6999cebb3b332/users/33ad1f2d9cd94377b917124fe608112a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:25.369935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.370303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.370659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.380518 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:25.381498 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:25.412752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] MFA Rules not processed for user `33ad1f2d9cd94377b917124fe608112a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:25.414033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:25.566491 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1646/3320] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:25.569762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.570829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.571028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.571142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.571379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.573867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.575933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.583351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197643a5-e788-4e10-babb-ea07543778c4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.588210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1675/3321] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:25.592402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.622526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.623957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.624288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fb98-621c-42ed-8010-dadfc724fd41 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.625348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.626053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.627707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.632878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07452d79-f69e-47f1-b681-4389d9c491d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.645054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.646685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.650063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.650670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] PATH_INFO: `/v3/projects/eec1319e579e4320b8dcc92ea5cf7497/users/7456ca6479564821bcefcf411f86bf13/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.682460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec1319e579e4320b8dcc92ea5cf7497, user_id=7456ca6479564821bcefcf411f86bf13, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.687504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.708425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1647/3322] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:25.714002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8a1b-9a8e-4c6f-a9d6-18bd4af57371 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.715517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8a1b-9a8e-4c6f-a9d6-18bd4af57371 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.716411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8a1b-9a8e-4c6f-a9d6-18bd4af57371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.727594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1676/3323] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:25 2022] PUT /identity/v3/projects/eec1319e579e4320b8dcc92ea5cf7497/users/7456ca6479564821bcefcf411f86bf13/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:25.729559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.792120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-376e8a1b-9a8e-4c6f-a9d6-18bd4af57371 None None] MFA Rules not processed for user `829a6360f61f4d47afc21aac640b9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:25.793513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-376e8a1b-9a8e-4c6f-a9d6-18bd4af57371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:25.895540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248c1-b928-418c-a54e-838e659d1e2b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.908790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.909648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.910034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.910566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.911315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.917348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:25.920701 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1648/3324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:25.922774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.923227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.924423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.963798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1677/3325] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:25.967815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:25.981896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0ba-5df1-4f6a-aec7-fa3aaa8614cf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:25.987720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:25.988504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:25.989019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:25.989396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:25.990188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:25.990368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] MFA Rules not processed for user `7456ca6479564821bcefcf411f86bf13`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:25.991746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:25.992334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.005092 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1678/3326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:26.009033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.024062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180936-c7a6-491b-b004-1ae7e229e91c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.030013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.030810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.031190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.031564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] PATH_INFO: `/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2/users/9bbfd75df6464163bed3fecbbb67492f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.066692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e54bfd8ef744a20b2d010fb073f6fc2, user_id=9bbfd75df6464163bed3fecbbb67492f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.072291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.077222 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:26.106803 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1679/3327] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:26 2022] PUT /identity/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2/users/9bbfd75df6464163bed3fecbbb67492f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:26.106803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.107647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:26.132165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1649/3328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:26.133203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.151560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456f72-0601-4b2d-9a28-c3b26124150e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.209060 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:26.289574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5b19-48e5-49e9-82f5-993e5b093075 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.296519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.297646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.297927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.298200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.303251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.304478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.304951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.305426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.306766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.308936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.326411 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1650/3329] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:26.327789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.339583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2223d-ff79-4164-92b9-51ae6eb2c3a7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.350129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.351236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.351765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.352226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.353085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.357229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.405298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.409551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.409712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1651/3330] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:26 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:26.409712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.429643 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1680/3331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:26.430527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.446751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fb5a-b3a7-4bd4-9d74-b64fbafee023 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.546689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a316e2f-bb23-4637-a4ce-c3fadff6ac4b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.551958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.554125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.554480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.555312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.555494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.555692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.555857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.555950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] PATH_INFO: `/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2/users/9bbfd75df6464163bed3fecbbb67492f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.556575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.558272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e54bfd8ef744a20b2d010fb073f6fc2, user_id=9bbfd75df6464163bed3fecbbb67492f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.558940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.561102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dd87a-94cf-4ca2-9520-a2f717369af5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.578383 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1652/3332] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:26 2022] PUT /identity/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2/users/9bbfd75df6464163bed3fecbbb67492f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:26.590668 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1681/3333] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:26 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:26.594316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.594712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.595060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.597750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.618596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b6df-ce1e-411a-bbe0-5d1ac922306b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.635690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] MFA Rules not processed for user `9bbfd75df6464163bed3fecbbb67492f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:26.636788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:26.721139 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:26.757092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.758804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.759157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.759728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.760462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.762354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.770688 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:26.785804 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1682/3334] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:26.787542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.789389 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1653/3335] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:26.801980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.810015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5bcf-47c0-4b2c-b59a-9f1a851e65da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:26.819697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:26.820086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:26.820517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:26.820794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] PATH_INFO: `/v3/projects/3f7804cf06b1415d898033a81a3404c8/users/fac8c23b872749558d6ab78fda396408/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:26.850981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7804cf06b1415d898033a81a3404c8, user_id=fac8c23b872749558d6ab78fda396408, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:26.857498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:26.885522 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1683/3336] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:26 2022] PUT /identity/v3/projects/3f7804cf06b1415d898033a81a3404c8/users/fac8c23b872749558d6ab78fda396408/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:26.897158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:26.987703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204218c5-7b2d-4b34-bb9d-d76b9c66db45 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.059860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9970d-3522-4e4a-bf37-ccb644d3d455 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.068664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.069360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.069640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.069961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.070621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.073183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.111404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1684/3337] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:27.114251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.133189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7f6a-c852-4987-9a22-5dba48cb1783 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.139503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.142061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.143355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.143922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] PATH_INFO: `/v3/projects/3f7804cf06b1415d898033a81a3404c8/users/fac8c23b872749558d6ab78fda396408/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.148582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7804cf06b1415d898033a81a3404c8, user_id=fac8c23b872749558d6ab78fda396408, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.153479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac84f1-ab5a-4bf5-8c08-e2a955aca0a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.166418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.167283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.167619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.167999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.187116 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1685/3338] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:27 2022] PUT /identity/v3/projects/3f7804cf06b1415d898033a81a3404c8/users/fac8c23b872749558d6ab78fda396408/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:27.201591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.202025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.202561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.247363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] MFA Rules not processed for user `fac8c23b872749558d6ab78fda396408`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:27.248073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:27.286539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.288769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.302586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1654/3339] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:27.356400 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1686/3340] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:27.363422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.403771 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:27.499783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2861-d93b-4fa3-88ee-300f69df1af3 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.516453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.517528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.518467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.518863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.519850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.521299 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:27.521299 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:27.521299 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:27.522440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.555149 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1655/3341] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:12:27 2022] POST /identity/v3/domains => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:27.556728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.571714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283bf10-beaf-405b-80d4-754600e453dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.660994 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:27.695275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.698553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.699668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.700354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.704039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1e3ef056700d45afb052446155174ffd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.705669 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:27.705669 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:27.705669 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:27.708673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.793792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1687/3342] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:12:27 2022] PUT /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config => generated 138 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:27.797077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.810204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a1c22-97fa-4bdd-9404-8521e78930c1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.818176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.819012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.819302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.820057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.831558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e3ef056700d45afb052446155174ffd, group=identity)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.833817 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:27.833817 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:27.833817 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:27.835552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.852160 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1656/3343] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:12:27 2022] GET /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config/identity => generated 45 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:27.858869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.875323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80999-4d49-4083-ac3d-c25fda262385 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.890957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.891874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.892347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.893530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config/identity/driver` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.895830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e3ef056700d45afb052446155174ffd, group=identity, option=driver)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.897634 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:27.897634 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:27.897634 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:27.898850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.907302 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1688/3344] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:12:27 2022] GET /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config/identity/driver => generated 31 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:27.912472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.926673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759297-4a94-4afd-bcd1-7862f3721485 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.941347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.942094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.942811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.942811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:27.943817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e3ef056700d45afb052446155174ffd, group=ldap)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:27.945466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:27.964154 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1657/3345] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:12:27 2022] GET /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap => generated 106 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:27.965176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:27.989745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aff66-0a58-4d22-b9bb-50112749a095 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:27.996086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:27.997062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:27.997616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:27.999459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap/url` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:28.001342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e3ef056700d45afb052446155174ffd, group=ldap, option=url)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:28.004067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:28.012822 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1689/3346] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:12:27 2022] GET /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap/url => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:28.024280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:28.036049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371987e7-2d11-4054-999b-1fd406ef91f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:28.043907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:28.044728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:28.045141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:28.045970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap/user_tree_dn` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:28.047404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e3ef056700d45afb052446155174ffd, group=ldap, option=user_tree_dn)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:28.049331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:28.062484 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1658/3347] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:12:28 2022] GET /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config/ldap/user_tree_dn => generated 63 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:28.063012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:28.080644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cd5b1-a768-4dcb-a9dd-ac5862401efb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:28.087564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:28.089608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:28.090090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:28.091724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:28.092489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1e3ef056700d45afb052446155174ffd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:28.093887 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:28.093887 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:28.093887 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:28.095795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:28.115292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1690/3348] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:28 2022] DELETE /identity/v3/domains/1e3ef056700d45afb052446155174ffd/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:28.119209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:28.133371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3903f7-0c5e-436a-a733-2078f209e1be tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:28.138564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:28.139363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:28.139843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:28.140220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:28.150812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e3ef056700d45afb052446155174ffd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:28.155189 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:28.155189 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:28.155189 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:28.156647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:28.198883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.199807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.253607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.255572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.262587 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1659/3349] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:28 2022] PATCH /identity/v3/domains/1e3ef056700d45afb052446155174ffd => generated 276 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:28.264262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:28.266892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:28.285473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e13d3-3d72-4378-866b-651e3d255aeb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:28.453331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:28.454033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:28.454326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:28.455468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:28.485436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e3ef056700d45afb052446155174ffd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:28.486770 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:28.486770 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:28.486770 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:28.487688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:28.547238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.559607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e3ef056700d45afb052446155174ffd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.684973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.697128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.700090 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:28.725847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.763351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] The token cache is being invalidate because project 1e3ef056700d45afb052446155174ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:28.763906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.768027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.791999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.804496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.805947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e3ef056700d45afb052446155174ffd', 'request_id': 'req-a3327292-3bb4-431a-a565-ec08c2d77793'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:28.820049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1691/3350] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:28 2022] DELETE /identity/v3/domains/1e3ef056700d45afb052446155174ffd => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:28.825070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:28.844131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1b439-3009-42f4-a3ff-b6bfd0c1bbdc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.045599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.046949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.047348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.047794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.049509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.052033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.159693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.161870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:29.166540 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1660/3351] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:12:28 2022] POST /identity/v3/domains => generated 276 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:29.202829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327292-3bb4-431a-a565-ec08c2d77793 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.281937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.284091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:29.428360 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:29.431737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.432471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.432700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.432980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.434406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.436130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.508051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9382-ac01-4421-baf5-fc77fa5614ef tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.515179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.516076 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1692/3352] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:12:29 2022] PUT /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 138 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:29.518536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.519888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.520334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.521277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.529990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:29.558114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9af0b-07a3-4086-874f-b38fecbb5afb tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.588148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.589088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.589570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.589859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.590570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.591604 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:29.591604 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:29.591604 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:29.593441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.635742 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1693/3353] 10.222.0.16 () {60 vars in 1271 bytes} [Sun Sep 25 01:12:29 2022] PATCH /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 141 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:29.639818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.647320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.649102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.662240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1661/3354] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:29.664828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437cfff-78ee-4eb7-b014-85258b438a3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.678510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.683316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.685236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.688302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.691761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.693457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.699868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1694/3355] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:29 2022] GET /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 141 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:12:29.705905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.724959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb829b-14e0-453f-b357-e5eb02a23725 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.736693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.741097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.742579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.743039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.744927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.747203 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:29.747203 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:29.747203 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:29.749804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.768145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1662/3356] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:29 2022] DELETE /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:29.772514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.787574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd951-7594-4ee7-8c2a-7fc665ffa09e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.794956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.795709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.796096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.796447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.797981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.800560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find any options in domain configuration for domain 3404c0117b004285af8d1d43729edb6a.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 3404c0117b004285af8d1d43729edb6a. Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:29.816011 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 3404c0117b004285af8d1d43729edb6a. Sep 25 01:12:29.816819 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:12:29.820647 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1695/3357] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:29 2022] GET /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 151 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:12:29.822077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.847385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e2e5-4d10-48de-80aa-872ba4729359 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.854349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.855182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.855577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.855963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a/config` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.856720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.858722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.866619 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1663/3358] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:29 2022] DELETE /identity/v3/domains/3404c0117b004285af8d1d43729edb6a/config => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:29.872265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:29.890240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a428-67dd-4fb9-b423-4ee5b7a33b67 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:29.897081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:29.897953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:29.898340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:29.898722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:29.900138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:29.901601 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:29.901601 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:29.901601 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:29.902899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:29.965100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:29.967992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.064798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.066591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.070655 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1696/3359] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:29 2022] PATCH /identity/v3/domains/3404c0117b004285af8d1d43729edb6a => generated 277 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:30.074761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:30.076972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:30.094737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2267-078f-4d4f-b49d-9e2bbbccf4ab tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:30.196067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:30.196803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:30.197105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:30.197389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:30.215010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3404c0117b004285af8d1d43729edb6a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:30.216263 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:30.216263 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:30.216263 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:30.217506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:30.252006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.260521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3404c0117b004285af8d1d43729edb6a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.303373 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:30.359176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.368067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.403773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.428142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] The token cache is being invalidate because project 3404c0117b004285af8d1d43729edb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:30.428461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.429271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.446833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.455443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.459218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3404c0117b004285af8d1d43729edb6a', 'request_id': 'req-2b4ff459-f623-41bb-b9b4-62e0342f7bea'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:30.474737 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1664/3360] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:30 2022] DELETE /identity/v3/domains/3404c0117b004285af8d1d43729edb6a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:30.482068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:30.496631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6db61-6853-4009-8002-9abfdac654f2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:30.503200 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:30.659081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:30.659986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:30.660279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:30.660775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:30.662345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:30.663595 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:30.663595 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:30.663595 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:30.664836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:30.724013 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1697/3361] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:12:30 2022] POST /identity/v3/domains => generated 277 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:30.729991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:30.735348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:30.772312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff459-f623-41bb-b9b4-62e0342f7bea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.049518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.050768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.053480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.054162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.056383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f9265153600340349b0accaffa6b43b0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.061838 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:31.061838 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:31.061838 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:31.063072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.165132 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1665/3362] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:12:30 2022] PUT /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config => generated 138 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:31.169191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.186385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d064f8-4d27-4beb-97b8-840ee5916090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.200411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.201099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.201389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.201697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.202919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.213449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.280298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1698/3363] 10.222.0.16 () {60 vars in 1297 bytes} [Sun Sep 25 01:12:31 2022] PATCH /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity => generated 176 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:31.284969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.304472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf576d5f-216f-4a21-8bff-36d5174d786c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.308879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.309654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.310025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.310334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.311064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity, option=driver)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.312390 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:31.312390 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:31.312390 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:31.313514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.344452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1666/3364] 10.222.0.16 () {60 vars in 1318 bytes} [Sun Sep 25 01:12:31 2022] PATCH /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver => generated 176 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:12:31.349080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.362058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4f285-d46a-4fd5-a2ba-9c9c9a4537ca tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.367208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.367883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.368165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.368442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.369292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity, option=driver)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.371062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.417978 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1699/3365] 10.222.0.16 () {58 vars in 1299 bytes} [Sun Sep 25 01:12:31 2022] DELETE /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:31.421782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.438464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26f0c-dcde-4638-a141-38f7ee1ad0de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.478322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.478322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.478322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.485118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.490442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity, option=driver)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.499919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find option driver in group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0. Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:31.565311 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0. Sep 25 01:12:31.566481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:31.568729 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1667/3366] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:12:31 2022] GET /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity/driver => generated 171 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:12:31.572925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.623653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe497a0-971e-4c3a-8609-eec630936ff9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.635919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.637065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.637571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.638088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.639327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.644357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.670174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1700/3367] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:12:31 2022] DELETE /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:31.671928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.693307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1233a-409b-40cc-aa73-4220ae2c287f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.701833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.702899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.703356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.703803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.706612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f9265153600340349b0accaffa6b43b0, group=identity)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.709452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0. Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:31.729836 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain f9265153600340349b0accaffa6b43b0. Sep 25 01:12:31.730976 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:31.737499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1668/3368] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:12:31 2022] GET /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config/identity => generated 154 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:12:31.739412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.757781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e0a8c-6eb4-4725-b35e-863388ac3f87 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.777199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.779237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.779791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.780558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0/config` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.781705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f9265153600340349b0accaffa6b43b0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.785951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.812738 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1701/3369] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:31 2022] DELETE /identity/v3/domains/f9265153600340349b0accaffa6b43b0/config => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:31.815310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:31.841187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c54de-3186-4dd6-88b2-a8022f7df086 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:31.854873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:31.857266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:31.857975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:31.860511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:31.864594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f9265153600340349b0accaffa6b43b0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:31.867970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:31.893580 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:31.931827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:31.933369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.001292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.001734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.006739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1669/3370] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:31 2022] PATCH /identity/v3/domains/f9265153600340349b0accaffa6b43b0 => generated 278 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:32.012033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.015090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:32.031302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4d0a3-65bb-4b9c-b701-b3cbc6daa577 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.134640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.135405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.135802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.136178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.159826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f9265153600340349b0accaffa6b43b0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.163080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.203050 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:32.224289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.229872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f9265153600340349b0accaffa6b43b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.420169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.438205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.449212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.474400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] The token cache is being invalidate because project f9265153600340349b0accaffa6b43b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:32.476333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.477310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.518856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.524372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.525773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f9265153600340349b0accaffa6b43b0', 'request_id': 'req-968c284f-3f80-4daf-a26c-22731d445c42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:32.540228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1702/3371] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:32 2022] DELETE /identity/v3/domains/f9265153600340349b0accaffa6b43b0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:32.541916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.553559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fec461-8c0b-4ee1-a466-602b4b3cddfc tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.683389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.684601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.684601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.684601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.685294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.686743 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:32.686743 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:12:32.686743 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:32.687580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.695972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1670/3372] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:32.697726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.700485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:32.741601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c284f-3f80-4daf-a26c-22731d445c42 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.762176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.764359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.764793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.765137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.765689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.771210 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:32.771210 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:32.771210 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:32.772154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.777488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.779108 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1703/3373] 10.222.0.16 () {58 vars in 1200 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:32.792727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2d79-f330-4f07-8a9e-fecce02bbba8 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.807634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.812381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.812660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.812937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.813592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.815772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.816921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1671/3374] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 25 01:12:32.821432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.838890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb8ec-10ea-4ec5-8f93-e2bb97e21139 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.844442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.845888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.846349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.846728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.848754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.850940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.852719 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1704/3375] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:32.858102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.898875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe191f-b7af-41d2-b003-764730a44e39 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.906559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.907212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.907567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.907797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.909607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.926810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.928969 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1672/3376] 10.222.0.16 () {58 vars in 1188 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:32.934537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.951910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d134b2-64be-422a-bbf0-ede5fa12299b tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.960314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.961000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.961283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.961592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.962187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.963962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.968724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1705/3377] 10.222.0.16 () {58 vars in 1200 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:32.969888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:32.984271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e04ad-0e3d-40d8-afec-34616d6ec4f9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:32.990320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:32.990976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:32.991441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:32.991768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:32.992393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:32.994368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:32.995804 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1673/3378] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.000653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.025508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbf04c-ab18-4be3-91f3-2ee45d208075 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.033056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.034012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.034303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.034600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.035175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.036970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.041604 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1706/3379] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:12:32 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.042877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.055779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3d14-c7e5-4995-8b38-94a4bdd278d5 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.065397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.065397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.065831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.066102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.067333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.069932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.074076 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1674/3380] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.075415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.113485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978d54-4b41-42ab-84f5-ff722cff4b8d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.128745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.130481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.130664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.131202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.132930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.138217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.143365 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1707/3381] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.144543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.157734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e99f9e-0031-4692-991b-77e8a8726e2a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.167807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.168401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.168689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.168967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.169609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.171262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.175940 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1675/3382] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.177474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.190507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c895a6-b48e-4248-9123-489fe248cf97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.197139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.197870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.198154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.198430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.199067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.200672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.204922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1708/3383] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.206585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.231517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03af89-7697-4962-9d2d-7e1fbe820c24 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.244548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.245589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.245589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.245799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.246393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.248153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.253011 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1676/3384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.254146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.269321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e8be0-03a8-4fa8-96e4-b212f3420184 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.291506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.292240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.292446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.292724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.293317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.295045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.297638 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1709/3385] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.301221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.312747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11e3d8-5f96-413a-b3d1-0e5913644a41 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.325127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.325905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.326267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.326624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.327441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.330036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.334256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1677/3386] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.335821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.348228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9eb72-ad2e-4b30-8839-bf917fa691ec tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.353824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.355059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.355428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.355786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.356585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.358529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.363558 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1710/3387] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.365065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.380193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000de95-0573-4945-af7b-28c6048afe97 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.386471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.387214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.387576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.387938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.388605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.390630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.395583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1678/3388] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.396444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.408063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1330-5714-485e-985b-c3eda0a7cd1e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.413641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.414466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.420068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.425616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.426299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.428053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.432203 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1711/3389] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.433441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.445030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04629daa-506b-4d0c-a3cd-0d06e671be3c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.450759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.451424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.451903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.452322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.452919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.454636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.455972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1679/3390] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.461006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.471772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecafdb-2637-4964-9895-fe12f1abf6c6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.478649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.479320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.479608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.479886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.480487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.482140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.485441 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1712/3391] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.488398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.507972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1406e-fa0e-4374-9571-05ca4a15904d tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.515456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.516416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.516534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.517167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.518482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.520141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.524672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1680/3392] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.527074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.539210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fd247-28a4-426e-a4c4-72453d3feb19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.546567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.547576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.548078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.549073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.550239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.552209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.553725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1713/3393] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.558657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.575297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b564a-c96c-4d89-acea-6651c715bc82 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.581775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.582559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.582848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.583134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.584468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.585562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.589452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1681/3394] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.591346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.605636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457253c-4cf9-4241-9b83-85adde1e7733 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.614472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.615243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.615601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.615959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.618563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.620703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.622700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1714/3395] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.628190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.660904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b482d3-b5bb-44fd-b37f-56203162ba5c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.674297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.675873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.675873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.675873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.679536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.681417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.682596 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1682/3396] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.686993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.710058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2202-7494-4b51-aaa9-d18f01d1972a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.764263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.764995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.765278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.765602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.766198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.768346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.770538 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1715/3397] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.777642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.804069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0529-a0d9-47fc-ad6a-826026194e49 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.809690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.810329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.810629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.810881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.811457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.813532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.815754 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1683/3398] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.821843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.839423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad90e28-5e16-404c-b71d-b20a1e6167de tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.846764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.847467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.847746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.848084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.848706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.850210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.851578 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1716/3399] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.856565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.871887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df1eb-ee80-4699-ba11-28001bf2732c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.878056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.878828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.879332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.880598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.880598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.882687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.887048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1684/3400] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.888580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.901723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20e2d-38a2-44e9-b097-6ccad2bbcdd1 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.905255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.908162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:33.918205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.919241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.919601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.920554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.921266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.923156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.926505 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1717/3401] 10.222.0.16 () {58 vars in 1308 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.930482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.951952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014f6b-d4f5-415b-9533-7b07dfaab66a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:33.962679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:33.963671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:33.964817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:33.965607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:33.966419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:33.978537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:33.982974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1718/3402] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:33.984629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:33.998297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ccd4-c599-4ea9-a097-16922e9102a2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.004667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.005744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.006315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.006932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.007201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6255b-36f3-47cf-b114-51a6bfb9d0f3 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.008099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.010583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.016288 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1719/3403] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:33 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.024803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.026682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.027467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.030525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.031049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] PATH_INFO: `/v3/users/a0ab066b8b314936b036e1cde20e17c0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.037212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ab066b8b314936b036e1cde20e17c0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.039427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.040951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cd90d-b959-4069-af7d-16483c7f468c tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.048618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.049308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.049634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.049918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.050523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.052360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.057599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1720/3404] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.058976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.069829 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:34.072863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15126-a8ac-4184-870d-6a088abfa9fd tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.087833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.088770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.089766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.090055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.091088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.092854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.097791 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1721/3405] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.101229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.144783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13340a-6c01-4d89-9be0-5be73f0f7e62 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.162322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ab066b8b314936b036e1cde20e17c0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.163520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ab066b8b314936b036e1cde20e17c0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.169323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.170220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.171289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.171748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.173131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.173629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ab066b8b314936b036e1cde20e17c0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.177746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.187207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1722/3406] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.188652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.193372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:34.195183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ab066b8b314936b036e1cde20e17c0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.195969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ab066b8b314936b036e1cde20e17c0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.216740 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1685/3407] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:33 2022] DELETE /identity/v3/users/a0ab066b8b314936b036e1cde20e17c0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:34.244151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a832-4033-41ba-b9ac-cd1593073a19 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.290129 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:34.358064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.358628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.358990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.359176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.359802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.363237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.365047 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1723/3408] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 25 01:12:34.369757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.388874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463b46-9daf-4a1d-94e4-88ba6f90f85c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.392337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.394121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.394695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.394831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.395548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.397499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.400287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1686/3409] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.404252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.442104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0688-8f39-4ffc-86a7-101b756f9923 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.450517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.451386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.451681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.452141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.453287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.454683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.460038 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1724/3410] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.463393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.497178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3038-3c43-40c6-81cc-512330008090 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.511056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.511734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.512021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.512297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.512930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.514636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.517477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1687/3411] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.520455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.535915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ed49-3740-43aa-a49a-e50e5ae2b347 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.541112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.541772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.542175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.542457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.543055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.544681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.549453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1725/3412] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.551157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.563087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d09b-a652-4d1a-ab78-295f1cc1d969 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.572543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.573350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.573830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.574281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.582950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.585075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.590505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.598339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1688/3413] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.603896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7c6a4-363d-4190-b329-ecfb475deea9 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.610602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.612078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.615913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.615913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.615913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.616646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.618344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1726/3414] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.622517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.638162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.639451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e8e07-5844-4159-915c-960a6f813c48 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.642028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:34.652859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.658684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.659830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.660396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.662629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.664363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.676688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1689/3415] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.677799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.700446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71461-c046-4054-9d11-5842003e5cad tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.717763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.718712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.722290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.722784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.726033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.729663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.734045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1690/3416] 10.222.0.16 () {58 vars in 1212 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:34.738687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.782191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b80fd-cd6c-4499-8f66-99a8054d416a tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.790706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.791548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.791832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.792315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] PATH_INFO: `/v3/users/829a6360f61f4d47afc21aac640b9c2e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.797205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=829a6360f61f4d47afc21aac640b9c2e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.799971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.801616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2bce-c787-46ad-87e0-d4548d0b22d6 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.812379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.812920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.813209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.813524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.819234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.820967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.825105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1691/3417] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 25 01:12:34.825105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.826001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:34.855217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc65f3-d74b-40e8-b68c-9b32b9ec7e08 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:34.875875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:34.884231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:34.884753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:34.885243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] PATH_INFO: `/v3/projects/985a702f5bbd4fe581b4cd6d1745edf9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:34.890687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985a702f5bbd4fe581b4cd6d1745edf9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:34.891818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829a6360f61f4d47afc21aac640b9c2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.894468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:34.902985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829a6360f61f4d47afc21aac640b9c2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.921006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829a6360f61f4d47afc21aac640b9c2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.921747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829a6360f61f4d47afc21aac640b9c2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.922811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829a6360f61f4d47afc21aac640b9c2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.944645 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1727/3418] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:34 2022] DELETE /identity/v3/users/829a6360f61f4d47afc21aac640b9c2e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:34.946298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:34.947987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:34.987387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985a702f5bbd4fe581b4cd6d1745edf9', 'request_id': 'req-54abc83c-798b-4c51-8723-0526aa63acd3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:34.996975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985a702f5bbd4fe581b4cd6d1745edf9', 'request_id': 'req-54abc83c-798b-4c51-8723-0526aa63acd3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.010379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985a702f5bbd4fe581b4cd6d1745edf9', 'request_id': 'req-54abc83c-798b-4c51-8723-0526aa63acd3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.013082 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:35.027656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] The token cache is being invalidate because project 985a702f5bbd4fe581b4cd6d1745edf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:35.028259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.029237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.031763 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1692/3419] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:34 2022] DELETE /identity/v3/projects/985a702f5bbd4fe581b4cd6d1745edf9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:35.037009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.038312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.054153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368c5a-2e15-4e6d-80c4-e1b57a73f10c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.101046 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:35.119615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc83c-798b-4c51-8723-0526aa63acd3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.125904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.127348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.127625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.128178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] PATH_INFO: `/v3/users/dcd5e1e7009441c882b446e43722da34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.129392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd5e1e7009441c882b446e43722da34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.130197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.131439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.132372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.133589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.134186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.134988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.136826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.138523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1728/3420] 10.222.0.16 () {58 vars in 1215 bytes} [Sun Sep 25 01:12:34 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.146544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.149739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.168247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb7d-9094-4659-ac76-11d6c982feea tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.174556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.175443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.175734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.176014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.177082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.178868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.181150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1729/3421] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.185954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.196885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798d3d6-0d55-4cb7-8fc3-13e81098f89f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.202281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.202941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.203284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.203510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.204183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.205443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd5e1e7009441c882b446e43722da34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.206013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.206291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd5e1e7009441c882b446e43722da34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.207427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1730/3422] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.211509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.213954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.214768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd5e1e7009441c882b446e43722da34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.228751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd5e1e7009441c882b446e43722da34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.229618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd5e1e7009441c882b446e43722da34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.230790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd87bd-2ada-4f77-b006-1607f31d750f tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.243029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.243607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.243915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.244192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.244790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.246855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.251323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1731/3423] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 25 01:12:35.253002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.254589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1693/3424] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:35 2022] DELETE /identity/v3/users/dcd5e1e7009441c882b446e43722da34 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:35.265373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-3536-43f1-ba62-f3a35ee01110 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.331963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.332903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.333177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.333491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.334085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.335717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.339934 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1732/3425] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.342142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.365458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42179341-883b-4ae8-8c45-a913da98298e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.370865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.371604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.371963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.372321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.374220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.374900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.379851 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1694/3426] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.381220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.416617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03817b-30f5-4279-bafc-f58902d58a51 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.417587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.418354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.419220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.419220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.419509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.421193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.425273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1733/3427] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.427477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.438215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1eb30-040a-457b-9d6d-cb61b624a576 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.444130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.444973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.445265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.445721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.446323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.447978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.449103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1695/3428] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.453394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.467554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f36c2-2d96-4204-af51-cfa06f1ed83e tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.473294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.474101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.474384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.474664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.475913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.477056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.481450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1734/3429] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:12:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:35.484982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.498259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f32d-8327-442c-8f5e-52b7a49e7ed2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.513629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.513629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.515774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.516429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.517264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.518114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/f9265153600340349b0accaffa6b43b0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.526740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find domain: f9265153600340349b0accaffa6b43b0.: keystone.exception.DomainNotFound: Could not find domain: f9265153600340349b0accaffa6b43b0. Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9265153600340349b0accaffa6b43b0. Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:35.540373 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:35.541518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:12:35.542382 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9265153600340349b0accaffa6b43b0. Sep 25 01:12:35.543482 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.543482 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1696/3430] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:35 2022] PATCH /identity/v3/domains/f9265153600340349b0accaffa6b43b0 => generated 112 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:12:35.546332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.557652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62913-2b90-44df-9e79-d9ebe9b2a333 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.562760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.563213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.563850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.563850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/3404c0117b004285af8d1d43729edb6a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.583944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find domain: 3404c0117b004285af8d1d43729edb6a.: keystone.exception.DomainNotFound: Could not find domain: 3404c0117b004285af8d1d43729edb6a. Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3404c0117b004285af8d1d43729edb6a. Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:35.589648 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:35.590576 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:12:35.591406 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3404c0117b004285af8d1d43729edb6a. Sep 25 01:12:35.592461 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.594768 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1697/3431] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:35 2022] PATCH /identity/v3/domains/3404c0117b004285af8d1d43729edb6a => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:12:35.596995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.609553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff7203-ee4b-4991-9a88-7bdb615f5571 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.615653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac8c23b872749558d6ab78fda396408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f7804cf06b1415d898033a81a3404c8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.616289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.616609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.616872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] PATH_INFO: `/v3/domains/1e3ef056700d45afb052446155174ffd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.624664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:12:35.629284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f72e-cfa1-4cbc-81a0-57bbc494b982 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Could not find domain: 1e3ef056700d45afb052446155174ffd.: keystone.exception.DomainNotFound: Could not find domain: 1e3ef056700d45afb052446155174ffd. Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1e3ef056700d45afb052446155174ffd. Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:35.630835 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:35.631806 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:12:35.632740 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1e3ef056700d45afb052446155174ffd. Sep 25 01:12:35.633704 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:12:35.633704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1698/3432] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:12:35 2022] PATCH /identity/v3/domains/1e3ef056700d45afb052446155174ffd => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:12:35.636170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.638435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.638981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.639671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.639954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.640233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] PATH_INFO: `/v3/projects/becc007596364d5fac8bf17571458d83` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.641395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=becc007596364d5fac8bf17571458d83)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.644453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.653981 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:35.654559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05b7d-d62a-44c8-8cc3-e0df50ec85c2 tempest-DomainConfigurationTestJSON-1820912289 tempest-DomainConfigurationTestJSON-1820912289-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.662812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.663456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.663735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.664034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] PATH_INFO: `/v3/users/7456ca6479564821bcefcf411f86bf13` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.667679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7456ca6479564821bcefcf411f86bf13)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.669682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.722402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becc007596364d5fac8bf17571458d83', 'request_id': 'req-58ac5012-24d3-4214-beae-d5b7080cf4f4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.730745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becc007596364d5fac8bf17571458d83', 'request_id': 'req-58ac5012-24d3-4214-beae-d5b7080cf4f4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.748402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becc007596364d5fac8bf17571458d83', 'request_id': 'req-58ac5012-24d3-4214-beae-d5b7080cf4f4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.749054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7456ca6479564821bcefcf411f86bf13'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.749947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7456ca6479564821bcefcf411f86bf13'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.759173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7456ca6479564821bcefcf411f86bf13'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.768922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] The token cache is being invalidate because project becc007596364d5fac8bf17571458d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:35.769198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.769972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58ac5012-24d3-4214-beae-d5b7080cf4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.772455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1735/3433] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:35 2022] DELETE /identity/v3/projects/becc007596364d5fac8bf17571458d83 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:35.775800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7456ca6479564821bcefcf411f86bf13'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.776556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-823f4abf-b443-4638-880c-b925c0c09abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7456ca6479564821bcefcf411f86bf13'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:35.777347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.777940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.778212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.811636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1699/3434] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:35 2022] DELETE /identity/v3/users/7456ca6479564821bcefcf411f86bf13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:35.818771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b401a-a917-4663-ad12-eeeaad618366 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.818885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b401a-a917-4663-ad12-eeeaad618366 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.819114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b401a-a917-4663-ad12-eeeaad618366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.820561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:35.824207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.829955 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:35.866812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8c0b401a-a917-4663-ad12-eeeaad618366 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:35.868619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c0b401a-a917-4663-ad12-eeeaad618366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.919953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1736/3435] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:35.920713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:35.926358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:35.946515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb02e-0b88-4aca-92b9-09195a07c020 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:35.957449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:35.958102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.958384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.958659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] PATH_INFO: `/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:35.960142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc73235b39ca4ab3ba34ec0762ef2130)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:35.962513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:35.977711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1700/3436] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:35.979564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dc03-7c55-457b-9094-239ea8316612 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:35.979920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dc03-7c55-457b-9094-239ea8316612 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:35.980268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dc03-7c55-457b-9094-239ea8316612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.006030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-beb2dc03-7c55-457b-9094-239ea8316612 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:36.007601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-beb2dc03-7c55-457b-9094-239ea8316612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.028339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc73235b39ca4ab3ba34ec0762ef2130', 'request_id': 'req-f0070957-e056-4540-9ca5-cb2735de98b7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.037936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc73235b39ca4ab3ba34ec0762ef2130', 'request_id': 'req-f0070957-e056-4540-9ca5-cb2735de98b7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.045523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc73235b39ca4ab3ba34ec0762ef2130', 'request_id': 'req-f0070957-e056-4540-9ca5-cb2735de98b7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.064776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] The token cache is being invalidate because project fc73235b39ca4ab3ba34ec0762ef2130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:36.065141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.065871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.070865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1737/3437] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:35 2022] DELETE /identity/v3/projects/fc73235b39ca4ab3ba34ec0762ef2130 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:36.070865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.070865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.086203 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1701/3438] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:36.087458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.087687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.087931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.102209 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:36.113844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:36.115163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.132060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1702/3439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:36.132060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.143667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812bb8f-e07d-4a46-b6b9-6a4ac16cade2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.150885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.151502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.151777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.152047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.152699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:36.152994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.154640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b654ad7-9d23-4d99-9eec-b0125983c521 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.163023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0070957-e056-4540-9ca5-cb2735de98b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.167263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.168123 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1703/3440] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:36.168262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.169164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.169477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.169755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.170127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.170591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.174049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.191623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.192777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:36.193490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.194422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.203434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1704/3441] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:36.204568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.216385 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1738/3442] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:36.217354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876ca9-f29b-434e-be2b-4ad1f13b8526 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.219164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.228165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.228841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.229272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.229717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.230426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.232802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.239137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c9dd-2453-4a8a-9142-a58cecd7a095 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.256369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.257566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.257820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.258182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.258916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:36.259292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.261278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.302946 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1739/3443] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:36.307293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.328341 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1705/3444] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:36.328538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee78ed-9d03-49b2-8f0b-2e52b2afe512 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.330041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.435988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.436609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.436889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.437164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.437837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.441033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.475323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1740/3445] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:36.480050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.497152 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:36.506731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2c70-d02d-4601-9311-36d7fac74054 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.672527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2dae-0833-4040-8868-d35af67aaed9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.694712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.697278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.698682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.700590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.702086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.702843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.703823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.704651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.704651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.705833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.708387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.709524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.748824 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1741/3446] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:36.750616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.753486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.765264 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1706/3447] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:36 2022] POST /identity/v3/users => generated 290 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:36.770003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.770278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dadda-c19d-4c31-b1bc-ac66caa5802e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.777572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.778385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.778645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.779067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] PATH_INFO: `/v3/projects/eec1319e579e4320b8dcc92ea5cf7497` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.780273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec1319e579e4320b8dcc92ea5cf7497)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.782253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6984-5abe-4ca8-9d5c-81cd7d540627 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.782915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.789930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.790924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.791072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.791467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.792300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.794935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.810177 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1707/3448] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:36.811396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.816639 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:36.826691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f99f8d-b3c0-4044-87f9-e6900ec9659a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.845604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.845604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.845604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.845604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.846012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.846012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.852558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1708/3449] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:36.852558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.870229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799c0d4-2e08-4750-ba8b-da4e6cd4404b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.874549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec1319e579e4320b8dcc92ea5cf7497', 'request_id': 'req-6f027495-e794-4cb9-8f48-3882d5c31b90'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.884814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec1319e579e4320b8dcc92ea5cf7497', 'request_id': 'req-6f027495-e794-4cb9-8f48-3882d5c31b90'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.893192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec1319e579e4320b8dcc92ea5cf7497', 'request_id': 'req-6f027495-e794-4cb9-8f48-3882d5c31b90'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.925570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] The token cache is being invalidate because project eec1319e579e4320b8dcc92ea5cf7497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:36.925570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.927648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:36.932344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1742/3450] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:36 2022] DELETE /identity/v3/projects/eec1319e579e4320b8dcc92ea5cf7497 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:36.936082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.941644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.958763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:36.959665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:36.959959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:36.960237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:36.960890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:36.963324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:36.980246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1709/3451] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:36.981174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:36.983115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:36.987394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f027495-e794-4cb9-8f48-3882d5c31b90 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:36.996747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fe6f-5d48-46c2-baa2-a4837f9d387a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:37.002990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.003936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.004467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.004964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.006183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.008872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.011673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.012709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.013195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.013730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] PATH_INFO: `/v3/users/fac8c23b872749558d6ab78fda396408` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.015378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac8c23b872749558d6ab78fda396408)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.019189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.038258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1743/3452] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:37.039129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:37.044697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.075878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0282f-3c5b-4ab0-929b-4579b89c47ae admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:37.088112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.089444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.090101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac8c23b872749558d6ab78fda396408'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.090618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.090955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] PATH_INFO: `/v3/projects/46ae8b5de3254713b60172f6c0b351e1/users/5db19a97588e41d1858915c9ccc48620/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.091684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac8c23b872749558d6ab78fda396408'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.102959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac8c23b872749558d6ab78fda396408'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.110629 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:37.119765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae8b5de3254713b60172f6c0b351e1, user_id=5db19a97588e41d1858915c9ccc48620, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.127024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.132621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac8c23b872749558d6ab78fda396408'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.133494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9260ffb2-56de-4fca-8dac-3301f341e05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac8c23b872749558d6ab78fda396408'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.156994 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1744/3453] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:37 2022] PUT /identity/v3/projects/46ae8b5de3254713b60172f6c0b351e1/users/5db19a97588e41d1858915c9ccc48620/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:37.158903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:37.176683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.178340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1710/3454] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:36 2022] DELETE /identity/v3/users/fac8c23b872749558d6ab78fda396408 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:37.182305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.185012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.185181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.288804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] MFA Rules not processed for user `5db19a97588e41d1858915c9ccc48620`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:37.291679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.381331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164320-21b3-46af-a075-e16fa13271ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:37.518276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1711/3455] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:37.524175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:37.526581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.553605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.556090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.556090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.556913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] PATH_INFO: `/v3/projects/99bc91409fe24f088ae6a51eff7381e1/users/38e3ca9f263a437ab752007ef0588edc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.623611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bc91409fe24f088ae6a51eff7381e1, user_id=38e3ca9f263a437ab752007ef0588edc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.638065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.670698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1745/3456] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:37 2022] PUT /identity/v3/projects/99bc91409fe24f088ae6a51eff7381e1/users/38e3ca9f263a437ab752007ef0588edc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:37.672022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:37.680277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.692824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5023b7-22f0-49db-8590-7d58ee4a089e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:37.695315 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:37.823538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138076e6-eb8b-4d9e-98ba-93ac7134e789 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:37.838135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.839456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.839740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.839898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:37.840011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.840821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.841081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.841553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.841990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] PATH_INFO: `/v3/projects/3f7804cf06b1415d898033a81a3404c8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.842838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403c091-efad-4710-9354-a514302a9187 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.843584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7804cf06b1415d898033a81a3404c8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:37.846624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:37.880717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1712/3457] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:37 2022] POST /identity/v3/projects => generated 373 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:37.883419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb130f6-f992-4af9-884d-f00c923de3b2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:37.884404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb130f6-f992-4af9-884d-f00c923de3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:37.885149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb130f6-f992-4af9-884d-f00c923de3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:37.895604 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:37.914818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4bb130f6-f992-4af9-884d-f00c923de3b2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:37.916243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4bb130f6-f992-4af9-884d-f00c923de3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:37.928051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7804cf06b1415d898033a81a3404c8', 'request_id': 'req-285a9266-f272-4ce0-9f87-fc392a17ca87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.935356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7804cf06b1415d898033a81a3404c8', 'request_id': 'req-285a9266-f272-4ce0-9f87-fc392a17ca87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.942430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7804cf06b1415d898033a81a3404c8', 'request_id': 'req-285a9266-f272-4ce0-9f87-fc392a17ca87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.959712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] The token cache is being invalidate because project 3f7804cf06b1415d898033a81a3404c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:37.960025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.960922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:37.966173 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1746/3458] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:37 2022] DELETE /identity/v3/projects/3f7804cf06b1415d898033a81a3404c8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:37.966173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:37.966173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:38.009467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1713/3459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:38.017749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.019290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.019763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.053567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:38.054981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:38.067533 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1714/3460] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:38.068466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.069955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:38.082685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9266-f272-4ce0-9f87-fc392a17ca87 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.088773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.089703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.090292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.090723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.091555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.093812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85fee-7e67-4762-871e-4e4f41c0e3db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.121715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1747/3461] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:37 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:38.126880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.127271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.127551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.152000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:38.153256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:38.164541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b64f-ad36-4de1-9338-b97d1e9e4071 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.169941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1748/3462] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:38.169941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.175605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.176550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.176838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.177118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.194058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.196214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.212971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1715/3463] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:38.215559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc79d6-83ac-43e1-a223-c4bab2d20f88 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.224430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.225460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.225935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.226387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.226500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.227547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.231051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.250760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4068-e59e-4b8f-87ef-d0d9e413a793 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.257084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.257753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.258526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.258810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.259476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:38.259781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.261915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.263278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1749/3464] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:38.265340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.299495 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:38.307576 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1716/3465] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:38.313086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.319073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0b9d-aa10-402f-9c10-19dcdea3a850 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.335286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.338449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.338946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.341695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] PATH_INFO: `/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb/users/231418d4fb2246adb38aaeefb031655e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.351323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891c41-ed68-44d0-90a4-8fc54afcd8aa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.371301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.372296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.372770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.373254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.374373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.397561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.410819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7569ed03c4fc4fd5a6e987cf82ea14fb, user_id=231418d4fb2246adb38aaeefb031655e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.443485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.483228 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1717/3466] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:38.484169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.493078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1750/3467] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:38 2022] PUT /identity/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb/users/231418d4fb2246adb38aaeefb031655e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:38.494812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.625933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187c766-0d3d-4207-ac99-a6e57a2491cf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.631837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6cfa-d492-495d-91c8-08eade0f846b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.632849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.633723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.634099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.634525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.635500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.637279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.650013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.650649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.650981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.651769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.652433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.662852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.665048 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1751/3468] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:38.668913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.689347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8cf-8e60-49c1-ba3a-75cad1307445 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.692278 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:38.699722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.700605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.700843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.701113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] PATH_INFO: `/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb/users/231418d4fb2246adb38aaeefb031655e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.707657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7569ed03c4fc4fd5a6e987cf82ea14fb, user_id=231418d4fb2246adb38aaeefb031655e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.711010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4b48e-1268-4cfc-9d87-469773866eab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.719158 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1718/3469] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:38 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:38.724137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.741207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1752/3470] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:38 2022] PUT /identity/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb/users/231418d4fb2246adb38aaeefb031655e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:38.746902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28fea6-7605-4761-be07-6e0811b5487e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.753530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14198-951f-467a-8b81-b03c1c97262d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.754180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14198-951f-467a-8b81-b03c1c97262d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.754493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14198-951f-467a-8b81-b03c1c97262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.808859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cfe14198-951f-467a-8b81-b03c1c97262d None None] MFA Rules not processed for user `231418d4fb2246adb38aaeefb031655e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:38.810518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfe14198-951f-467a-8b81-b03c1c97262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:38.834733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.835630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.836222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.836823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.837693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.839800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.855166 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1719/3471] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:38.859772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.878815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6f08-0484-46fc-a58a-af9d5cdcd2d4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.887556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.888753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.889247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.890052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:38.890948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:38.894404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:38.930865 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1720/3472] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:38.934693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:38.958869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434f98f-40f7-498f-96ef-6c40a4ccba44 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:38.978385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:38.979290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:38.979676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:38.980538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] PATH_INFO: `/v3/projects/f3e3c1747791481db08c8881f4f831da/users/9822eb4c1d5d401bb52cd264616aa2f1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.012239 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1753/3473] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:39.020942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e3c1747791481db08c8881f4f831da, user_id=9822eb4c1d5d401bb52cd264616aa2f1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.030066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d7453-6729-441e-9145-59705c350446 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.030739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.031032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.031311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.067271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] MFA Rules not processed for user `5db19a97588e41d1858915c9ccc48620`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:39.071607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:39.074612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1721/3474] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:38 2022] PUT /identity/v3/projects/f3e3c1747791481db08c8881f4f831da/users/9822eb4c1d5d401bb52cd264616aa2f1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:39.093736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.093736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.093736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.149986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] MFA Rules not processed for user `9822eb4c1d5d401bb52cd264616aa2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:39.151469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:39.182304 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:39.222736 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1754/3475] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:39.248669 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1722/3476] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:39.253664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.348647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c678f54-6932-4b5f-81d5-eece13bb264a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:39.356520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:39.357221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.357556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.357882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.358600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.360949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.437231 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1755/3477] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:39.438180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.462110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.466399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:39.468102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab9181-6d30-44de-a6c2-4054285ec6f3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:39.529554 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:39.584492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:39.586658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.587177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.587461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.589958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.592314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.652869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1723/3478] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:39 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:39.656592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.683422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6c236-cc0b-4fc9-ae73-2c9fff2b47a9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:39.686100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b839-210d-4074-ba1f-17c3022bf875 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:39.695375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:39.695889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:39.696018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.696275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.696547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.697211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.697888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.698350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.698573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:39.699391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.701200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.725846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1724/3479] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:39.729150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.748495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7f86-3ecc-48ac-87e4-b7705bd91a18 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:39.773884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:39.775366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:39.775869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:39.776371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] PATH_INFO: `/v3/projects/16ab228e9d67437594864df156c39bc8/users/3fc8c5d8360b47b89dcbb54698cdad40/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:39.803568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab228e9d67437594864df156c39bc8, user_id=3fc8c5d8360b47b89dcbb54698cdad40, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.809727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.844685 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1725/3480] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:39 2022] PUT /identity/v3/projects/16ab228e9d67437594864df156c39bc8/users/3fc8c5d8360b47b89dcbb54698cdad40/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:39.849015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:39.858681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:39.860242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:39.879139 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1756/3481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:40.034975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c29a6-0c11-43ca-8f26-fd6422793fc0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.050071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.051197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.051978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.052475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.053761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.058250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15729e7-3f6e-4a96-87f9-f22da9f00d35 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.084215 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1726/3482] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:40.085953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.099411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd8ee-dfb1-4106-b461-3f6c386d6c1f service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.104818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.105688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.106235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.106610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] PATH_INFO: `/v3/projects/16ab228e9d67437594864df156c39bc8/users/3fc8c5d8360b47b89dcbb54698cdad40/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.108850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab228e9d67437594864df156c39bc8, user_id=3fc8c5d8360b47b89dcbb54698cdad40, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.113140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.133528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1757/3483] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:40 2022] PUT /identity/v3/projects/16ab228e9d67437594864df156c39bc8/users/3fc8c5d8360b47b89dcbb54698cdad40/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:40.148743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.151141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.152429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.201160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] MFA Rules not processed for user `3fc8c5d8360b47b89dcbb54698cdad40`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:40.203148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:40.343096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1727/3484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:40.346274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.353606 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:40.371072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12637-dbfc-4573-a41b-f025f5b95d93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.389050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.390071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.390363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.390646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects/f3e3c1747791481db08c8881f4f831da` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.395396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3e3c1747791481db08c8881f4f831da)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.403426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.410193 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1758/3485] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:40 2022] GET /identity/v3/projects/f3e3c1747791481db08c8881f4f831da => generated 385 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:40.410748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.422430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b428-d7a8-455f-84b4-e731ec1fd389 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.437695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.438334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.438726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.439099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.439985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.442080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.476397 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:40.492534 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1728/3486] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:12:40 2022] POST /identity/v3/projects => generated 338 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:40.496725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.520320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befadda-c070-4c9f-b586-9238d303e61f tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.645135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.646102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.646556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.647737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.648803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.652200 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:40.652200 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:40.652200 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:40.654980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.719636 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1759/3487] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:12:40 2022] GET /identity/v3/projects => generated 6964 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:40.724522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.738584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e298d-3174-4b98-a330-bc2261159102 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.746862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.747947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.748184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.748559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects/f3e3c1747791481db08c8881f4f831da` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.749953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3e3c1747791481db08c8881f4f831da)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.752902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.755713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1729/3488] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:40 2022] GET /identity/v3/projects/f3e3c1747791481db08c8881f4f831da => generated 385 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:12:40.759259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.780949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ae19b-e5be-43db-84ec-4747fdc2a1de tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.792922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.795906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.796513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.796897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects/e91c78da1a0e49b1acfa18598c26065c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.800150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:get_project(project_id=e91c78da1a0e49b1acfa18598c26065c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.805109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:40.811086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1760/3489] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:40 2022] GET /identity/v3/projects/e91c78da1a0e49b1acfa18598c26065c => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:40.814662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:40.883424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44427-4c41-4234-9891-7705456b51d2 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:40.906877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:40.910365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:40.910637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:40.910923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:40.911599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:40.920175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.022445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1730/3490] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:12:40 2022] GET /identity/v3/projects => generated 6964 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:41.029906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.053619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47c41c-9571-41c4-ad13-3d5ab778a90b tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.073965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.086233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.087230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.088739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.101679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:41.102237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.109499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.225633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.233798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1761/3491] 10.222.0.16 () {58 vars in 1166 bytes} [Sun Sep 25 01:12:41 2022] GET /identity/v3/projects?domain_id=default => generated 6633 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:41.246442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bed92-4667-41a3-a77c-ea4293efc114 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.261189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.261861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.262150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.262428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.263080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.269817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.317351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1731/3492] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:12:41 2022] GET /identity/v3/projects => generated 6964 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:41.322933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.335927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804d52-42de-4725-bb7f-73414ec309fe tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.355880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.356693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.357769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.359676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.361067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:41.362286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.368268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.439921 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1762/3493] 10.222.0.16 () {58 vars in 1166 bytes} [Sun Sep 25 01:12:41 2022] GET /identity/v3/projects?domain_id=default => generated 6633 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:41.446340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.475465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cdeb-709e-4081-bd95-d897540eece4 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.487586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.488010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.488297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.488577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.489728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.491174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.540158 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1732/3494] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:12:41 2022] GET /identity/v3/projects => generated 6964 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:41.545210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.566267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35603c-5194-4626-998e-fa048c759183 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.596709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.597372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.598137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.598137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.604288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-82937983) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:41.604604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.607969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.644197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.657268 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1763/3495] 10.222.0.16 () {58 vars in 1228 bytes} [Sun Sep 25 01:12:41 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-82937983 => generated 531 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:41.678986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e907800-fd2b-4d0a-a3dd-dc2044186bbb tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:41.685245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc8c5d8360b47b89dcbb54698cdad40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ab228e9d67437594864df156c39bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:41.685959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:41.686246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:41.686524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] PATH_INFO: `/v3/projects/e91c78da1a0e49b1acfa18598c26065c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:41.687747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e91c78da1a0e49b1acfa18598c26065c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:41.690631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:41.827654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91c78da1a0e49b1acfa18598c26065c', 'request_id': 'req-0f9dfb18-a67b-4acc-b132-567875d72fe3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:41.845965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91c78da1a0e49b1acfa18598c26065c', 'request_id': 'req-0f9dfb18-a67b-4acc-b132-567875d72fe3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:41.857137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.859140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:41.889274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91c78da1a0e49b1acfa18598c26065c', 'request_id': 'req-0f9dfb18-a67b-4acc-b132-567875d72fe3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:41.932282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] The token cache is being invalidate because project e91c78da1a0e49b1acfa18598c26065c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:41.932624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:41.934920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:41.943214 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1733/3496] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:41 2022] DELETE /identity/v3/projects/e91c78da1a0e49b1acfa18598c26065c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:41.954082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:41.958490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:42.083937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885466-b97b-47d5-892f-54cd89419825 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:42.129072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb18-a67b-4acc-b132-567875d72fe3 tempest-ListProjectsStaticTestJSON-627137638 tempest-ListProjectsStaticTestJSON-627137638-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:42.135564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:42.136215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.136601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.136873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] PATH_INFO: `/v3/users/9822eb4c1d5d401bb52cd264616aa2f1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:42.138081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9822eb4c1d5d401bb52cd264616aa2f1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:42.146195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:42.234600 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:42.258690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9822eb4c1d5d401bb52cd264616aa2f1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.259627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9822eb4c1d5d401bb52cd264616aa2f1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.262094 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:42.280104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:42.281178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.282264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9822eb4c1d5d401bb52cd264616aa2f1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.282674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.284237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] PATH_INFO: `/v3/users/33ad1f2d9cd94377b917124fe608112a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:42.287023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ad1f2d9cd94377b917124fe608112a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:42.291249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:42.328348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9822eb4c1d5d401bb52cd264616aa2f1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.329887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a16fad3-7aa0-403a-b324-56954535fb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9822eb4c1d5d401bb52cd264616aa2f1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.384500 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1734/3497] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:41 2022] DELETE /identity/v3/users/9822eb4c1d5d401bb52cd264616aa2f1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:42.395950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.397482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.399423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:42.453219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ad1f2d9cd94377b917124fe608112a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.468321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ad1f2d9cd94377b917124fe608112a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.526707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ad1f2d9cd94377b917124fe608112a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.531551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:42.533885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ad1f2d9cd94377b917124fe608112a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.535856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:42.538705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d1983f97-b556-408b-9f76-654e7520751b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ad1f2d9cd94377b917124fe608112a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:42.586687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1764/3498] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:41 2022] DELETE /identity/v3/users/33ad1f2d9cd94377b917124fe608112a => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:42.590916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.591235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.591532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:42.660239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:42.661534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:42.749175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1735/3499] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:42.781266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:42.788980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:42.834512 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1765/3500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:42.857050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:42.858555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:42.970197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ae37-4d3e-4c70-8ac4-903fa94e0454 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:42.986744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:42.987047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159934ce-5428-40b6-85fa-fa60a14d1e11 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:42.988236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.988524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.988800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:42.995118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:42.995774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:42.996038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:42.996311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:43.031576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:43.032064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:43.033327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:43.035517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:43.053620 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1766/3501] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:43.085998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1736/3502] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:43.598655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:43.601083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:43.621458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eba9a-f7dd-4f5c-b376-fe58629dc3d1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:43.650502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:43.652020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:43.652020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:43.652020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] PATH_INFO: `/v3/projects/82faf0d0b44b443e8da6999cebb3b332` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:43.652972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82faf0d0b44b443e8da6999cebb3b332)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:43.654846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:43.683522 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:43.767726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82faf0d0b44b443e8da6999cebb3b332', 'request_id': 'req-0b9cc12c-0e24-4be0-a302-1f369acbd310'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:43.776418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82faf0d0b44b443e8da6999cebb3b332', 'request_id': 'req-0b9cc12c-0e24-4be0-a302-1f369acbd310'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:43.784959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82faf0d0b44b443e8da6999cebb3b332', 'request_id': 'req-0b9cc12c-0e24-4be0-a302-1f369acbd310'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:43.809302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] The token cache is being invalidate because project 82faf0d0b44b443e8da6999cebb3b332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:43.809851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:43.810619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:43.816488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1767/3503] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:43 2022] DELETE /identity/v3/projects/82faf0d0b44b443e8da6999cebb3b332 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:43.817839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:43.830066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d164-01a7-4ab4-941c-d7a6e29a0346 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:43.943024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:43.943651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:43.943936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:43.944210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] PATH_INFO: `/v3/users/9bbfd75df6464163bed3fecbbb67492f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:43.945829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbfd75df6464163bed3fecbbb67492f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:43.949152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:43.951946 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:44.078049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbfd75df6464163bed3fecbbb67492f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.079132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbfd75df6464163bed3fecbbb67492f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.093757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbfd75df6464163bed3fecbbb67492f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.132019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbfd75df6464163bed3fecbbb67492f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.133310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbfd75df6464163bed3fecbbb67492f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.165777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1737/3504] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:43 2022] DELETE /identity/v3/users/9bbfd75df6464163bed3fecbbb67492f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:44.691126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:44.693608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:44.713662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc12c-0e24-4be0-a302-1f369acbd310 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:44.744970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:44.746500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:44.791942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:44.792899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:44.793474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:44.793917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] PATH_INFO: `/v3/projects/f3e3c1747791481db08c8881f4f831da` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:44.795352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e3c1747791481db08c8881f4f831da)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:44.797532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:44.881220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e3c1747791481db08c8881f4f831da', 'request_id': 'req-761e445a-8330-42fe-8ee4-2d09835ffe74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.898225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e3c1747791481db08c8881f4f831da', 'request_id': 'req-761e445a-8330-42fe-8ee4-2d09835ffe74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.913442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f20c-cc53-42a9-8b73-d5b8313f356f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:44.914824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e3c1747791481db08c8881f4f831da', 'request_id': 'req-761e445a-8330-42fe-8ee4-2d09835ffe74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.937294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] The token cache is being invalidate because project f3e3c1747791481db08c8881f4f831da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:44.937617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.944340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:44.949846 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1768/3505] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:44 2022] DELETE /identity/v3/projects/f3e3c1747791481db08c8881f4f831da => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:44.951414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:44.952862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:45.026913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:45.029572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.030880 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:45.031683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.036287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] PATH_INFO: `/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.041887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e54bfd8ef744a20b2d010fb073f6fc2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:45.046937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:45.120695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e445a-8330-42fe-8ee4-2d09835ffe74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:45.122723 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:45.134652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:45.135529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.135858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.136265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] PATH_INFO: `/v3/users/3fc8c5d8360b47b89dcbb54698cdad40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.138637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc8c5d8360b47b89dcbb54698cdad40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:45.143929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:45.156808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e54bfd8ef744a20b2d010fb073f6fc2', 'request_id': 'req-209498ec-06de-459c-87e8-b1d0c5ab6e9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.188985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e54bfd8ef744a20b2d010fb073f6fc2', 'request_id': 'req-209498ec-06de-459c-87e8-b1d0c5ab6e9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.206974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e54bfd8ef744a20b2d010fb073f6fc2', 'request_id': 'req-209498ec-06de-459c-87e8-b1d0c5ab6e9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.241729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] The token cache is being invalidate because project 9e54bfd8ef744a20b2d010fb073f6fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:45.242061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.243097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-209498ec-06de-459c-87e8-b1d0c5ab6e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.248002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1738/3506] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:44 2022] DELETE /identity/v3/projects/9e54bfd8ef744a20b2d010fb073f6fc2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:45.253553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.254034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.254216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.256973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc8c5d8360b47b89dcbb54698cdad40'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.272902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc8c5d8360b47b89dcbb54698cdad40'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.294238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:45.295675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:45.300768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc8c5d8360b47b89dcbb54698cdad40'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.301673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc8c5d8360b47b89dcbb54698cdad40'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.304033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85690846-a91d-40cd-bff9-46f8666b5c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc8c5d8360b47b89dcbb54698cdad40'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:45.334086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1769/3507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:44 2022] DELETE /identity/v3/users/3fc8c5d8360b47b89dcbb54698cdad40 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:45.458741 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1739/3508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:45.462313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922839e0-37d4-4950-a525-2da98742b674 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.462607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922839e0-37d4-4950-a525-2da98742b674 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.462888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922839e0-37d4-4950-a525-2da98742b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.508540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-922839e0-37d4-4950-a525-2da98742b674 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:45.511275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-922839e0-37d4-4950-a525-2da98742b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:45.621360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1770/3509] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:45.625386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:45.637346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9db09-a989-43f1-9755-0f38b58ad018 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:45.643731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:45.644738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.645169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.645646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.647445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:45.648025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:45.649988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:45.672468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922839e0-37d4-4950-a525-2da98742b674 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:45.673357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1740/3510] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:45.695826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922839e0-37d4-4950-a525-2da98742b674 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:45.704270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:45.705491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.705996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.706453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.707353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:45.710480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:45.752434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1771/3511] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:45 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:45.756822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:45.771025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ee67-729b-4539-95e5-4ecadeffad01 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:45.951087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:45.951997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:45.952450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:45.953486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:45.955402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:45.958250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.008585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1741/3512] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:45 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:46.009655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.026776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6011-6035-4a4a-afbc-5f85500e90c0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.038040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.039495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.039612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.039887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.045984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.048535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.065876 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1772/3513] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:46.067824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.083531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6245-e183-4e40-97a7-7cf69faf5707 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.092285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.093215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.093618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.094294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.095924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.100358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c078009-fc2d-484e-be56-13c059324a1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.122536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1742/3514] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:46.126808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.140915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a579f9-ecc4-425c-a05b-39c32587e42a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.149366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.150245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.151748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.151748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] PATH_INFO: `/v3/projects/934b22e1c24a45cc87d50b89a0540f46/users/3949c16e4fde47108c4242a3f99ec5df/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.191147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=934b22e1c24a45cc87d50b89a0540f46, user_id=3949c16e4fde47108c4242a3f99ec5df, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.194836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.200263 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:46.220653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1773/3515] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:46 2022] PUT /identity/v3/projects/934b22e1c24a45cc87d50b89a0540f46/users/3949c16e4fde47108c4242a3f99ec5df/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:46.233438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.233905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.234069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.316499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] MFA Rules not processed for user `3949c16e4fde47108c4242a3f99ec5df`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:46.319381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:46.341877 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:46.489578 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1743/3516] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:46.493022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.645682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3b98-6cb5-447b-b7ac-777ff514d06f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.655416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.656017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.656302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.656576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.657764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.659702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.720568 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1774/3517] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:46 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:46.724303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.739310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a55d2-7b2d-473b-864e-6d8dbedc4458 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.837525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.838248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.838627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.838963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.839686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.841942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.877501 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1744/3518] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:46 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:46.878766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.904453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46997d-e741-496d-a787-de560e2cb6b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.920118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.920756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.921039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.921314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:46.922009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:46.927781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:46.959604 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1775/3519] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:46.962295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:46.975148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c379c-02cc-4a81-8678-1b09fa51bc6f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:46.982937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:46.985302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:46.985740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:46.986195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] PATH_INFO: `/v3/projects/fac1cae88d324f0981e18f3a5905260b/users/ca3aabb3c55f430cb645fcf4325ea3dd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.019292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac1cae88d324f0981e18f3a5905260b, user_id=ca3aabb3c55f430cb645fcf4325ea3dd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.025009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:47.048326 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1745/3520] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:46 2022] PUT /identity/v3/projects/fac1cae88d324f0981e18f3a5905260b/users/ca3aabb3c55f430cb645fcf4325ea3dd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:47.052937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.068457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8341a-e7ab-4ff9-848a-4a64e66f5f0c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:47.213958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.216338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.220789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:47.221752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.222262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.223363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.224877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.227314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:47.249512 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1776/3521] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:47.250545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.262045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed4ee-bc77-4428-bab3-a0415ff0fc1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:47.283885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:47.286408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.288175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.288513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] PATH_INFO: `/v3/projects/fac1cae88d324f0981e18f3a5905260b/users/ca3aabb3c55f430cb645fcf4325ea3dd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.290726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324fca-a166-4da6-892f-2b9aad71e2bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:47.291229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac1cae88d324f0981e18f3a5905260b, user_id=ca3aabb3c55f430cb645fcf4325ea3dd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.293993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1245b4-ace0-47a3-8e6b-0e8d63bd49a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:47.323915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:47.329242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.329614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.329963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] PATH_INFO: `/v3/projects/16ab228e9d67437594864df156c39bc8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.335451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ab228e9d67437594864df156c39bc8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.341569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:47.343148 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1777/3522] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:47 2022] PUT /identity/v3/projects/fac1cae88d324f0981e18f3a5905260b/users/ca3aabb3c55f430cb645fcf4325ea3dd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:47.345579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3784-fbc9-4703-928b-f5d8e4cdaf72 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.345868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3784-fbc9-4703-928b-f5d8e4cdaf72 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.346180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3784-fbc9-4703-928b-f5d8e4cdaf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.421505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-312c3784-fbc9-4703-928b-f5d8e4cdaf72 None None] MFA Rules not processed for user `ca3aabb3c55f430cb645fcf4325ea3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:47.430148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-312c3784-fbc9-4703-928b-f5d8e4cdaf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.480792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ab228e9d67437594864df156c39bc8', 'request_id': 'req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:47.490696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ab228e9d67437594864df156c39bc8', 'request_id': 'req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:47.502721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ab228e9d67437594864df156c39bc8', 'request_id': 'req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:47.524200 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:47.529269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] The token cache is being invalidate because project 16ab228e9d67437594864df156c39bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:47.530467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:47.531761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac1e78cc-e82a-43bd-82be-bc1d0e38e2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:47.536119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1746/3523] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:47 2022] DELETE /identity/v3/projects/16ab228e9d67437594864df156c39bc8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:47.541620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801972-8777-49fc-af2c-f0259ce6e66d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.542131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801972-8777-49fc-af2c-f0259ce6e66d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.542673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801972-8777-49fc-af2c-f0259ce6e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.566235 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:47.577214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-79801972-8777-49fc-af2c-f0259ce6e66d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:47.578687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79801972-8777-49fc-af2c-f0259ce6e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.669502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1778/3524] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:47.671312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.671675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.672028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.715241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] MFA Rules not processed for user `3949c16e4fde47108c4242a3f99ec5df`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:47.716526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.726659 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1747/3525] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:47.734818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600185f-3271-4a48-80d1-61098728a580 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.735130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600185f-3271-4a48-80d1-61098728a580 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.735579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600185f-3271-4a48-80d1-61098728a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.767012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9600185f-3271-4a48-80d1-61098728a580 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:47.781539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9600185f-3271-4a48-80d1-61098728a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.820908 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1748/3526] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:47.824581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600185f-3271-4a48-80d1-61098728a580 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.859658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600185f-3271-4a48-80d1-61098728a580 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:47.862480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1779/3527] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:47.879787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.881158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:47.881367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:47.882214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.882798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.883317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.884677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:47.885285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.887145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:47.913976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1749/3528] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:47.920601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:47.946472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6d997-9f5d-4300-83b9-3a66040d1f64 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:47.952792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:47.953308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:47.953735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:47.954061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:47.955708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:47.958431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.036722 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1750/3529] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:47 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:12:48.040459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:48.075875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3623ceb-10f5-418e-bea6-964efd511b07 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:48.198683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:48.199334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.199743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.199850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.201759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:48.224742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b189-5363-469a-bd44-b9b50c25b67a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:48.239868 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:48.241939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:48.242621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.242963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.247230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.247973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:48.250010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.319765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1751/3530] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:48 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:48.322584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:48.346270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4591-8407-4d6c-bcb5-47d3d7c34cd8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:48.387172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:48.388061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.390990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:48.393862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.396536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.399046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:48.401721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.402309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.429206 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1780/3531] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:48.453495 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1752/3532] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:48.458247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:48.476507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0d5-37bd-4fac-b957-ea1e9453c4b7 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:48.487614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:48.489170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.489528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.489815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.491627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:48.493291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d41ac-dc0f-4ca7-a6e5-db58563325e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.534756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1781/3533] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:48.539378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:48.572203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509d2ee-44f5-4b3f-adbf-ed4eaf83f715 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:48.585938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:48.586620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.586904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.587182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] PATH_INFO: `/v3/projects/61de8289ca9a496585738e99e3a986f8/users/046b8c52a2c14ec39102e0b615397bd6/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.617084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61de8289ca9a496585738e99e3a986f8, user_id=046b8c52a2c14ec39102e0b615397bd6, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:48.620088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:48.677270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:48.677639 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1753/3534] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:48 2022] PUT /identity/v3/projects/61de8289ca9a496585738e99e3a986f8/users/046b8c52a2c14ec39102e0b615397bd6/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:48.677777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:48.678307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:48.718813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] MFA Rules not processed for user `046b8c52a2c14ec39102e0b615397bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:48.720814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:48.881393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1782/3535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:48.886307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:48.910771 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:49.016060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d2b93-6434-47fd-907a-768f2ba0ff01 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.023613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.024753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.025044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.025489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.026002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.028519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.072268 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1754/3536] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:49.076148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:49.092708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814590d-31d4-4fb6-a1fc-6cda1d7235d2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.198436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.199281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.199799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.200231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.201052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.204120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d266e-376c-410e-80a3-e1332de5efc2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.255269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1783/3537] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:49 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:49.256455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:49.279704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab4af-6b4a-452f-b3ba-39c4e9c6c123 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.284737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.285363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.285672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.286106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.286772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.289628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.313143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb244-c847-4895-a467-a5a15be31ec8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.314537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb244-c847-4895-a467-a5a15be31ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.315318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb244-c847-4895-a467-a5a15be31ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.325691 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1755/3538] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:49.330691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:49.361172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88889c-d43a-490d-a3c8-61b7408cd56a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.387682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.388360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.388638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.388911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] PATH_INFO: `/v3/projects/0812c0ea89e54582b6ea349da1ba98c1/users/275330a280684ec3808df2bfcb066d08/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.397481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-919bb244-c847-4895-a467-a5a15be31ec8 None None] MFA Rules not processed for user `38e3ca9f263a437ab752007ef0588edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:49.400464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-919bb244-c847-4895-a467-a5a15be31ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:49.423481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0812c0ea89e54582b6ea349da1ba98c1, user_id=275330a280684ec3808df2bfcb066d08, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.426977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.452969 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:49.456255 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1756/3539] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:49 2022] PUT /identity/v3/projects/0812c0ea89e54582b6ea349da1ba98c1/users/275330a280684ec3808df2bfcb066d08/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:49.466483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:49.616340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1784/3540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:49.628174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd9c7-a700-41c7-8da1-6a0079c47727 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.628174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd9c7-a700-41c7-8da1-6a0079c47727 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.628792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd9c7-a700-41c7-8da1-6a0079c47727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.669434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1c3cd9c7-a700-41c7-8da1-6a0079c47727 None None] MFA Rules not processed for user `38e3ca9f263a437ab752007ef0588edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:49.684526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c3cd9c7-a700-41c7-8da1-6a0079c47727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:49.688656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b221-f14a-4d62-a3f9-ad1f616f35d8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.716335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.716974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.717257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.717557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.718211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.719909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.742808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1757/3541] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:49.761788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:49.802533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a35e5-f1cd-42b2-8d33-d89dc11c4c6d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:49.824787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:49.824787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.824787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.824787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] PATH_INFO: `/v3/projects/0812c0ea89e54582b6ea349da1ba98c1/users/275330a280684ec3808df2bfcb066d08/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.829313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0812c0ea89e54582b6ea349da1ba98c1, user_id=275330a280684ec3808df2bfcb066d08, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:49.834114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a02cf-ca0d-4400-9a03-4d79a9f97a8a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:49.840831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1785/3542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:49.868820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1758/3543] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:49 2022] PUT /identity/v3/projects/0812c0ea89e54582b6ea349da1ba98c1/users/275330a280684ec3808df2bfcb066d08/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:49.880741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.881735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.881735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.887487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:49.887772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:49.888046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:49.922375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] MFA Rules not processed for user `1cc384987bb247d88d0027e60d600ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:49.924985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:49.981050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] MFA Rules not processed for user `275330a280684ec3808df2bfcb066d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:49.982345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:50.019292 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:50.093813 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1759/3544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:50.093813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:50.097343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:50.268633 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1786/3545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:50.273692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:50.276608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca02e2-da49-4136-8ce8-1cb931a54a03 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:50.284606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:50.285390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:50.286332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:50.286332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:50.310907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e96f2-0285-4d00-b60a-551cf88b9475 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:50.323391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:50.323867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:50.324060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:50.324342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:50.330133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:50.337162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:50.348476 n-d-master-1 devstack@keystone.service[81863]: WARNING keystone.server.flask.common [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 25 01:12:50.383497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:50.386074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:50.402967 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1760/3546] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:50.429622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1787/3547] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:50 2022] POST /identity/v3/projects => generated 360 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:50.435083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:50.465945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5a40-1fce-4b3d-b44b-3b1b7230f401 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:50.613187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:50.613891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:50.614179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:50.614458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1910104450` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:50.618521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=6272a52ee217435da9219380a1e6e886, value=tempest-tag-1910104450)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:50.622783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:50.721375 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:50.769659 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1910104450. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:12:50.769659 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:12:50.769659 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:50.784077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1761/3548] 10.222.0.16 () {60 vars in 1333 bytes} [Sun Sep 25 01:12:50 2022] PUT /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1910104450 => generated 0 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Sep 25 01:12:50.788194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:50.801385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce196-2094-43a4-9553-0ff02addfdec tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:50.819103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:50.820904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:50.821388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:50.821890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1910104450` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:50.862706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6272a52ee217435da9219380a1e6e886, value=tempest-tag-1910104450)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:50.865064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:50.884230 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:50.888456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1788/3549] 10.222.0.16 () {58 vars in 1314 bytes} [Sun Sep 25 01:12:50 2022] GET /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1910104450 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:50.893200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:50.909048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f6a00-e61a-4dc2-a048-c9164df832bb tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:50.926048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:50.926860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:50.927220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:50.927574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:50.930008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=6272a52ee217435da9219380a1e6e886)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:50.933841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.039990 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1762/3550] 10.222.0.16 () {60 vars in 1265 bytes} [Sun Sep 25 01:12:50 2022] PUT /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags => generated 141 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:51.040814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.058628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632ba2-ef5a-4c11-86ae-d4586e990e5f tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.065040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.070813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.071112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.071415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.109742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6272a52ee217435da9219380a1e6e886)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.112539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.147546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1789/3551] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:12:51 2022] GET /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags => generated 141 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:51.151354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.170101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201546f-ed51-43aa-b190-a15a7a725de0 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.180250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.181145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.181696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.182119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1131785582` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.183526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=6272a52ee217435da9219380a1e6e886, value=tempest-tag-1131785582)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.186470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.246938 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1131785582. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:12:51.246938 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:12:51.246938 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:12:51.260886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1763/3552] 10.222.0.16 () {58 vars in 1317 bytes} [Sun Sep 25 01:12:51 2022] DELETE /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1131785582 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:51.261141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.276189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880f91-4cd2-4bfa-bd8a-d2b5bbbb4f67 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.287567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.288246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.288533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.288810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1131785582` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.306309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6272a52ee217435da9219380a1e6e886, value=tempest-tag-1131785582)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.308494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Could not find project tag: tempest-tag-1131785582.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1131785582. Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Sep 25 01:12:51.332312 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1131785582. Sep 25 01:12:51.333500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:12:51.334123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1790/3553] 10.222.0.16 () {58 vars in 1314 bytes} [Sun Sep 25 01:12:51 2022] GET /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags/tempest-tag-1131785582 => generated 107 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:12:51.338353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.354555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe5ea-ac97-4695-99f1-71a199aa6487 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.361516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.362301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.362591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.362869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.374237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=6272a52ee217435da9219380a1e6e886)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.378123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.446010 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1764/3554] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:12:51 2022] DELETE /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:51.450112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.461008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b546b-81c3-4126-8cb7-9470f2b28710 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.466118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.466873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.467222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.467594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886/tags` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.480431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6272a52ee217435da9219380a1e6e886)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.482777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.494587 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1791/3555] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:12:51 2022] GET /identity/v3/projects/6272a52ee217435da9219380a1e6e886/tags => generated 66 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 25 01:12:51.500946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.514857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2357-21b6-461e-86fa-6bdcce18dab9 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.521274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '275330a280684ec3808df2bfcb066d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0812c0ea89e54582b6ea349da1ba98c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.521979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.522134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.522615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] PATH_INFO: `/v3/projects/6272a52ee217435da9219380a1e6e886` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.523958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6272a52ee217435da9219380a1e6e886)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.525937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:51.589174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6272a52ee217435da9219380a1e6e886', 'request_id': 'req-c27ca957-d2de-4e21-b332-51210be5fb32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:51.596904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6272a52ee217435da9219380a1e6e886', 'request_id': 'req-c27ca957-d2de-4e21-b332-51210be5fb32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:51.609756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6272a52ee217435da9219380a1e6e886', 'request_id': 'req-c27ca957-d2de-4e21-b332-51210be5fb32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:51.633012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] The token cache is being invalidate because project 6272a52ee217435da9219380a1e6e886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:51.633012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:51.633855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c27ca957-d2de-4e21-b332-51210be5fb32 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:51.640691 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1765/3556] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:51 2022] DELETE /identity/v3/projects/6272a52ee217435da9219380a1e6e886 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:51.643245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:51.645324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:51.771917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938c49-bbf1-4a40-be1d-5cf8e6ce0420 tempest-IdentityV3ProjectTagsTest-532186189 tempest-IdentityV3ProjectTagsTest-532186189-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:51.931180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:51.932657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:51.935838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:51.939523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] PATH_INFO: `/v3/users/046b8c52a2c14ec39102e0b615397bd6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:51.942089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046b8c52a2c14ec39102e0b615397bd6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:51.947752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:52.092131 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:52.104477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046b8c52a2c14ec39102e0b615397bd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:52.117172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046b8c52a2c14ec39102e0b615397bd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:52.136202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046b8c52a2c14ec39102e0b615397bd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:52.137073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046b8c52a2c14ec39102e0b615397bd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:52.143840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046b8c52a2c14ec39102e0b615397bd6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:52.171474 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1792/3557] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:51 2022] DELETE /identity/v3/users/046b8c52a2c14ec39102e0b615397bd6 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:52.176449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:52.176810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:52.177029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:52.205953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:52.207545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:52.212850 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:52.325500 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1766/3558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:52.363707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:52.365473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:52.581902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76edc5-ce81-46c5-a0ba-d44b7de1b4a1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:52.586299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:52.587002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:52.587349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:52.587690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:52.618484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:52.620942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:52.637911 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1793/3559] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:12:53.775086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:53.778724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:53.811528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8148f-a0b8-47f6-b7b2-ce17b1faf8a5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:53.819509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:53.821162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:53.821718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:53.822239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] PATH_INFO: `/v3/projects/61de8289ca9a496585738e99e3a986f8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:53.823722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61de8289ca9a496585738e99e3a986f8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:53.825992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:53.971407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61de8289ca9a496585738e99e3a986f8', 'request_id': 'req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:53.983815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61de8289ca9a496585738e99e3a986f8', 'request_id': 'req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.001098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61de8289ca9a496585738e99e3a986f8', 'request_id': 'req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.039331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] The token cache is being invalidate because project 61de8289ca9a496585738e99e3a986f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:54.039896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.042458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.045390 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1767/3560] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:53 2022] DELETE /identity/v3/projects/61de8289ca9a496585738e99e3a986f8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:54.050334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:54.068112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215186-1c6a-4db5-9d6e-e20da99ed6e8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:54.194659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:54.196441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:54.213310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:54.214262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:54.214723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:54.215226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] PATH_INFO: `/v3/users/275330a280684ec3808df2bfcb066d08` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:54.217588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] RBAC: Authorizing `identity:delete_user(user_id=275330a280684ec3808df2bfcb066d08)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:54.222210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:54.372873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275330a280684ec3808df2bfcb066d08'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.402043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9c9c5-dd0a-466f-9320-7f9d358200d1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:54.404356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275330a280684ec3808df2bfcb066d08'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.418032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:54.419001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:54.419280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:54.419564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] PATH_INFO: `/v3/users/4a8f4f941c504950b4f8217de48f3f58` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:54.428245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8f4f941c504950b4f8217de48f3f58)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:54.431017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:54.432657 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:54.446081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275330a280684ec3808df2bfcb066d08'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.447405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275330a280684ec3808df2bfcb066d08'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.448521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275330a280684ec3808df2bfcb066d08'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.497597 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:54.499964 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1794/3561] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:54 2022] DELETE /identity/v3/users/275330a280684ec3808df2bfcb066d08 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:54.517195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8f4f941c504950b4f8217de48f3f58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.519280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8f4f941c504950b4f8217de48f3f58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.528390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8f4f941c504950b4f8217de48f3f58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.544393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8f4f941c504950b4f8217de48f3f58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.545237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8f4f941c504950b4f8217de48f3f58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:54.585117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1768/3562] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:54 2022] DELETE /identity/v3/users/4a8f4f941c504950b4f8217de48f3f58 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:55.395049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:55.397241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:55.572276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b073f0e-1ad1-43f4-94bb-fbaff5e7923d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:55.644170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:55.645902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:55.722276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:55.723030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:55.723311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:55.723586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] PATH_INFO: `/v3/projects/2767668c8f624a71b787a1334c9091da` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:55.724758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2767668c8f624a71b787a1334c9091da)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:55.726926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:55.779431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343d89a-2fe6-45c7-bb40-bc63d7456f8c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:55.793122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2767668c8f624a71b787a1334c9091da', 'request_id': 'req-04e80242-d85f-4625-8b13-5695f15d7548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:55.803985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2767668c8f624a71b787a1334c9091da', 'request_id': 'req-04e80242-d85f-4625-8b13-5695f15d7548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:55.815918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2767668c8f624a71b787a1334c9091da', 'request_id': 'req-04e80242-d85f-4625-8b13-5695f15d7548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:55.835720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] The token cache is being invalidate because project 2767668c8f624a71b787a1334c9091da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:55.835929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:55.836807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-04e80242-d85f-4625-8b13-5695f15d7548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:55.841703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1795/3563] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:55 2022] DELETE /identity/v3/projects/2767668c8f624a71b787a1334c9091da => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:55.846695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb9e2-5c42-4d89-a868-efbdf21114d8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:55.847681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb9e2-5c42-4d89-a868-efbdf21114d8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:55.848123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb9e2-5c42-4d89-a868-efbdf21114d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:55.878518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:55.879683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:55.880279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:55.880777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] PATH_INFO: `/v3/projects/0812c0ea89e54582b6ea349da1ba98c1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:55.882427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11fdb9e2-5c42-4d89-a868-efbdf21114d8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:55.883630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11fdb9e2-5c42-4d89-a868-efbdf21114d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:55.890940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0812c0ea89e54582b6ea349da1ba98c1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:55.893567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:55.901627 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1796/3564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:55.909502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:55.910120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:55.910591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:55.962675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:55.964433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:55.977443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1797/3565] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:55.979578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.007201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e377c72-0622-4c7d-b72c-3d27a5542975 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.022245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.022483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.022710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.023014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.023955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:56.024263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.025895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.027753 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:56.042225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1798/3566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:12:56.046517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.058005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0812c0ea89e54582b6ea349da1ba98c1', 'request_id': 'req-7da27d1f-6475-4989-832f-5e41dca44196'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:56.059849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61eb4d-2030-456d-8398-1629ec41b992 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.066956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0812c0ea89e54582b6ea349da1ba98c1', 'request_id': 'req-7da27d1f-6475-4989-832f-5e41dca44196'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:56.072552 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:56.074065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0812c0ea89e54582b6ea349da1ba98c1', 'request_id': 'req-7da27d1f-6475-4989-832f-5e41dca44196'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:56.095998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] The token cache is being invalidate because project 0812c0ea89e54582b6ea349da1ba98c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:56.096290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:56.097699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7da27d1f-6475-4989-832f-5e41dca44196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:56.108372 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1769/3567] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:55 2022] DELETE /identity/v3/projects/0812c0ea89e54582b6ea349da1ba98c1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:56.113515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd723b-ef8e-4c4f-b563-174d8b515c90 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.113895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd723b-ef8e-4c4f-b563-174d8b515c90 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.114167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd723b-ef8e-4c4f-b563-174d8b515c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.145604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.146235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.146828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.147145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.148169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.149939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.178286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-95cd723b-ef8e-4c4f-b563-174d8b515c90 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:56.179759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95cd723b-ef8e-4c4f-b563-174d8b515c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:56.196391 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1799/3568] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:56.196620 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1770/3569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:56.198163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.200343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:56.202549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.202841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.203206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.236062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:56.238577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:56.320440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f468d0-c2a3-44a6-8e2d-ea5834864341 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.324083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1771/3570] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:56.327900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.329304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.329976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.330274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.330533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.331300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.333248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.342057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9655d-9200-4abc-8616-bf24e3950996 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.353365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.356882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.357181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.358560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.359252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:56.359547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.364991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.372313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1800/3571] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:56.373734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.397099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1772/3572] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:56.400307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597c3-37df-4638-855b-c9bb903891ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.402350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.417634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.418257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.421243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.421590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.422525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.424174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.434571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c36ca-5bd5-43da-b6e7-cc31da74cc0d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.447366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.448164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.448456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.448732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.449874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1801/3573] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:56.452948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.452948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.457261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.481845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68a75c-ceee-458c-81cc-3c28d7b4adea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.489251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.490406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.491204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.491661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.492523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.495339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.513612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1773/3574] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:56.516402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.518618 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1802/3575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:56.525582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.542217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e096a-33b2-4213-9e07-a46cc1b401d4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.607135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167d1b-1ec1-4f2c-95ae-9cdf3b9c4713 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.613921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.614622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.614970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.615312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.616919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.617301 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:56.622889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.643720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.646013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.647281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.647772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] PATH_INFO: `/v3/projects/51f36d0acd3e457cbb8fc3d10b486ad1/users/4c25e53535f348718d8bf85e020ec15d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.655362 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1774/3576] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:56.658585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.678573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352339d-587e-4a3f-95b2-c0c5d813240e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.686485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f36d0acd3e457cbb8fc3d10b486ad1, user_id=4c25e53535f348718d8bf85e020ec15d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.692096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fa343-1f2a-421d-9450-a4b2719d81c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.693444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.694130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.694415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.694684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.697282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.699691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.718624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1775/3577] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:12:56.719896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.725728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1803/3578] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:56 2022] PUT /identity/v3/projects/51f36d0acd3e457cbb8fc3d10b486ad1/users/4c25e53535f348718d8bf85e020ec15d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:56.730558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.730853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.731122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.732496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9e04-0afd-4e57-a9ed-cf300e43a94e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.765373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:56.766560 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:56.768342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:56.827482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.828097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.828377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.828722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.829788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.832008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.843435 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1776/3579] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:56.845362 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1804/3580] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:56.849447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.855868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:56.858859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:56.863026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ae30-fc72-4bf6-ab47-08ba829cde8f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.873106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:56.874154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.874512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.874861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] PATH_INFO: `/v3/projects/fa28a8cd543845c9a16b3a20a2bed196/users/4f5abed0fb384ab0b1930508db1c7682/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.893133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa28a8cd543845c9a16b3a20a2bed196, user_id=4f5abed0fb384ab0b1930508db1c7682, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:56.896105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2f9db-62f0-4d46-848b-8e12db178173 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:56.917775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1777/3581] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:56 2022] PUT /identity/v3/projects/fa28a8cd543845c9a16b3a20a2bed196/users/4f5abed0fb384ab0b1930508db1c7682/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:56.924719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:56.925378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:56.926250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:56.947507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269e9d-215b-4fcf-a678-8beec84614c4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:56.977645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] MFA Rules not processed for user `4f5abed0fb384ab0b1930508db1c7682`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:56.978984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:57.010805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.011536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.011884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.012223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.066168 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:57.092618 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1778/3582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:12:57.103563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.123799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.125582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.128419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82f11-c697-4c4b-af15-20bb698fd570 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.135843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.136615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.136932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.137261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.138013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.141369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.143685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1805/3583] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:12:57.179938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1779/3584] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:57 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:57.184084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.195896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0fe7-1d4a-4ce2-ba66-35c0cc600826 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.272863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.273611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.273906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.274180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.275222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.277099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.308356 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1806/3585] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:57 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:57.313124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.326059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6449cf-85e9-482c-93f0-47a5cc05bcbc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.336963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.338048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.338499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.338974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.339801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.341753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.357623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1780/3586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:57.360522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.383772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186fd6-c2d0-4cca-aeeb-4eb7e08b4988 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.399280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.402200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.406168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.406836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] PATH_INFO: `/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1/users/e49706fbc3694b6e93303ca7d69c2ed2/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.445647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1d1b09d7354577bc2f4810898ec1c1, user_id=e49706fbc3694b6e93303ca7d69c2ed2, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.449339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.479266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1807/3587] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:57 2022] PUT /identity/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1/users/e49706fbc3694b6e93303ca7d69c2ed2/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:57.484357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.504619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c727a-9549-4dd9-ae8d-d301f70a191e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.588706 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:57.601011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.602057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.602586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.603080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.604339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.606630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cd30c-5ec6-490d-95f7-d9cd3f4de9cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.628586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.628747 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1781/3588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:57.649321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05443c-a9e7-4d30-a06d-ea82f27a149d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.669164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.670348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.670633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.671000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] PATH_INFO: `/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1/users/e49706fbc3694b6e93303ca7d69c2ed2/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.674388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1d1b09d7354577bc2f4810898ec1c1, user_id=e49706fbc3694b6e93303ca7d69c2ed2, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.678177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.698812 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1808/3589] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:12:57 2022] PUT /identity/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1/users/e49706fbc3694b6e93303ca7d69c2ed2/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:12:57.714680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.715811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.715811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.769125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] MFA Rules not processed for user `e49706fbc3694b6e93303ca7d69c2ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:12:57.770738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:57.887150 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1782/3590] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:12:57.894562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:57.920334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21864d44-05cc-48d1-8ede-a4a7074fb12b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:57.927117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:57.941646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:57.941646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:57.941646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:57.941646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:57.941646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:57.989011 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1809/3591] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:57 2022] POST /identity/v3/projects => generated 358 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:57.993328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.006414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e0988-5dbe-40ca-9a6b-a959c3e8ba0c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.083895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.084552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.084835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.085108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.085827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.089554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.118689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1783/3592] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:12:57 2022] POST /identity/v3/users => generated 413 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:58.120142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.132045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644e73f-a65d-47f7-9250-4333bec729ab tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.136984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.137731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.137963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.138268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/users/e890c9dcea494805aee6da52b334d39a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.154593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_user(user_id=e890c9dcea494805aee6da52b334d39a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.157517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.159384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1810/3593] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:12:58 2022] GET /identity/v3/users/e890c9dcea494805aee6da52b334d39a => generated 413 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:58.163735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.174552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd227ea-bd31-462c-a421-c191e4681352 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.179993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.179993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.180298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.180563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/users/e890c9dcea494805aee6da52b334d39a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.181798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e890c9dcea494805aee6da52b334d39a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.183926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.232216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e890c9dcea494805aee6da52b334d39a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.232985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e890c9dcea494805aee6da52b334d39a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.240333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e890c9dcea494805aee6da52b334d39a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.245958 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:58.257722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e890c9dcea494805aee6da52b334d39a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.260238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e890c9dcea494805aee6da52b334d39a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.284466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1784/3594] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:12:58 2022] DELETE /identity/v3/users/e890c9dcea494805aee6da52b334d39a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:58.285663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.291546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:58.310593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923a5f5-fe50-4e6b-9ec7-67b025e57035 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.370741 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:58.389512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.389512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.389512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.389835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/9f35e8c6064f46e8af34d2a50cdcbc2a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.389835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f35e8c6064f46e8af34d2a50cdcbc2a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.391878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.457748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f35e8c6064f46e8af34d2a50cdcbc2a', 'request_id': 'req-2b1917f6-2c65-4cdb-9531-4b5179fe4299'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.467874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f35e8c6064f46e8af34d2a50cdcbc2a', 'request_id': 'req-2b1917f6-2c65-4cdb-9531-4b5179fe4299'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.476863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f35e8c6064f46e8af34d2a50cdcbc2a', 'request_id': 'req-2b1917f6-2c65-4cdb-9531-4b5179fe4299'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.495249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 9f35e8c6064f46e8af34d2a50cdcbc2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:58.495829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.496645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.503030 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1811/3595] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:58 2022] DELETE /identity/v3/projects/9f35e8c6064f46e8af34d2a50cdcbc2a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:58.505626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.523195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503de8-328f-49c9-87e5-0c999e93b3b6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.622875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.624012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.624388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.626114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.626349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.628770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.652140 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1785/3596] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:58 2022] POST /identity/v3/projects => generated 349 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:58.656229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.658429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:58.676961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1917f6-2c65-4cdb-9531-4b5179fe4299 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.780382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.781028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.781319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.781664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.782356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:12:58.782667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.784759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.807986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1812/3597] 10.222.0.16 () {58 vars in 1160 bytes} [Sun Sep 25 01:12:58 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:12:58.812443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.824225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe4820-2bd5-48b9-84f8-b55d8fb3843f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.833133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.834244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.834244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.834448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.834977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.836974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.862625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1786/3598] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:12:58 2022] GET /identity/v3/domains => generated 830 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:58.867938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.881317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305172-a3c7-4771-9bc8-2ab95d57913b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:58.887153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:58.887813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:58.888095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:58.888371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/bbecf722d0124dd39e56f176c9f00880` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:58.889652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_project(project_id=bbecf722d0124dd39e56f176c9f00880)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:58.890822 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:12:58.890822 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:12:58.890822 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:12:58.892148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:58.905042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.905813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.938077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.939447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:58.943728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1813/3599] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:12:58 2022] PATCH /identity/v3/projects/bbecf722d0124dd39e56f176c9f00880 => generated 363 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:58.947938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:58.950779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:58.989269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19b2c-8965-4103-87c4-b8e79fde8d05 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:59.105228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:59.106528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:59.107072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:59.107587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/bbecf722d0124dd39e56f176c9f00880` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:59.121688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbecf722d0124dd39e56f176c9f00880)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:59.123977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:59.151802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.155982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.203279 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:59.228613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.241178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.250988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.270009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project bbecf722d0124dd39e56f176c9f00880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:59.270385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.271027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.284354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.289890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.290677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbecf722d0124dd39e56f176c9f00880', 'request_id': 'req-336ecb80-3e23-417e-b540-743a74b8560e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.303933 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1787/3600] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:58 2022] DELETE /identity/v3/projects/bbecf722d0124dd39e56f176c9f00880 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:59.305202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:59.321336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f5-f386-46cd-8125-902513013aa6 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:59.386943 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:59.424113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:59.424826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:59.425116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:59.425390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:59.426152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:59.428155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:59.491107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1814/3601] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:59 2022] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:12:59.495466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:59.497046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:59.511207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ecb80-3e23-417e-b540-743a74b8560e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:59.600637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:59.604966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:59.607766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:59.607766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/8c2a21458ce64715b3a05cd404b88669` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:59.609598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c2a21458ce64715b3a05cd404b88669)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:59.613734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:59.616685 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1788/3602] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:12:59 2022] GET /identity/v3/projects/8c2a21458ce64715b3a05cd404b88669 => generated 359 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:12:59.621199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:59.641537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247c3e0-5025-4068-9a19-a1b693f9fd93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:12:59.663936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:12:59.665368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:12:59.665882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:12:59.666315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/8c2a21458ce64715b3a05cd404b88669` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:12:59.668678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c2a21458ce64715b3a05cd404b88669)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:12:59.674598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:12:59.774433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2a21458ce64715b3a05cd404b88669', 'request_id': 'req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.784213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2a21458ce64715b3a05cd404b88669', 'request_id': 'req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.791643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2a21458ce64715b3a05cd404b88669', 'request_id': 'req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.814182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 8c2a21458ce64715b3a05cd404b88669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:12:59.814744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.815764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:12:59.818972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1815/3603] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:59 2022] DELETE /identity/v3/projects/8c2a21458ce64715b3a05cd404b88669 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:12:59.829851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:12:59.832377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:12:59.846694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7845-b5bb-40f6-acb2-b833ae0f856f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.025256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.026817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.028626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.029178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.030529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.068883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.144416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1789/3604] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:12:59 2022] POST /identity/v3/projects => generated 360 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:00.144881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.166518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0b32-f18b-4b7c-a2a3-bb59e09b6b6e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.254214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.254923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.255208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.255485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/ac7329c6772a45da9f61ed830d95d7dd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.256656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac7329c6772a45da9f61ed830d95d7dd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.259729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.266437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.269016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1816/3605] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:00 2022] GET /identity/v3/projects/ac7329c6772a45da9f61ed830d95d7dd => generated 360 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:00.282207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c46822-ccde-4f3c-9938-9b8fdddef813 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.287954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.289062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.290256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.290547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/ac7329c6772a45da9f61ed830d95d7dd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.291872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac7329c6772a45da9f61ed830d95d7dd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.295083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.338162 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:00.481549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7329c6772a45da9f61ed830d95d7dd', 'request_id': 'req-23d9ff3a-8169-4699-881a-999ee6108742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.496739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7329c6772a45da9f61ed830d95d7dd', 'request_id': 'req-23d9ff3a-8169-4699-881a-999ee6108742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.521705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7329c6772a45da9f61ed830d95d7dd', 'request_id': 'req-23d9ff3a-8169-4699-881a-999ee6108742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.543926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project ac7329c6772a45da9f61ed830d95d7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:00.544229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.545698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.549029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1790/3606] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:00 2022] DELETE /identity/v3/projects/ac7329c6772a45da9f61ed830d95d7dd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:00.554595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.557329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:00.571817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97cb3d-c8c3-4df5-b22f-7e48c3ce889f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.653062 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:00.670762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.671711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.672152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.673167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.674255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.678686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.744783 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1817/3607] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:13:00 2022] POST /identity/v3/projects => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:00.749044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.760110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ff3a-8169-4699-881a-999ee6108742 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.831180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.831872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.832093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.832431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/23434f2a6ebc444eb3915b87ca78a0af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.834031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=23434f2a6ebc444eb3915b87ca78a0af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.836142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.841303 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1791/3608] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:00 2022] GET /identity/v3/projects/23434f2a6ebc444eb3915b87ca78a0af => generated 347 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:00.842428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.865676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd744c1-1de2-4573-a1fb-ee0462a9d42c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:00.865676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:00.865676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:00.865929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:00.865929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/23434f2a6ebc444eb3915b87ca78a0af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:00.865929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23434f2a6ebc444eb3915b87ca78a0af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:00.865929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:00.940747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23434f2a6ebc444eb3915b87ca78a0af', 'request_id': 'req-fd21a600-587a-4911-8e52-dab5572c4ce2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.953107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23434f2a6ebc444eb3915b87ca78a0af', 'request_id': 'req-fd21a600-587a-4911-8e52-dab5572c4ce2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.961314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23434f2a6ebc444eb3915b87ca78a0af', 'request_id': 'req-fd21a600-587a-4911-8e52-dab5572c4ce2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.977528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 23434f2a6ebc444eb3915b87ca78a0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:00.977877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.978586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:00.980525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1818/3609] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:00 2022] DELETE /identity/v3/projects/23434f2a6ebc444eb3915b87ca78a0af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:00.987146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:00.989111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:01.002149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba270e-1431-4d83-a273-2d0db4318622 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.088643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.089487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.090363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.090686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.091484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.093220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.113547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1792/3610] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:13:00 2022] POST /identity/v3/domains => generated 276 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:01.117714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.144253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a600-587a-4911-8e52-dab5572c4ce2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.278969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.279550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.279831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.280103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.280916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.284179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.358397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1819/3611] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:01 2022] POST /identity/v3/projects => generated 404 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:01.364477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.386141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75483b-efd6-42a2-ab17-12873b84e66c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.468444 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.490193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.491300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.491445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.491633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/080e1ad5bb3144e5b07ac577176a0833` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.492840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=080e1ad5bb3144e5b07ac577176a0833)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.494999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.497264 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1793/3612] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:01 2022] GET /identity/v3/projects/080e1ad5bb3144e5b07ac577176a0833 => generated 404 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:01.514812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.526802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.528923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:01.535662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da075b3-510c-4467-8f32-900a97ebfad7 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.547467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.548315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.548603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.548881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/080e1ad5bb3144e5b07ac577176a0833` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.553029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=080e1ad5bb3144e5b07ac577176a0833)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.555370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.647796 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.676361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080e1ad5bb3144e5b07ac577176a0833', 'request_id': 'req-5ad40a4c-2e28-4009-808b-76f0f97bacd2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.679980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f751dc-947f-40fa-af06-47d552471eae tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.692845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080e1ad5bb3144e5b07ac577176a0833', 'request_id': 'req-5ad40a4c-2e28-4009-808b-76f0f97bacd2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.703072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080e1ad5bb3144e5b07ac577176a0833', 'request_id': 'req-5ad40a4c-2e28-4009-808b-76f0f97bacd2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.737673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 080e1ad5bb3144e5b07ac577176a0833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:01.737897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.739384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.743792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1820/3613] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:01 2022] DELETE /identity/v3/projects/080e1ad5bb3144e5b07ac577176a0833 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:01.747867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.749688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:01.806713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.807860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.808421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.808713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.811095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:01.848379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40a4c-2e28-4009-808b-76f0f97bacd2 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.853392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:01.854149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:01.854503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:01.854847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/0fa2f4d41f864266874b16277a974b45` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:01.856667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0fa2f4d41f864266874b16277a974b45)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.859019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.897623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.898457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.935327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:01.938758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:01.951793 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1794/3614] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:01.956005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.956921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:01.960636 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1821/3615] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:13:01 2022] PATCH /identity/v3/domains/0fa2f4d41f864266874b16277a974b45 => generated 277 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:01.965832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:01.978135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca524bf-d8e6-4f86-a91f-bc37789ab2dc service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:01.993973 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:02.103800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:02.104459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:02.104789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:02.105067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/0fa2f4d41f864266874b16277a974b45` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:02.119644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0fa2f4d41f864266874b16277a974b45)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:02.122394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:02.155285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.162297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0fa2f4d41f864266874b16277a974b45'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.276845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.289693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.308019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.345886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 0fa2f4d41f864266874b16277a974b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:02.348472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.355021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.377092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.383624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.393180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0fa2f4d41f864266874b16277a974b45', 'request_id': 'req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:02.404268 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1795/3616] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:01 2022] DELETE /identity/v3/domains/0fa2f4d41f864266874b16277a974b45 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:02.412191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:02.413842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:02.442007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561d528-2a37-4657-beab-d2c89a80e008 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:02.550049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:02.550743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:02.551144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:02.551599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:02.552485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:02.554343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:02.577602 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1822/3617] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:13:02 2022] POST /identity/v3/domains => generated 276 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:02.582503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:02.584890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:02.617118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a2b4-4529-4a83-92e1-79b1dc63b6d0 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:02.755788 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:02.781476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:02.787852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:02.788181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:02.788461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:02.789121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:02.802790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:02.899557 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1796/3618] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:02 2022] POST /identity/v3/projects => generated 409 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:02.904153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:02.921195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf5d6-2a50-41c6-93b6-f0ddf724bcbd tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:02.946147 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:03.028412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:03.029700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:03.030143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:03.030269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:03.030842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:03.032047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:03.032201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:03.034782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:03.108795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1823/3619] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:02 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:03.112888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:03.204186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97224-3ddc-4e81-aeaf-0de7d3693688 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:03.244258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd7ac-18ed-426a-992e-c01d5b69f865 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:03.255420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:03.256482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:03.256868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:03.257552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/ca8d17a1245b4e6d904893d284129d57` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:03.260377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca8d17a1245b4e6d904893d284129d57)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:03.264130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:03.368806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8d17a1245b4e6d904893d284129d57', 'request_id': 'req-67fa1868-b544-4298-abf8-a35c97015b7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.374195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:03.374952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:03.375338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:03.376128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:03.378580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:03.380091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8d17a1245b4e6d904893d284129d57', 'request_id': 'req-67fa1868-b544-4298-abf8-a35c97015b7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.388229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8d17a1245b4e6d904893d284129d57', 'request_id': 'req-67fa1868-b544-4298-abf8-a35c97015b7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.406307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project ca8d17a1245b4e6d904893d284129d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:03.408324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.409177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.415067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1824/3620] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:03 2022] DELETE /identity/v3/projects/ca8d17a1245b4e6d904893d284129d57 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:03.416273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:03.420599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:03.423028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:03.423190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:03.458931 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1797/3621] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:03.487614 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:03.597705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1868-b544-4298-abf8-a35c97015b7e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:03.603901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:03.604567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:03.604894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:03.605103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/d5c661ebc55d4239b41b4b9252191750` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:03.606890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5c661ebc55d4239b41b4b9252191750)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:03.608850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:03.695315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c661ebc55d4239b41b4b9252191750', 'request_id': 'req-77bf18e8-a000-4506-b702-dbb88b688866'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.707581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c661ebc55d4239b41b4b9252191750', 'request_id': 'req-77bf18e8-a000-4506-b702-dbb88b688866'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.726763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c661ebc55d4239b41b4b9252191750', 'request_id': 'req-77bf18e8-a000-4506-b702-dbb88b688866'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.752582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project d5c661ebc55d4239b41b4b9252191750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:03.752885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.753668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.756303 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1825/3622] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:03 2022] DELETE /identity/v3/projects/d5c661ebc55d4239b41b4b9252191750 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:03.761367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:03.778301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557b83-7675-40b5-9823-a4d36239282b service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:03.865238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:03.866509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:03.866904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:03.867342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:03.868826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=49a92aa4aca048f19d3c30abcf8b8c72)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:03.871274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:03.886087 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:03.919464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.924354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.967890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.968568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0745e477-67cf-4cf7-b8a8-a80101627103 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:03.972912 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1798/3623] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:13:03 2022] PATCH /identity/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72 => generated 277 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:03.976275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:03.977770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:03.991923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf18e8-a000-4506-b702-dbb88b688866 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:04.148847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:04.152360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.152702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.152973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.186603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=49a92aa4aca048f19d3c30abcf8b8c72)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:04.192635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:04.256050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.270480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.350803 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:04.398456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.408632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d881a3-1772-475f-bf5c-f9098c0a7ec7 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.408632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d881a3-1772-475f-bf5c-f9098c0a7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.408632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d881a3-1772-475f-bf5c-f9098c0a7ec7 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.410195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1799/3624] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 25 01:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:13:04.414969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.417458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f26-9a13-4192-b018-4d3a78e4f02a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.417756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f26-9a13-4192-b018-4d3a78e4f02a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.418029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f26-9a13-4192-b018-4d3a78e4f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.433072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.456436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 49a92aa4aca048f19d3c30abcf8b8c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:04.456894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.457705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.497511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.497511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.504590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '49a92aa4aca048f19d3c30abcf8b8c72', 'request_id': 'req-7545b311-cbdb-4af3-aa60-5af30fa73ede'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:04.514526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1826/3625] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:03 2022] DELETE /identity/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:04.529673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:04.533529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:04.546089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e49d8f26-9a13-4192-b018-4d3a78e4f02a None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:04.552220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e49d8f26-9a13-4192-b018-4d3a78e4f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:04.715016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b311-cbdb-4af3-aa60-5af30fa73ede tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:04.721706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:04.722510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.722893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.724796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.725714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:04.727681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:04.755546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1800/3626] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:04.763734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.764227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.764649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.804030 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1827/3627] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:04 2022] POST /identity/v3/projects => generated 376 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:04.805421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:04.810342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:04.842711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] MFA Rules not processed for user `4c25e53535f348718d8bf85e020ec15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:04.845313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:04.946565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6579e18-5f6a-49e0-8ebe-9e7bbcb8d91c tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:04.950681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:04.951555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:04.952018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:04.952468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:04.961152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1801/3628] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:04.962138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.008476 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:05.030575 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:05.060958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35585-4f2b-46c2-b5b4-2324f00e39d7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.062573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.065390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.067333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.067994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.068372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.068658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/399c6ea4a7324c8b8ac359751d2ce4f7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.069910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=399c6ea4a7324c8b8ac359751d2ce4f7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.076347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.081471 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1802/3629] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:04 2022] GET /identity/v3/projects/399c6ea4a7324c8b8ac359751d2ce4f7 => generated 376 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:05.081471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.081708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:05.081859 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1828/3630] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:05.093000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.104677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666def-1184-44ff-b9af-7854c970f20d tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.104920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894dcd-3f9b-4bb1-a904-08ed5a28490d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.112708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.113336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.113486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.113713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.113985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.114343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.115138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.116081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.116804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.119725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.123432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.125566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.153583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1803/3631] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:05.155525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1829/3632] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:13:05 2022] GET /identity/v3/projects => generated 6916 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:05.168944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.198387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711144c-4340-4dd0-9544-84df8bc30830 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.204251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.205793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.206342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.206911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/399c6ea4a7324c8b8ac359751d2ce4f7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.208587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=399c6ea4a7324c8b8ac359751d2ce4f7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.211306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.326559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399c6ea4a7324c8b8ac359751d2ce4f7', 'request_id': 'req-5a20c3e9-5f92-4a25-924e-422bc24c4a25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:05.338463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399c6ea4a7324c8b8ac359751d2ce4f7', 'request_id': 'req-5a20c3e9-5f92-4a25-924e-422bc24c4a25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:05.349687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399c6ea4a7324c8b8ac359751d2ce4f7', 'request_id': 'req-5a20c3e9-5f92-4a25-924e-422bc24c4a25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:05.378102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 399c6ea4a7324c8b8ac359751d2ce4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:05.378411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:05.379228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:05.385478 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1804/3633] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:05 2022] DELETE /identity/v3/projects/399c6ea4a7324c8b8ac359751d2ce4f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:05.386737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.393227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:05.442350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb74ef-6c65-4632-a3ef-20e5bbcc6177 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.587611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.588924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.589753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.590203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.606120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.608261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.665763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1830/3634] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:13:05 2022] POST /identity/v3/projects => generated 348 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:05.670047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.698995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20c3e9-5f92-4a25-924e-422bc24c4a25 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.841150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.842297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.842297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.842508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/d68c7524a5584c63ae03e37d85e7492d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.850148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_project(project_id=d68c7524a5584c63ae03e37d85e7492d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.851195 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:05.851195 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:05.851195 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:05.852783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:05.912175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1805/3635] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:13:05 2022] PATCH /identity/v3/projects/d68c7524a5584c63ae03e37d85e7492d => generated 361 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:05.915108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:05.928654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ce0a-6564-4a58-890a-7564f77187da tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:05.947627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:05.950022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:05.950693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:05.950693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/d68c7524a5584c63ae03e37d85e7492d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:05.992556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=d68c7524a5584c63ae03e37d85e7492d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:05.998773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.003756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1831/3636] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:05 2022] GET /identity/v3/projects/d68c7524a5584c63ae03e37d85e7492d => generated 348 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:06.008706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.026470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b5f5-c752-4bc2-8591-118975869d5b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.039919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.040585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.040870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.041298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/d68c7524a5584c63ae03e37d85e7492d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.045677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d68c7524a5584c63ae03e37d85e7492d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.049105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.088315 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:06.148761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68c7524a5584c63ae03e37d85e7492d', 'request_id': 'req-2bffac82-bb46-4865-ac72-8e30b379b8ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.159083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68c7524a5584c63ae03e37d85e7492d', 'request_id': 'req-2bffac82-bb46-4865-ac72-8e30b379b8ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.168078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68c7524a5584c63ae03e37d85e7492d', 'request_id': 'req-2bffac82-bb46-4865-ac72-8e30b379b8ca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.184402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project d68c7524a5584c63ae03e37d85e7492d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:06.185097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.186432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.194357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1806/3637] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:06 2022] DELETE /identity/v3/projects/d68c7524a5584c63ae03e37d85e7492d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:06.196482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.202683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:06.232539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0678d-5267-43f3-ac07-22a318284e93 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.323247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.324257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.324608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.325029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.325798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.328067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.379317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1832/3638] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:06 2022] POST /identity/v3/projects => generated 360 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:06.383492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.398526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffac82-bb46-4865-ac72-8e30b379b8ca tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.481533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.482205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.482489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.482769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/0d6a6767847143e9bd8a0caa17c744ec` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.484308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_project(project_id=0d6a6767847143e9bd8a0caa17c744ec)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.487288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.559340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1807/3639] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:13:06 2022] PATCH /identity/v3/projects/0d6a6767847143e9bd8a0caa17c744ec => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:06.560552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.568539 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:06.575636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3918-f26b-4293-ba58-c724ec05f220 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.583839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.584671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.585386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.585800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/0d6a6767847143e9bd8a0caa17c744ec` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.599911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d6a6767847143e9bd8a0caa17c744ec)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.602208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.606933 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1833/3640] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:06 2022] GET /identity/v3/projects/0d6a6767847143e9bd8a0caa17c744ec => generated 359 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:06.608487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.619484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e2c9-c76b-43e8-90bc-edf29383b061 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.624177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.624802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.625098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.625991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/0d6a6767847143e9bd8a0caa17c744ec` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.627464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d6a6767847143e9bd8a0caa17c744ec)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.629370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.680743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6a6767847143e9bd8a0caa17c744ec', 'request_id': 'req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.687430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6a6767847143e9bd8a0caa17c744ec', 'request_id': 'req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.694769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6a6767847143e9bd8a0caa17c744ec', 'request_id': 'req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.698915 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:06.711173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 0d6a6767847143e9bd8a0caa17c744ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:06.711438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.713815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:06.715376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1808/3641] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:06 2022] DELETE /identity/v3/projects/0d6a6767847143e9bd8a0caa17c744ec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:06.720723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.722657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:06.735976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cee992-3217-4828-b83a-b9aa9aa16e78 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.814737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.815948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.816388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.816877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.817819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.820725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:06.858584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1834/3642] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:06 2022] POST /identity/v3/projects => generated 354 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:06.863337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:06.883587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be103f-ce1c-4398-8ddc-d8bdafa9c697 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:06.981101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:06.982574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:06.982954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:06.984257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:06.986129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:update_project(project_id=8cf1a563c9114aa09dc66bf1df4b16f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:06.988117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:07.033452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1809/3643] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:13:06 2022] PATCH /identity/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2 => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:07.035047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.049497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14760a-f843-419a-a18b-2c33f05ab84b tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.059450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.060148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.060549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.060902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.076453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cf1a563c9114aa09dc66bf1df4b16f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:07.079193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:07.081356 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1835/3644] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:07 2022] GET /identity/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2 => generated 355 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:07.085241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.096431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702c91-06f5-467a-b68c-5281350784ee tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.121731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.122722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.123082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.123807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.127618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8cf1a563c9114aa09dc66bf1df4b16f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:07.130789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:07.196651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf1a563c9114aa09dc66bf1df4b16f2', 'request_id': 'req-9dbd05e9-2b76-4e36-b1f5-59330560129f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.205457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf1a563c9114aa09dc66bf1df4b16f2', 'request_id': 'req-9dbd05e9-2b76-4e36-b1f5-59330560129f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.212618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf1a563c9114aa09dc66bf1df4b16f2', 'request_id': 'req-9dbd05e9-2b76-4e36-b1f5-59330560129f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.229297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] The token cache is being invalidate because project 8cf1a563c9114aa09dc66bf1df4b16f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:07.229627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.230314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.231875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1810/3645] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:07 2022] DELETE /identity/v3/projects/8cf1a563c9114aa09dc66bf1df4b16f2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:07.238137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.240709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:07.255324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656efee-ad9f-40ed-96bd-b5160ebee685 tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.333638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.334195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.334792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.334934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.342879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Could not find domain: 49a92aa4aca048f19d3c30abcf8b8c72.: keystone.exception.DomainNotFound: Could not find domain: 49a92aa4aca048f19d3c30abcf8b8c72. Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 49a92aa4aca048f19d3c30abcf8b8c72. Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:13:07.348645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:13:07.349958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 49a92aa4aca048f19d3c30abcf8b8c72. Sep 25 01:13:07.351300 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:07.352733 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1836/3646] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:13:07 2022] PATCH /identity/v3/domains/49a92aa4aca048f19d3c30abcf8b8c72 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:13:07.354210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.367301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd05e9-2b76-4e36-b1f5-59330560129f tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.372716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e49706fbc3694b6e93303ca7d69c2ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1d1b09d7354577bc2f4810898ec1c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.373486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.373862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.374210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] PATH_INFO: `/v3/domains/0fa2f4d41f864266874b16277a974b45` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.385477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-49d7a0a2-3918-4648-83aa-2cd6afb9edff tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Could not find domain: 0fa2f4d41f864266874b16277a974b45.: keystone.exception.DomainNotFound: Could not find domain: 0fa2f4d41f864266874b16277a974b45. Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0fa2f4d41f864266874b16277a974b45. Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:13:07.389160 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:13:07.390565 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0fa2f4d41f864266874b16277a974b45. Sep 25 01:13:07.392814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:13:07.402048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1811/3647] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:13:07 2022] PATCH /identity/v3/domains/0fa2f4d41f864266874b16277a974b45 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:13:07.406653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.408663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:07.506254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dea6a-c43c-4a46-8bca-2bbb2d4e873e tempest-ProjectsTestJSON-1598203422 tempest-ProjectsTestJSON-1598203422-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.512721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.513533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.513824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.514125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] PATH_INFO: `/v3/users/4f5abed0fb384ab0b1930508db1c7682` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.515277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5abed0fb384ab0b1930508db1c7682)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:07.518359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:07.522807 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:07.593051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5abed0fb384ab0b1930508db1c7682'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.606867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5abed0fb384ab0b1930508db1c7682'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.626940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5abed0fb384ab0b1930508db1c7682'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.627926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5abed0fb384ab0b1930508db1c7682'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.628711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5abed0fb384ab0b1930508db1c7682'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:07.646864 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1837/3648] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:07 2022] DELETE /identity/v3/users/4f5abed0fb384ab0b1930508db1c7682 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:07.652837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684bd5f-69e4-418d-abdb-8e0a42134f24 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.653123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684bd5f-69e4-418d-abdb-8e0a42134f24 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.655891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684bd5f-69e4-418d-abdb-8e0a42134f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.684753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b684bd5f-69e4-418d-abdb-8e0a42134f24 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:07.686970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b684bd5f-69e4-418d-abdb-8e0a42134f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:07.742711 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:07.770041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1812/3649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:07.779327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:07.781195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:07.867472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682b60-2efe-4723-ac65-8a793f70d22a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:07.872952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:07.874198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:07.874198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:07.874564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:07.903028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:07.905738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:07.926213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1838/3650] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:08.492886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:08.493872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:08.494155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:08.520979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] MFA Rules not processed for user `4c25e53535f348718d8bf85e020ec15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:08.522272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:08.597558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1813/3651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:08.726870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:08.728433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:08.744590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560accf-891d-4290-b4e5-0012db8ad12e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:08.758339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:08.759550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:08.759933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:08.760327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] PATH_INFO: `/v3/projects/fa28a8cd543845c9a16b3a20a2bed196` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:08.767681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa28a8cd543845c9a16b3a20a2bed196)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:08.770062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:08.900229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa28a8cd543845c9a16b3a20a2bed196', 'request_id': 'req-38e13c73-960e-4c0f-9da3-05d636a0d306'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:08.911020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa28a8cd543845c9a16b3a20a2bed196', 'request_id': 'req-38e13c73-960e-4c0f-9da3-05d636a0d306'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:08.919040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa28a8cd543845c9a16b3a20a2bed196', 'request_id': 'req-38e13c73-960e-4c0f-9da3-05d636a0d306'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:08.939151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] The token cache is being invalidate because project fa28a8cd543845c9a16b3a20a2bed196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:08.939440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:08.943031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:08.949097 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1839/3652] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:08 2022] DELETE /identity/v3/projects/fa28a8cd543845c9a16b3a20a2bed196 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:08.952863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:08.969928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8403-f0f6-47e8-b8a2-f5ae7fb63d1b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:09.098550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:09.099356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:09.099729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:09.099995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] PATH_INFO: `/v3/users/e49706fbc3694b6e93303ca7d69c2ed2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:09.101145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49706fbc3694b6e93303ca7d69c2ed2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:09.105031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:09.190194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49706fbc3694b6e93303ca7d69c2ed2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:09.191285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49706fbc3694b6e93303ca7d69c2ed2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:09.201587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49706fbc3694b6e93303ca7d69c2ed2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:09.219885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49706fbc3694b6e93303ca7d69c2ed2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:09.220869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05471471-f222-49b1-8635-d35e6ce04856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49706fbc3694b6e93303ca7d69c2ed2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:09.238637 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1814/3653] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:08 2022] DELETE /identity/v3/users/e49706fbc3694b6e93303ca7d69c2ed2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:09.728961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:09.741497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:09.775525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13c73-960e-4c0f-9da3-05d636a0d306 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:09.783268 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:09.921370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:09.923807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:09.923807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:09.923807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] PATH_INFO: `/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:09.924855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1d1b09d7354577bc2f4810898ec1c1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:09.926881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.015872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1d1b09d7354577bc2f4810898ec1c1', 'request_id': 'req-3c9fea37-fc26-4f8b-989a-a77c152d7168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:10.035579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1d1b09d7354577bc2f4810898ec1c1', 'request_id': 'req-3c9fea37-fc26-4f8b-989a-a77c152d7168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:10.054255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1d1b09d7354577bc2f4810898ec1c1', 'request_id': 'req-3c9fea37-fc26-4f8b-989a-a77c152d7168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:10.074763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] The token cache is being invalidate because project 5a1d1b09d7354577bc2f4810898ec1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:10.075245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:10.094339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c9fea37-fc26-4f8b-989a-a77c152d7168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:10.094339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1840/3654] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:09 2022] DELETE /identity/v3/projects/5a1d1b09d7354577bc2f4810898ec1c1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:10.099769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.100215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.101639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.153528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:10.154774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:10.182540 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:10.267789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1815/3655] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:10.276397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.277000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.277510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.314389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:10.317560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:10.340709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1841/3656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:10.346236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.374404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3135-2d25-4661-85d8-ab079e4c04f7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.382336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.383475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.384241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.384784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.386224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:10.386744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.389477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.426503 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1816/3657] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:10.430685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.442890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6d0a-c0aa-4522-b0f4-a9873b858a93 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.457033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.457884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.459219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.459505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.460529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.462528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.515696 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1842/3658] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:10.520174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.536859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5ed8-58a4-4cb7-9bd2-25a813aef837 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.614045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.614686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.614967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.615337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.615859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.617881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.649297 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1817/3659] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:10.650522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.662593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae7e9f-9e70-47e5-8c9c-c51591c61acb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.667961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.668534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.668813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.669082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.669761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.671361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.685593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1843/3660] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:10.688722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.700561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f2bf9-b8e2-4cc7-beb2-6e42fca75b7f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.706780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.707512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.707752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.707973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.708630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.710411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc9542-8b61-44fe-af5e-62f4f535bfc9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.723883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1818/3661] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:10.728036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.739950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763e2f-bab9-4f51-8ac3-360d4df433c1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.747170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.748147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.748477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.748839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] PATH_INFO: `/v3/projects/347f7c37a4394cf388e0360b7d8a4133/users/58d43b6118204c24b6220df883aacf1e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.771205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=347f7c37a4394cf388e0360b7d8a4133, user_id=58d43b6118204c24b6220df883aacf1e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.773979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:10.788735 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1844/3662] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:10 2022] PUT /identity/v3/projects/347f7c37a4394cf388e0360b7d8a4133/users/58d43b6118204c24b6220df883aacf1e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:10.799498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.799759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.800043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.829839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] MFA Rules not processed for user `58d43b6118204c24b6220df883aacf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:10.831294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:10.900472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1819/3663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:10.904970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:10.946971 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:10.985282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4fb3-5b52-43b0-9209-7bba68358e5e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:10.990246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:10.990916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:10.991145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:10.991428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:10.992098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:10.994093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.039031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1845/3664] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:10 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:11.040225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.052035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bbd6a-3af1-4974-8824-e8d2765e6177 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.058804 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:11.142172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.143175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.143340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.143735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.144441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.146629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.172343 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1820/3665] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:11 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:11.176576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.191200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680b8d-3053-4913-a723-0a13933c0b67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.196098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.196739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.197390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.197891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.198580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.200217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.212187 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1846/3666] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:11.216339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.227037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24860442-9dc5-403b-8531-4e02bb7a2585 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.231810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.232499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.232792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.233090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] PATH_INFO: `/v3/projects/43f6be4493724b86be252adffb7e31cb/users/d4865c08de29410b9eb100e71cd2f697/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.249721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f6be4493724b86be252adffb7e31cb, user_id=d4865c08de29410b9eb100e71cd2f697, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.253361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.268486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1821/3667] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:11 2022] PUT /identity/v3/projects/43f6be4493724b86be252adffb7e31cb/users/d4865c08de29410b9eb100e71cd2f697/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:11.272558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.283083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728368-1e0d-4aab-a265-e457eb7f02bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.354550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.355638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.355771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.356064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.356892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.358700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66a2e7-f615-4d19-84e5-6b2200cdc17e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.375752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.376780 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1847/3668] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:11.394551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcbe40-cd21-40eb-8088-cfc4a33b4c94 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.399606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.400353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.400643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.400918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] PATH_INFO: `/v3/projects/43f6be4493724b86be252adffb7e31cb/users/d4865c08de29410b9eb100e71cd2f697/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.403343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f6be4493724b86be252adffb7e31cb, user_id=d4865c08de29410b9eb100e71cd2f697, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.406246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.431115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.431466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.431818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.434431 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1822/3669] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:11 2022] PUT /identity/v3/projects/43f6be4493724b86be252adffb7e31cb/users/d4865c08de29410b9eb100e71cd2f697/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:11.469873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] MFA Rules not processed for user `d4865c08de29410b9eb100e71cd2f697`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:11.471685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:11.581088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1848/3670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:11.584421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.596776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8cbb-0c64-4586-933e-6b4607add13d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.602665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.603392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.603674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.603959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.604919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.606182 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:11.606182 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:11.606182 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:11.608313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.647987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1823/3671] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:13:11 2022] POST /identity/v3/regions => generated 224 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:11.651986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.664266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc6b42-79fe-4158-a48f-58bb7ff9c09d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.700750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.701117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.701485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.701772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.702437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.703705 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:11.703705 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:11.703705 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:11.708210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.740426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1849/3672] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:13:11 2022] POST /identity/v3/regions => generated 223 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:11.745344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.758787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ae79-18aa-4cc2-b619-29cafe07d7fb tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.777207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.778490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.778787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.779076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/ff6482ff-53ce-4250-99cc-b639ebf586ff` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.779749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:create_region(region_id=ff6482ff-53ce-4250-99cc-b639ebf586ff)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.783110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.810154 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1824/3673] 10.222.0.16 () {60 vars in 1259 bytes} [Sun Sep 25 01:13:11 2022] PUT /identity/v3/regions/ff6482ff-53ce-4250-99cc-b639ebf586ff => generated 231 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:11.814383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.822019 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:11.833542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ffaad-5e49-43d0-acbb-0cbf933cca30 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.852953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.853650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.853933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.854205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/ff6482ff-53ce-4250-99cc-b639ebf586ff` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.854817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ff6482ff-53ce-4250-99cc-b639ebf586ff)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.855817 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:11.855817 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:11.855817 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:11.856715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:11.889855 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1850/3674] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:13:11 2022] DELETE /identity/v3/regions/ff6482ff-53ce-4250-99cc-b639ebf586ff => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:11.891703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:11.924143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7d49-98a0-48de-b781-2c598829a1b4 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:11.978099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:11.979154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:11.979668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:11.980160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:11.981059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:11.987774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.041052 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1825/3675] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:13:11 2022] POST /identity/v3/regions => generated 254 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:12.046029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.061299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e919-03b4-48a5-b24e-ddcac2fdc352 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.099909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.100576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.100864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.101143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.101852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:update_region(region_id=0c956fbeb41a4b9e8d633e1ec8521c84)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.102874 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:12.102874 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:12.102874 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:12.103871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.174999 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1851/3676] 10.222.0.16 () {60 vars in 1250 bytes} [Sun Sep 25 01:13:12 2022] PATCH /identity/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84 => generated 254 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:12.176269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.200563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c28c7-7e2e-4815-9412-f1bad5a53ae5 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.272336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.273009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.273272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.274344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.285440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:get_region(region_id=0c956fbeb41a4b9e8d633e1ec8521c84)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.285440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.296549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1826/3677] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:13:12 2022] GET /identity/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84 => generated 254 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:12.300827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.320532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d3489-b91b-43c7-9639-ad0747e9eed9 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.338714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.339381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.339668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.340105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.340711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0c956fbeb41a4b9e8d633e1ec8521c84)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.342368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.395394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1852/3678] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:12.399049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.423708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aea6e-5bd0-44d7-b95b-d8f0131ce442 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.445779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.446650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.446807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.447169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.448799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.450393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.464844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1827/3679] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:13:12 2022] GET /identity/v3/regions => generated 669 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:12.466876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.482735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed309-3cd5-4ffc-a1ee-111c6f55eaca tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.491551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.492397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.493173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.493423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.494184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0c956fbeb41a4b9e8d633e1ec8521c84)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.495824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Could not find region: 0c956fbeb41a4b9e8d633e1ec8521c84.: keystone.exception.RegionNotFound: Could not find region: 0c956fbeb41a4b9e8d633e1ec8521c84. Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 0c956fbeb41a4b9e8d633e1ec8521c84. Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:13:12.515500 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 0c956fbeb41a4b9e8d633e1ec8521c84. Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:12.525240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1853/3680] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/regions/0c956fbeb41a4b9e8d633e1ec8521c84 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:13:12.526784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.538529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fcc66-4ccc-492e-a22a-a9e2e89b7b3f tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.550813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.551543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.551996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.552322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.553006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.555113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.566439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1828/3681] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:13:12 2022] GET /identity/v3/regions => generated 669 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:12.571272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.583594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb8cb-24d9-4cca-bb08-75993b02537c tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.588995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.590009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.590396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.590738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.591617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.594028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.634592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1854/3682] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:13:12 2022] POST /identity/v3/regions => generated 254 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:12.639615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.651659 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:12.673980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a75d-5097-4e84-9127-5a6d4d52feb2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.709048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.709883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.710003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.710425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.711374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Adding query filter params (parent_region_id=ffd3841d38894425a99834550f23fa21) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:12.711374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.712415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.719781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1829/3683] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:13:12 2022] GET /identity/v3/regions?parent_region_id=ffd3841d38894425a99834550f23fa21 => generated 400 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:12.724033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.736078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134598-bc2c-4bf1-b796-27014236f461 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.743194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.744608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.745542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.745988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/688a523ff2bc4e41acbc221c85b2fa2b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.746771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=688a523ff2bc4e41acbc221c85b2fa2b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.748770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.785158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.785974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1855/3684] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/regions/688a523ff2bc4e41acbc221c85b2fa2b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:12.799984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe95b1d-7ba8-4031-9ae7-f1fa80689ebe tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.819981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.820647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.821118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.821429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/9f0a944a250c4d9d862396591dc0cbce` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.822042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9f0a944a250c4d9d862396591dc0cbce)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.823114 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:12.823114 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:12.823114 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:12.824165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.853689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1830/3685] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/regions/9f0a944a250c4d9d862396591dc0cbce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:12.857653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:12.875147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ff51d-6941-4b61-9a9a-e0ec356d89dd tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:12.901187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4865c08de29410b9eb100e71cd2f697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f6be4493724b86be252adffb7e31cb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:12.902411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:12.902869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:12.903332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] PATH_INFO: `/v3/regions/ffd3841d38894425a99834550f23fa21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:12.904119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ffd3841d38894425a99834550f23fa21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:12.905902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c429dd0-cff0-48af-98e6-6cbc21dbdaef tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:12.928439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1856/3686] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/regions/ffd3841d38894425a99834550f23fa21 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:12.932440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:13.055693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f17-0f65-4992-ba76-43c0992b58f2 tempest-RegionsTestJSON-693572895 tempest-RegionsTestJSON-693572895-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:13.079270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:13.079930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.080215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.080659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] PATH_INFO: `/v3/users/58d43b6118204c24b6220df883aacf1e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.083044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d43b6118204c24b6220df883aacf1e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:13.085176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:13.171617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d43b6118204c24b6220df883aacf1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.172465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d43b6118204c24b6220df883aacf1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.180709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d43b6118204c24b6220df883aacf1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.194863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d43b6118204c24b6220df883aacf1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.195628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d43b6118204c24b6220df883aacf1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.212102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1831/3687] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:12 2022] DELETE /identity/v3/users/58d43b6118204c24b6220df883aacf1e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:13.216552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.216844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.217174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.237213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:13.238487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:13.301163 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:13.321585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1857/3688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:13.323707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:13.325252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:13.357723 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:13.429064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0406f4-5733-4780-b000-8185937fd60b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:13.449199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:13.449199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.449199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.449199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.458381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:13.460562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:13.473511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:13.477722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806cf9-5685-4a74-b39e-422e59a418d3 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:13.493918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1832/3689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:13.503509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c4d8e-4f4f-4476-9fca-ae26f64fc7b1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:13.521257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:13.522933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.523724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.524560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] PATH_INFO: `/v3/users/b1bc0ffad726490cb6501becbc822449` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.526808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bc0ffad726490cb6501becbc822449)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:13.530432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:13.658831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bc0ffad726490cb6501becbc822449'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.668401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bc0ffad726490cb6501becbc822449'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.694251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bc0ffad726490cb6501becbc822449'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.695873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bc0ffad726490cb6501becbc822449'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.696837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bc0ffad726490cb6501becbc822449'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:13.722247 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1858/3690] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:13 2022] DELETE /identity/v3/users/b1bc0ffad726490cb6501becbc822449 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:13.726690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.726973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.727322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.764648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:13.766078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:13.862124 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1833/3691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:13.879997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:13.884459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:13.978400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27b13-5256-4cb8-9d12-2a6981a1d293 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:13.983399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:13.984870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:13.985247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:13.985760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:13.996187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:13.998005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:14.009240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1859/3692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:14.120478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:14.123480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:14.137960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3aecf-208a-4f67-a707-903b1e830962 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:14.145279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:14.155933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:14.157828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:14.158106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] PATH_INFO: `/v3/projects/347f7c37a4394cf388e0360b7d8a4133` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:14.159531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=347f7c37a4394cf388e0360b7d8a4133)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:14.162042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:14.235985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347f7c37a4394cf388e0360b7d8a4133', 'request_id': 'req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.244672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347f7c37a4394cf388e0360b7d8a4133', 'request_id': 'req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.252579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347f7c37a4394cf388e0360b7d8a4133', 'request_id': 'req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.272970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] The token cache is being invalidate because project 347f7c37a4394cf388e0360b7d8a4133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:14.273309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.275146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.280624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1834/3693] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:14 2022] DELETE /identity/v3/projects/347f7c37a4394cf388e0360b7d8a4133 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:14.283201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:14.296016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b978-7b2d-495f-8a7a-b5ab4723ea29 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:14.443917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:14.444574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:14.444860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:14.445556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] PATH_INFO: `/v3/users/d4865c08de29410b9eb100e71cd2f697` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:14.446401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4865c08de29410b9eb100e71cd2f697)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:14.448451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:14.475609 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:14.535745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4865c08de29410b9eb100e71cd2f697'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.547586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4865c08de29410b9eb100e71cd2f697'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.565527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4865c08de29410b9eb100e71cd2f697'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.566384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4865c08de29410b9eb100e71cd2f697'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.567050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67f8f74d-6298-4e78-bfb1-303cbdc29a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4865c08de29410b9eb100e71cd2f697'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:14.607772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1860/3694] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:14 2022] DELETE /identity/v3/users/d4865c08de29410b9eb100e71cd2f697 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:14.926265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:14.926265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:14.949088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6abad9-7cdf-4adb-a3e9-9083b80ba4ef admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.000831 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:15.033043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.033795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.034142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.034482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] PATH_INFO: `/v3/projects/43f6be4493724b86be252adffb7e31cb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.035736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f6be4493724b86be252adffb7e31cb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.037804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.091003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f6be4493724b86be252adffb7e31cb', 'request_id': 'req-66074744-77ad-4bc8-847c-6d28097a3f25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.098908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f6be4493724b86be252adffb7e31cb', 'request_id': 'req-66074744-77ad-4bc8-847c-6d28097a3f25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.106103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f6be4493724b86be252adffb7e31cb', 'request_id': 'req-66074744-77ad-4bc8-847c-6d28097a3f25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.119247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] The token cache is being invalidate because project 43f6be4493724b86be252adffb7e31cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:15.119743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.120472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.122235 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1835/3695] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:14 2022] DELETE /identity/v3/projects/43f6be4493724b86be252adffb7e31cb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:15.129737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42468-1db0-4720-b089-5c07ff4fdb5e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.134581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42468-1db0-4720-b089-5c07ff4fdb5e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.134581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42468-1db0-4720-b089-5c07ff4fdb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.142033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.143907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.193947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-99e42468-1db0-4720-b089-5c07ff4fdb5e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:15.198384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99e42468-1db0-4720-b089-5c07ff4fdb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.248954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66074744-77ad-4bc8-847c-6d28097a3f25 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.254777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.255336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.255755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.256037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] PATH_INFO: `/v3/projects/52871d02d6f348c78767e9f62627b539` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.257211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52871d02d6f348c78767e9f62627b539)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.259179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.267603 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1861/3696] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:15.276137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.276496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.277520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.299635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:15.300947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.324257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52871d02d6f348c78767e9f62627b539', 'request_id': 'req-75bec265-3cf4-4c7a-978b-5455ab16bc73'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.331275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52871d02d6f348c78767e9f62627b539', 'request_id': 'req-75bec265-3cf4-4c7a-978b-5455ab16bc73'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.338669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52871d02d6f348c78767e9f62627b539', 'request_id': 'req-75bec265-3cf4-4c7a-978b-5455ab16bc73'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.342811 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:15.357458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] The token cache is being invalidate because project 52871d02d6f348c78767e9f62627b539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:15.358752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.359651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75bec265-3cf4-4c7a-978b-5455ab16bc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:15.361582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1836/3697] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:15 2022] DELETE /identity/v3/projects/52871d02d6f348c78767e9f62627b539 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:15.367155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479972e2-172e-4503-8147-0dd53edabc9b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.367498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479972e2-172e-4503-8147-0dd53edabc9b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.368290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479972e2-172e-4503-8147-0dd53edabc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.377537 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1862/3698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:15.387381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.395085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-479972e2-172e-4503-8147-0dd53edabc9b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:15.396373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-479972e2-172e-4503-8147-0dd53edabc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.398397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189dea-8c6c-43c5-876b-eec09ed0f71c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.403869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.404484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.404765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.405059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.405788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:15.406169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.407889 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1837/3699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:15.418347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.418553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.418553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.418553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.430258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1863/3700] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:15.439848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:15.441300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.448672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.456908 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1838/3701] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:15.458426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.464926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534b8de-311c-4fdd-a14b-f220c8e81ad0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.469657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56faf7-91d9-4f12-8c9e-669d14bfbe85 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.472770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.473437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.473804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.474146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.474591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.474928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.475206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.475487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.475759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.476412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:15.476755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.477282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.478635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.501860 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1839/3702] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:15.506745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.519983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094ed20-4a6c-42f0-8081-06bc705148af admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.520815 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:15.525317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.526053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.526341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.526618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.527625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.529804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.542195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1864/3703] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:15.544026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.570517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1840/3704] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:15.577061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.682710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9adfd-09d9-4f48-9a6e-24000a55eaee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.690305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.691323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.691640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.691998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.692669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.694974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.701428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0025fc-fd3f-4a39-9d8f-9efa5ed1f6fc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.714200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.715071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.715364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.715918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.716723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.719312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.728258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1865/3705] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:15.732537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.747437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2543-dc86-4cda-8aa8-df18878f1c5e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.756413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.757869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.759949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.760238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.762882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1841/3706] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:15.766146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.766691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.768547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.783371 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1866/3707] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:15.789760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.789962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373f34-ad42-4f1c-a6cc-4693b9379766 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.795679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.796506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.798237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.798706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.799529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.801665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.802527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5963-df2f-406c-ab3e-7b39ca64133c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.808468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.809089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.809583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.809866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.810594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.812246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.817285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1842/3708] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:15.820965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.828408 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1867/3709] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:15.832150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.840541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e92a-1dd9-4467-bb08-1e9dd10ca40f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.845539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b7aa4-321c-40f2-b347-d7d20ea24910 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.849757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.850517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.851135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.851254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.851425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.851549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.851697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.851814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] PATH_INFO: `/v3/projects/d88ba7be5a1041068579c20b334fb0ed/users/be29c331c79e4da2950862782bdd52cc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.852345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.859035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.870610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88ba7be5a1041068579c20b334fb0ed, user_id=be29c331c79e4da2950862782bdd52cc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:15.875930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1843/3710] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:15.876486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96e0aa-9ffa-4356-ab10-f0d472c5e1dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:15.880458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:15.892753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcbd4-0674-45e0-8cf9-a7e2372d3631 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:15.896041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1868/3711] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:15 2022] PUT /identity/v3/projects/d88ba7be5a1041068579c20b334fb0ed/users/be29c331c79e4da2950862782bdd52cc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:15.908726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.909008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.909287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:15.944820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] MFA Rules not processed for user `be29c331c79e4da2950862782bdd52cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:15.947004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:15.982427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:15.983316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:15.983766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:15.984050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] PATH_INFO: `/v3/projects/fd4027e26a844b0dbd34ac452b22b3ae/users/b984b9717fe94a6fb6c62a78af17f7aa/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.002590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4027e26a844b0dbd34ac452b22b3ae, user_id=b984b9717fe94a6fb6c62a78af17f7aa, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.005324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9e7e-c746-4cc5-81dc-fd4ab31abbed admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.016438 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:16.027042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1844/3712] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:15 2022] PUT /identity/v3/projects/fd4027e26a844b0dbd34ac452b22b3ae/users/b984b9717fe94a6fb6c62a78af17f7aa/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:16.034309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.034899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.035174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.058720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:16.058720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:16.059790 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1869/3713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:16.060979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.075673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974edb70-cd89-4520-b76f-c1fd0677203e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.123767 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:16.155666 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1845/3714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:16.163825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.164534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.164534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.164751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.165551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.167289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.201455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1870/3715] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:16 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:16.202361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.204413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:16.225619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.337496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11feb7-fdc7-4304-b1ac-340a341a1454 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.382050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b746-ae1e-49d3-b6e7-c0bca9ec1c2f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.396114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.396863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.397248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.397645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.398386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.400444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.440148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.441009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.441294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.441626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.445748 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1871/3716] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:16 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:16.447166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.461040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b205a-ce8f-4249-b39d-538e91e14929 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.466150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.466295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.466997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.467346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.467697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.468476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.469366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.471561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.485022 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1872/3717] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:16.486608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.496045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1846/3718] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:16.500697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995026f8-7417-4d84-b369-c29ba899cae5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.506680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.507879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.508382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.508881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] PATH_INFO: `/v3/projects/04f8f2818d9a48228d25374e4b7a16c4/users/7e5b4e7d2a064d1aba8122981dc31b36/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.532148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f8f2818d9a48228d25374e4b7a16c4, user_id=7e5b4e7d2a064d1aba8122981dc31b36, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.535908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.555629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1873/3719] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:16 2022] PUT /identity/v3/projects/04f8f2818d9a48228d25374e4b7a16c4/users/7e5b4e7d2a064d1aba8122981dc31b36/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:16.561022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.573241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d8d7-c13d-49f8-895d-aa0ef1f31498 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.653724 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:16.665461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.666342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.666999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.667615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.669244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.671032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d1d79-b5e4-4515-9abd-808ded29f088 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.690055 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1847/3720] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:16.690401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.709997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9ad58-da41-48e3-948e-4e60639b264e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.717975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.718924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.719513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.720270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] PATH_INFO: `/v3/projects/04f8f2818d9a48228d25374e4b7a16c4/users/7e5b4e7d2a064d1aba8122981dc31b36/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.723286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f8f2818d9a48228d25374e4b7a16c4, user_id=7e5b4e7d2a064d1aba8122981dc31b36, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.726465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.741433 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1874/3721] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:16 2022] PUT /identity/v3/projects/04f8f2818d9a48228d25374e4b7a16c4/users/7e5b4e7d2a064d1aba8122981dc31b36/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:16.753767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.754332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.754686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.795427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] MFA Rules not processed for user `7e5b4e7d2a064d1aba8122981dc31b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:16.798373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:16.909823 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1848/3722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:16.912172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.926465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2d3e-4fa1-4819-9876-e560ae031258 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:16.931660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:16.941882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:16.941882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:16.942065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:16.946440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:16.948993 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:16.948993 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:16.948993 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:16.950612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:16.974591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1875/3723] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:13:16 2022] POST /identity/v3/services => generated 241 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:16.975817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:16.987861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91cc2a-8d2e-4d0b-bb5d-8fc34713e2a7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.007204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.007990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.008283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.008563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/38cec069c6d14033a10a1a4cd8b1178f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.009169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:delete_service(service_id=38cec069c6d14033a10a1a4cd8b1178f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.010276 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.010276 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:17.010276 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:17.011193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.055220 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1849/3724] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:16 2022] DELETE /identity/v3/services/38cec069c6d14033a10a1a4cd8b1178f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:17.056176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.068466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c0f2-fcfe-4d4d-a5f1-61af1459ebbf tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.086553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.087294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.088091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.088091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.088609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.090559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.109857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1876/3725] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:17 2022] POST /identity/v3/services => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:17.113914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.124688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86ad3-c581-41ab-94b3-29f2d04fc98c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.139792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.140792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.141189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.141569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/61f46f8643084daeb1d4e2b792072ecf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.142464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:update_service(service_id=61f46f8643084daeb1d4e2b792072ecf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.143851 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.143851 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:17.143851 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:17.144758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.165591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1850/3726] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:13:17 2022] PATCH /identity/v3/services/61f46f8643084daeb1d4e2b792072ecf => generated 282 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:17.166847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.178764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e0f8f-1488-4d90-9ada-7b4386e415bc tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.194689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.195339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.195647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.195981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/61f46f8643084daeb1d4e2b792072ecf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.196497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:get_service(service_id=61f46f8643084daeb1d4e2b792072ecf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.197550 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.197550 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:17.197550 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:17.198444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.208079 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1877/3727] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services/61f46f8643084daeb1d4e2b792072ecf => generated 282 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:17.209917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.223797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10928dd7-4180-4189-b2b3-32f3c18bf610 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.230348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.231230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.231688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.232127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/61f46f8643084daeb1d4e2b792072ecf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.232866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:delete_service(service_id=61f46f8643084daeb1d4e2b792072ecf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.235769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.269652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1851/3728] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:17 2022] DELETE /identity/v3/services/61f46f8643084daeb1d4e2b792072ecf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:17.275962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.287488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472268c-6a2f-4ba2-8153-5c934bc1a67c tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.293842 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:17.307521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.308459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.308937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.309216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/61f46f8643084daeb1d4e2b792072ecf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.309958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:get_service(service_id=61f46f8643084daeb1d4e2b792072ecf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.312478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Could not find service: 61f46f8643084daeb1d4e2b792072ecf.: keystone.exception.ServiceNotFound: Could not find service: 61f46f8643084daeb1d4e2b792072ecf. Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 61f46f8643084daeb1d4e2b792072ecf. Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:13:17.337327 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:13:17.338572 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 61f46f8643084daeb1d4e2b792072ecf. Sep 25 01:13:17.339749 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:13:17.341679 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1878/3729] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services/61f46f8643084daeb1d4e2b792072ecf => generated 113 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:13:17.349259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.371051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d108-9d29-423a-90e7-93a76a5febb1 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.378820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.379934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.380305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.382981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.382981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.383260 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.383260 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:17.383260 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:17.384224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.408327 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1852/3730] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:17 2022] POST /identity/v3/services => generated 271 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:17.412303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.433845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbe06-fd72-4e23-ba25-0780d32ecbe5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.452512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.454935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.455297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.455635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.456383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.458400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.481993 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1879/3731] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:17 2022] POST /identity/v3/services => generated 273 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:17.483253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.495219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4fc4b-7ff9-41a7-83dc-d30805081ad0 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.538809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.539439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.539719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.541178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.542183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.543839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.568847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.569559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1853/3732] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:17 2022] POST /identity/v3/services => generated 275 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:17.582977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146219-1211-4b62-a6c2-87fa9f8dfb6e tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.601711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.603479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.603479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.603479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.604702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.605971 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.605971 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:17.605971 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:17.607526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.624144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.627703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1880/3733] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services => generated 2974 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:17.636490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae25517-0dd3-4793-b732-1856687987fe tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.643590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.644298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.645528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.645528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.646077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-9768934) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:17.646472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.649029 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.649029 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:13:17.649029 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:13:17.650127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.660194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1854/3734] 10.222.0.16 () {58 vars in 1216 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-9768934 => generated 411 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:17.663097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.676054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6711-2332-4d5c-b964-40ab39cd009d tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.683044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.684509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.684654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.684930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.685597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-98118562) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:17.685898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.688030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.697666 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1881/3735] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-98118562 => generated 414 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:17.699573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.712147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d46fb-be5a-463e-9225-6b21f32b98e6 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.718008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.719194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.720127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.720407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.721047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1406892585) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:17.721381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.723650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.732281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1855/3736] 10.222.0.16 () {58 vars in 1222 bytes} [Sun Sep 25 01:13:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1406892585 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:17.733555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.744764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db962e9-83ef-4176-8ef1-153868250d73 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.751430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.752089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.752370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.753126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/2ce9c19d3a454f16b88b6369b7d65e42` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.753390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2ce9c19d3a454f16b88b6369b7d65e42)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.755670 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:13:17.755670 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:13:17.755670 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:13:17.756595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.805580 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1882/3737] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:17 2022] DELETE /identity/v3/services/2ce9c19d3a454f16b88b6369b7d65e42 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:17.807678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.827139 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:17.834541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac794-f8a6-46c2-acd4-17722d59ae63 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:17.874287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:17.876290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:17.876592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:17.876851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/bebe7a1f91c8444f8aac47f88ee938f0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:17.877468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bebe7a1f91c8444f8aac47f88ee938f0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:17.879086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:17.948788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1856/3738] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:17 2022] DELETE /identity/v3/services/bebe7a1f91c8444f8aac47f88ee938f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:17.952730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:17.983433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a3b77-e0ba-4663-a542-3c150ebcbe17 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:18.029666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5b4e7d2a064d1aba8122981dc31b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f8f2818d9a48228d25374e4b7a16c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:18.030330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:18.030618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:18.030894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] PATH_INFO: `/v3/services/aeb9d8c66dbe41e9b78fd68d17fc28a2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:18.031664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aeb9d8c66dbe41e9b78fd68d17fc28a2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:18.033466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22918d08-6f7a-4c04-a563-19b1633e42da tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:18.073345 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1883/3739] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:17 2022] DELETE /identity/v3/services/aeb9d8c66dbe41e9b78fd68d17fc28a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:18.080679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:18.312098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5306f8-3375-4450-85e0-70a49dada2d5 tempest-ServicesTestJSON-639980425 tempest-ServicesTestJSON-639980425-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:18.363433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:18.364294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:18.364653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:18.364970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] PATH_INFO: `/v3/users/be29c331c79e4da2950862782bdd52cc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:18.366543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be29c331c79e4da2950862782bdd52cc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:18.369739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:18.449278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be29c331c79e4da2950862782bdd52cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:18.450082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be29c331c79e4da2950862782bdd52cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:18.464136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be29c331c79e4da2950862782bdd52cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:18.480561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be29c331c79e4da2950862782bdd52cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:18.481334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be29c331c79e4da2950862782bdd52cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:18.497689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1857/3740] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:18 2022] DELETE /identity/v3/users/be29c331c79e4da2950862782bdd52cc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:18.502663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:18.503199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:18.503199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:18.532270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:18.533773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:18.619812 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1884/3741] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:18.627949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:18.630046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:18.696040 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:18.746683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4482-3622-409a-870a-9c57c6f692f9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:18.751451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:18.752081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:18.752360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:18.752630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:18.763470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:18.764968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:18.777886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1858/3742] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:19.126003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:19.128051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:19.155458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2518ca-dd74-431a-8fb5-35b6c9b2262e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:19.165908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:19.166569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:19.166847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:19.167121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] PATH_INFO: `/v3/projects/d88ba7be5a1041068579c20b334fb0ed` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:19.170203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88ba7be5a1041068579c20b334fb0ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:19.173112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:19.275979 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:19.306674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88ba7be5a1041068579c20b334fb0ed', 'request_id': 'req-5566812c-489b-4223-8b5e-054906929059'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.318607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88ba7be5a1041068579c20b334fb0ed', 'request_id': 'req-5566812c-489b-4223-8b5e-054906929059'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.330852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88ba7be5a1041068579c20b334fb0ed', 'request_id': 'req-5566812c-489b-4223-8b5e-054906929059'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.363943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] The token cache is being invalidate because project d88ba7be5a1041068579c20b334fb0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:19.364249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.366277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.375973 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1885/3743] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:19 2022] DELETE /identity/v3/projects/d88ba7be5a1041068579c20b334fb0ed => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:19.376377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:19.397142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbb8f-44e0-44c1-b836-ac8e5e1e2338 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:19.525415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:19.526322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:19.526692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:19.526975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] PATH_INFO: `/v3/users/7e5b4e7d2a064d1aba8122981dc31b36` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:19.532754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5b4e7d2a064d1aba8122981dc31b36)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:19.534809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:19.620882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5b4e7d2a064d1aba8122981dc31b36'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.621673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5b4e7d2a064d1aba8122981dc31b36'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.635388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5b4e7d2a064d1aba8122981dc31b36'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.654893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5b4e7d2a064d1aba8122981dc31b36'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.656572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-76d258fa-f635-49de-b494-c71a4acd52db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5b4e7d2a064d1aba8122981dc31b36'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:19.674598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1859/3744] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:19 2022] DELETE /identity/v3/users/7e5b4e7d2a064d1aba8122981dc31b36 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:20.956823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:20.958318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:20.976708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566812c-489b-4223-8b5e-054906929059 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.092499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.093658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.093943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.094242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] PATH_INFO: `/v3/projects/04f8f2818d9a48228d25374e4b7a16c4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.095454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f8f2818d9a48228d25374e4b7a16c4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.097425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.155464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f8f2818d9a48228d25374e4b7a16c4', 'request_id': 'req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:21.162951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f8f2818d9a48228d25374e4b7a16c4', 'request_id': 'req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:21.176427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f8f2818d9a48228d25374e4b7a16c4', 'request_id': 'req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:21.193654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] The token cache is being invalidate because project 04f8f2818d9a48228d25374e4b7a16c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:21.193953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:21.194616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c31eb40e-bd31-4646-bc9e-d8785e6ef6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:21.201494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1886/3745] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:20 2022] DELETE /identity/v3/projects/04f8f2818d9a48228d25374e4b7a16c4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:21.202841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.203476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.203654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.230763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:21.232002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:21.301558 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:21.335300 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1860/3746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:21.342815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.343567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.344097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.368088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:21.369440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:21.379797 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1887/3747] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:21.383902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.399018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eede51a-d815-4319-94cb-c7d7a2ed106b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.442341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.443302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.443848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.444825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.445762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:21.446283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.448890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.470579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1861/3748] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:21.474645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.490647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b426e9c-4407-4c55-b1ad-8e2903a9d0ec None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.497785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.498743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.498884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.499124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.499781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.502927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.567661 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1888/3749] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:21 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:21.572173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.636729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8f72a-7db7-4ec2-b9b2-e05b579d93a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.760647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.770077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.771215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.771590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.772653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.781626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.809003 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1862/3750] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:21 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:21.813493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.826351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c669-a2bf-428b-a599-f5a078ae5c40 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.833310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.834035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.834302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.834564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.835206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.837454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.853446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1889/3751] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:21.855221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.869889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d5e93-e241-44ad-a539-4346f569f592 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.876561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.877432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.877567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.878193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.878665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.880607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abe451-43c4-45d7-a4c1-83f7cf8ce711 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.903265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:21.904043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1863/3752] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:21.918626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118b6c5-8650-4968-8b48-a429a42186e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:21.927601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:21.928904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:21.929377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:21.929861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] PATH_INFO: `/v3/projects/0d8f44ee288f4578a3fc002881f30ece/users/4c006c30e3fb47bda278798a1621b69c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:21.956803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8f44ee288f4578a3fc002881f30ece, user_id=4c006c30e3fb47bda278798a1621b69c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:21.960115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:21.964025 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:22.023135 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1890/3753] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:21 2022] PUT /identity/v3/projects/0d8f44ee288f4578a3fc002881f30ece/users/4c006c30e3fb47bda278798a1621b69c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:22.113072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.113357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.113714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.146816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] MFA Rules not processed for user `4c006c30e3fb47bda278798a1621b69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:22.148262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:22.292766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1864/3754] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:22.297837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:22.439366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb605-9358-4a92-8bd4-4bb1a1e4ac75 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:22.445109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:22.446059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.446560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.447016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.447833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:22.451204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:22.522246 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1891/3755] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:22 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:22.538642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:22.551630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c3b3-b9b3-4f70-9f09-5e7a07cf2eff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:22.627481 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:22.653104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:22.653922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.654306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.654683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.660703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:22.661981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:22.705581 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1865/3756] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:22 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:22.709495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:22.723250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0683-f4b1-4136-adb7-9e2b25192e07 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:22.730508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:22.731146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.731431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.731706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.732362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:22.734758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:22.750687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1892/3757] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:22.752528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:22.767463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48990-e5b8-48b6-b770-10c3f2769fab admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:22.774337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:22.775306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.775785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.776313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.777254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:22.779211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba665-a666-44fa-970a-4f7aa06cebf9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:22.797977 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1866/3758] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:22.801647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:22.814327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7e46-236c-402e-89f8-47e57d009b4b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:22.819434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:22.820251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.820539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.820820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] PATH_INFO: `/v3/projects/61e8739497304af3815e3f883f66953f/users/b2c4cf31ca924a2096efa3fb38f6d96c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.837655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e8739497304af3815e3f883f66953f, user_id=b2c4cf31ca924a2096efa3fb38f6d96c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:22.841562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:22.873804 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1893/3759] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:22 2022] PUT /identity/v3/projects/61e8739497304af3815e3f883f66953f/users/b2c4cf31ca924a2096efa3fb38f6d96c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:22.878347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c871-e429-4e82-9389-0dcca26a7ea4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:22.878895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c871-e429-4e82-9389-0dcca26a7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:22.879172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c871-e429-4e82-9389-0dcca26a7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:22.929331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4149c871-e429-4e82-9389-0dcca26a7ea4 None None] MFA Rules not processed for user `b2c4cf31ca924a2096efa3fb38f6d96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:22.933724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4149c871-e429-4e82-9389-0dcca26a7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:23.050536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1867/3760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:23.056622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:23.152496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d8fa-f57c-4612-ada1-8122712c93bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:23.160370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c006c30e3fb47bda278798a1621b69c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8f44ee288f4578a3fc002881f30ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:23.161255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:23.161835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:23.164133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] PATH_INFO: `/v3/users/4c006c30e3fb47bda278798a1621b69c/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:23.165791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] RBAC: Authorizing `identity:list_user_projects(user_id=4c006c30e3fb47bda278798a1621b69c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:23.168079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a74788-71a8-48e9-afc0-c1de1a25dab1 tempest-IdentityV3ProjectsTest-293751942 tempest-IdentityV3ProjectsTest-293751942-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:23.257134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1894/3761] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:13:23 2022] GET /identity/v3/users/4c006c30e3fb47bda278798a1621b69c/projects => generated 515 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:23.258737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:23.259223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:23.259511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:23.316680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] MFA Rules not processed for user `4c006c30e3fb47bda278798a1621b69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:23.321329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:23.349454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1868/3762] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:23.349661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:23.349661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:23.349854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:23.409224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] MFA Rules not processed for user `4c006c30e3fb47bda278798a1621b69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:23.418905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:23.447748 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:23.618476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.models.token_model [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] User 4c006c30e3fb47bda278798a1621b69c has no access to project 61e8739497304af3815e3f883f66953f {{(pid=81863) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Sep 25 01:13:23.633053 n-d-master-1 devstack@keystone.service[81863]: WARNING keystone.server.flask.application [None req-d0f029ca-49b0-4578-abd0-83f64339460d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:13:23.634789 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1895/3763] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:23 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 288 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:13:23.639925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:23.755488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f5d6-4726-4480-9cf3-2569f6c2326d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:23.780529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:23.781950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:23.783125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:23.783495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] PATH_INFO: `/v3/users/4c006c30e3fb47bda278798a1621b69c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:23.784912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c006c30e3fb47bda278798a1621b69c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:23.790677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:23.885883 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:23.899191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c006c30e3fb47bda278798a1621b69c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:23.899920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c006c30e3fb47bda278798a1621b69c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:23.917611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c006c30e3fb47bda278798a1621b69c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:23.945426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c006c30e3fb47bda278798a1621b69c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:23.946265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c006c30e3fb47bda278798a1621b69c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:23.977819 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1869/3764] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:23 2022] DELETE /identity/v3/users/4c006c30e3fb47bda278798a1621b69c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:23.983582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:23.983897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:23.989046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:24.034832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:24.038038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:24.135981 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1896/3765] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:24.159935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:24.162164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:24.253983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a743-848e-48f6-a8fa-6a12252697a0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:24.258898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:24.259755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:24.260036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:24.260309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:24.272725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:24.274298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:24.291074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1870/3766] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:25.392397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:25.396274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:25.432739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902109c6-fb88-4fd2-a1e4-b21e71495701 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:25.454719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:25.461228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:25.461965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:25.462466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] PATH_INFO: `/v3/projects/0d8f44ee288f4578a3fc002881f30ece` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:25.465489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8f44ee288f4578a3fc002881f30ece)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:25.468743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:25.547996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8f44ee288f4578a3fc002881f30ece', 'request_id': 'req-402f6276-6a2a-4f2e-8e09-118f938bf44a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.561179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8f44ee288f4578a3fc002881f30ece', 'request_id': 'req-402f6276-6a2a-4f2e-8e09-118f938bf44a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.569760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8f44ee288f4578a3fc002881f30ece', 'request_id': 'req-402f6276-6a2a-4f2e-8e09-118f938bf44a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.596149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] The token cache is being invalidate because project 0d8f44ee288f4578a3fc002881f30ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:25.596149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.600384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-402f6276-6a2a-4f2e-8e09-118f938bf44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.608061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:25.616776 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1897/3767] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:25 2022] DELETE /identity/v3/projects/0d8f44ee288f4578a3fc002881f30ece => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:25.643463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123b2e-5e53-424d-894a-8902a24955a7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:25.730852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:25.731797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:25.732246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:25.732691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] PATH_INFO: `/v3/users/b2c4cf31ca924a2096efa3fb38f6d96c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:25.735483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c4cf31ca924a2096efa3fb38f6d96c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:25.738317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:25.762364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:25.762839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:25.763468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:25.809623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] MFA Rules not processed for user `b984b9717fe94a6fb6c62a78af17f7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:25.811004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:25.834982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c4cf31ca924a2096efa3fb38f6d96c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.838029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c4cf31ca924a2096efa3fb38f6d96c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.860653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c4cf31ca924a2096efa3fb38f6d96c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.868064 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:25.873886 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:25.888814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c4cf31ca924a2096efa3fb38f6d96c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.891134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c4cf31ca924a2096efa3fb38f6d96c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:25.920557 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1898/3768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:25.925594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:25.927091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:25.927877 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1871/3769] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:25 2022] DELETE /identity/v3/users/b2c4cf31ca924a2096efa3fb38f6d96c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:25.946558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690549-7e55-4429-9035-6c39c111e1a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.016198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:26.017119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:26.017548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:26.017687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:26.019126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:26.021212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:26.071854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.082109 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1899/3770] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:25 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:26.084445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af596-239b-4513-b6ac-22143eabd112 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.201000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:26.202141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:26.202673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:26.203155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:26.204428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:26.207118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:26.253662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.301969 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1872/3771] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:26 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:26.326655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0839-a888-4c42-9919-a9cb0b9a9fbf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.364117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:26.365087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:26.365225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:26.365660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:26.366428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:26.368072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:26.402629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1900/3772] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:26.404568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.423438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48832-3670-42f5-a1be-97e7165c8346 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.430350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:26.431447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:26.431998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:26.432498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:26.433375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:26.436065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:26.463357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1873/3773] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:26.465034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.486127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad752-fdb2-44b2-be9e-3e5c5dbbaadf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.497420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:26.498609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:26.499135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:26.499684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] PATH_INFO: `/v3/projects/153e3aa4f1ab42319781e527a271bd6a/users/f85a366f989648c7a62880578c0ea947/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:26.527465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153e3aa4f1ab42319781e527a271bd6a, user_id=f85a366f989648c7a62880578c0ea947, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:26.531613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:26.557107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1901/3774] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:26 2022] PUT /identity/v3/projects/153e3aa4f1ab42319781e527a271bd6a/users/f85a366f989648c7a62880578c0ea947/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:26.655163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.658649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:26.863933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f25f6-ae32-4dee-8199-afdf2b70cfc9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:26.911974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:26.913367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:26.975030 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:27.020605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:27.021472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.021669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.021945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.026714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:27.062670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199342a-fcca-4d10-932d-688f4fa934f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:27.085081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:27.085831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.086113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.086426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] PATH_INFO: `/v3/projects/61e8739497304af3815e3f883f66953f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.089059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e8739497304af3815e3f883f66953f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:27.094283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:27.188354 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:27.193492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:27.195164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d5e20-3157-445e-9048-c7c3c20b0888 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:27.214950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e8739497304af3815e3f883f66953f', 'request_id': 'req-30d14581-b3ac-4c4c-ab48-f60f9af16464'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:27.241431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e8739497304af3815e3f883f66953f', 'request_id': 'req-30d14581-b3ac-4c4c-ab48-f60f9af16464'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:27.244589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1874/3775] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:27.252121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e8739497304af3815e3f883f66953f', 'request_id': 'req-30d14581-b3ac-4c4c-ab48-f60f9af16464'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:27.273933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] The token cache is being invalidate because project 61e8739497304af3815e3f883f66953f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:27.274227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:27.274888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-30d14581-b3ac-4c4c-ab48-f60f9af16464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:27.279340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1902/3776] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:26 2022] DELETE /identity/v3/projects/61e8739497304af3815e3f883f66953f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:27.288649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.289815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.290303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.360346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:27.365775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:27.488312 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1875/3777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:27.495676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.496208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.496208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.538580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:27.540136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:27.565341 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1903/3778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:27.568687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:27.585308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc143401-108b-4e99-85a0-a3b3c35df612 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:27.602163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:27.604532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.605531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.607427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.609715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:27.611876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:27.619405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:27.645898 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1876/3779] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:27.650082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:27.665904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f17d-cb0e-42c7-93d3-e5dabab8fcdc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:27.682864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:27.689367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:27.690912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:27.691438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:27.694949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:27.699795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:27.766819 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1904/3780] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:27 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:27.771237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:27.804066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133002e-aa85-43a2-ab54-b1a0bee63ea5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.000806 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:28.029305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.030355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.032258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.033148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.033441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.036138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:28.081235 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1877/3781] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:27 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:28.081713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:28.095893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31156d1-ba85-4820-9160-56ad79c8a10c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.115286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.121807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.122353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.122796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.123692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.134592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:28.159090 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1905/3782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:28.162916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:28.178665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de39a9-7475-4fc0-a284-5a81a37add6b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.204405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.205099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.205378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.205694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] PATH_INFO: `/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96/users/6ce582c5092e43e2ae3b9a99e804b579/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.246438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38a1ca6723c4577aeecbdb5aa5e8d96, user_id=6ce582c5092e43e2ae3b9a99e804b579, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.251063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:28.285494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1878/3783] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:28 2022] PUT /identity/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96/users/6ce582c5092e43e2ae3b9a99e804b579/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:28.286979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:28.310050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8faca2-dc7c-4216-abb7-2f8913278ab0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.480587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.481248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.481563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.481836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.482486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.485019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dd9b7-e892-4ed9-be79-a56c91c4cb37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:28.502383 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1906/3784] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:28.503564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:28.521653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa81-2aa0-4158-ad6f-123c2405454d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.535068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.535765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.536044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.536317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] PATH_INFO: `/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96/users/6ce582c5092e43e2ae3b9a99e804b579/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.538331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38a1ca6723c4577aeecbdb5aa5e8d96, user_id=6ce582c5092e43e2ae3b9a99e804b579, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.540984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:28.562711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1879/3785] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:28 2022] PUT /identity/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96/users/6ce582c5092e43e2ae3b9a99e804b579/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:28.574615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.575079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.575360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.651699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] MFA Rules not processed for user `6ce582c5092e43e2ae3b9a99e804b579`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:28.655122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:28.842507 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1907/3786] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:28.844896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:28.981948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233c91-a7e3-41cd-ad4e-729d4b8bf3f1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:28.988197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:28.988920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:28.989329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:28.989641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:28.990341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:28.992403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:29.029636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1880/3787] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:28 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:29.034571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:29.042853 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:29.059520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8121-0787-4a31-b4cb-683cab052cd7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:29.178337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:29.182007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:29.182528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:29.183742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:29.186068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:29.192752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:29.247569 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1908/3788] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:29 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:29.247986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:29.262357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b57f2-a955-4be8-98aa-3b3b70b1ab1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:29.286439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:29.287396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:29.287839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:29.288285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:29.289096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:29.290920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:29.315053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:29.322031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1881/3789] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:29.333469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010016-c641-4d02-8f79-b1dbc578b854 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:29.357925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:29.360671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:29.361210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:29.361732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:29.362675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:29.364525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7c30f-4139-4868-b907-65969ef91851 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:29.406402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1909/3790] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:29.407721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:29.434883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6814a7a-c34d-40f6-9c35-d0db13723936 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:29.449258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:29.449974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:29.450697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:29.450697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] PATH_INFO: `/v3/projects/430ccf31dc5446dcbb83cb7d599ed895/users/97f5588439b1400ab57ddd93ad4d68d9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:29.505934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=430ccf31dc5446dcbb83cb7d599ed895, user_id=97f5588439b1400ab57ddd93ad4d68d9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:29.509140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:29.545672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1882/3791] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:29 2022] PUT /identity/v3/projects/430ccf31dc5446dcbb83cb7d599ed895/users/97f5588439b1400ab57ddd93ad4d68d9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:29.554083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:29.555710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:29.556204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:29.648737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] MFA Rules not processed for user `97f5588439b1400ab57ddd93ad4d68d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:29.655237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:29.811324 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1910/3792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:29.819852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:29.822218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:30.003926 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:30.026694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200988b-dff5-46b4-bd7a-749c60ec5f8a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:30.034811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:30.039913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:30.040512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:30.041193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:30.222591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:30.224176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a55e-a01c-4996-949a-1f380b908442 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:30.254432 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1883/3793] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:32.003149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:32.163168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6e838-b9dc-46ab-a3cf-bf175b85b024 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:32.193526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:32.196051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:32.196508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:32.198119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] PATH_INFO: `/v3/users/6ce582c5092e43e2ae3b9a99e804b579` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:32.200434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce582c5092e43e2ae3b9a99e804b579)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:32.205880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:32.249780 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:32.325179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce582c5092e43e2ae3b9a99e804b579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:32.342926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce582c5092e43e2ae3b9a99e804b579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:32.371088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce582c5092e43e2ae3b9a99e804b579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:32.372214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce582c5092e43e2ae3b9a99e804b579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:32.379504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce582c5092e43e2ae3b9a99e804b579'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:32.401478 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1911/3794] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:32 2022] DELETE /identity/v3/users/6ce582c5092e43e2ae3b9a99e804b579 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:32.406616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:32.407093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:32.407220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:32.463540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:32.477788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:32.651130 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1884/3795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:32.669009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:32.670907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:32.793789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae8ef-e1cc-4bd8-9f8b-bdc5e2ad6e10 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:32.801879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:32.802569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:32.802854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:32.803126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:32.815440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:32.817155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:32.830927 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1912/3796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:33.500552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:33.502071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:33.699199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390ba7-78b1-4bf2-9e2a-3db389cf56cd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:33.700742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:33.703822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:33.709149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:33.711441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:33.711732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:33.712012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:33.722117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:33.724588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111232ad-2257-4d42-a209-2de9cd11f2e7 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:33.738490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:33.740220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:33.741257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:33.742439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] PATH_INFO: `/v3/users/1cc384987bb247d88d0027e60d600ed1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:33.744591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc384987bb247d88d0027e60d600ed1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:33.750347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:33.751507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:33.751993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:33.770904 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1885/3797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:33.856150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc384987bb247d88d0027e60d600ed1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:33.873995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:33.878558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:33.878762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc384987bb247d88d0027e60d600ed1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:33.909890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc384987bb247d88d0027e60d600ed1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:33.913054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc384987bb247d88d0027e60d600ed1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:33.913764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc384987bb247d88d0027e60d600ed1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:33.915332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8058717-3185-4e48-8676-d70b95806a03 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:33.938034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:33.939837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:33.940365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:33.941029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] PATH_INFO: `/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:33.941156 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1913/3798] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:33 2022] DELETE /identity/v3/users/1cc384987bb247d88d0027e60d600ed1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:33.943672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38a1ca6723c4577aeecbdb5aa5e8d96)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:33.946141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:33.961035 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:34.081767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38a1ca6723c4577aeecbdb5aa5e8d96', 'request_id': 'req-87d350a2-46b2-4d22-b8bd-63d75b01dac2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.097952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38a1ca6723c4577aeecbdb5aa5e8d96', 'request_id': 'req-87d350a2-46b2-4d22-b8bd-63d75b01dac2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.110426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38a1ca6723c4577aeecbdb5aa5e8d96', 'request_id': 'req-87d350a2-46b2-4d22-b8bd-63d75b01dac2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.130435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] The token cache is being invalidate because project c38a1ca6723c4577aeecbdb5aa5e8d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:34.131211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.132014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.137297 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1886/3799] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:33 2022] DELETE /identity/v3/projects/c38a1ca6723c4577aeecbdb5aa5e8d96 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:34.138263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:34.140349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:34.150494 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:34.317112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693b3f-62ea-498c-87bb-24ba71549387 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:34.432397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:34.434712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:34.434712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:34.434712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] PATH_INFO: `/v3/users/97f5588439b1400ab57ddd93ad4d68d9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:34.435316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f5588439b1400ab57ddd93ad4d68d9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:34.439436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:34.533977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f5588439b1400ab57ddd93ad4d68d9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.554110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f5588439b1400ab57ddd93ad4d68d9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.585321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f5588439b1400ab57ddd93ad4d68d9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.587307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f5588439b1400ab57ddd93ad4d68d9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.589724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b31fb84-3964-4cfd-9765-084223d0ff18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f5588439b1400ab57ddd93ad4d68d9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.641990 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1914/3800] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:34 2022] DELETE /identity/v3/users/97f5588439b1400ab57ddd93ad4d68d9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:34.653644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:34.656229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:34.674220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d350a2-46b2-4d22-b8bd-63d75b01dac2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:34.757705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:34.758531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:34.759130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:34.759827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] PATH_INFO: `/v3/projects/56773bfde588477493c4d44b0d3e74b9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:34.761709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56773bfde588477493c4d44b0d3e74b9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:34.765979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:34.843565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56773bfde588477493c4d44b0d3e74b9', 'request_id': 'req-af601c99-4083-4fb4-a40b-76611d8755e8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.857114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56773bfde588477493c4d44b0d3e74b9', 'request_id': 'req-af601c99-4083-4fb4-a40b-76611d8755e8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.888113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56773bfde588477493c4d44b0d3e74b9', 'request_id': 'req-af601c99-4083-4fb4-a40b-76611d8755e8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.916842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] The token cache is being invalidate because project 56773bfde588477493c4d44b0d3e74b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:34.917147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.919775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:34.922348 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1887/3801] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:34 2022] DELETE /identity/v3/projects/56773bfde588477493c4d44b0d3e74b9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:34.928199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360360-89e0-4c2b-bda3-5d94003b8a32 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:34.928733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360360-89e0-4c2b-bda3-5d94003b8a32 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:34.929484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360360-89e0-4c2b-bda3-5d94003b8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:34.967236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-05360360-89e0-4c2b-bda3-5d94003b8a32 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:34.968572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05360360-89e0-4c2b-bda3-5d94003b8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:34.992602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:34.995772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:35.014141 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:35.069908 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:35.098035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1915/3802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:35.101359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.103407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.103407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.142838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:35.145118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:35.148285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af601c99-4083-4fb4-a40b-76611d8755e8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.161453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.161793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.162076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.162363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] PATH_INFO: `/v3/users/38e3ca9f263a437ab752007ef0588edc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.163812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e3ca9f263a437ab752007ef0588edc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.165821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.173189 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1916/3803] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:35.174588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.184561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d47e7-df30-4505-8774-b17b714f6781 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.201020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.201769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.202112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.202254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.203052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:35.203536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.206034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.262497 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1917/3804] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:35.264161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.292780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780fc1-fb56-471a-814b-02432e13fc8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.303123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e3ca9f263a437ab752007ef0588edc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:35.304094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e3ca9f263a437ab752007ef0588edc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:35.310764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.311965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.311965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.311965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.313521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.315473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.319815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e3ca9f263a437ab752007ef0588edc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:35.345347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e3ca9f263a437ab752007ef0588edc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:35.346132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e3ca9f263a437ab752007ef0588edc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:35.376863 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1888/3805] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:34 2022] DELETE /identity/v3/users/38e3ca9f263a437ab752007ef0588edc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:35.381989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1918/3806] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:35 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:35.383250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.388803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:35.544224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470a1d1-4c54-47fa-bae9-d295c3a96ec1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.605990 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:35.625985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.626845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.627197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.627535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.628462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.631565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.664625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1889/3807] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:35 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:35.669954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.682990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68af18-9fc6-4247-b879-a37e08cdfec3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.692403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.693185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.693894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.694232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.694953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.697084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.716647 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1919/3808] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:35.722196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.734304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150235ce-262d-4021-a0d9-d317a097bb2b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.740037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.740770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.741055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.741324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.742034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.743660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.758771 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1890/3809] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:35.767696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.795071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae3fe-36d1-4b06-b334-9ee1c84d54f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.804093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:35.806605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:35.830012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c6c0-6200-4099-baeb-febe3b643b96 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:35.846632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.847282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.847621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.847915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:35.848106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] PATH_INFO: `/v3/projects/430ccf31dc5446dcbb83cb7d599ed895` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.849126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] RBAC: Authorizing `identity:delete_project(project_id=430ccf31dc5446dcbb83cb7d599ed895)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.851254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.855936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.862408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.867482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] PATH_INFO: `/v3/projects/ecd6170549f94a59898b65f2383e5d1e/users/ad359d9027834039a45d3904d5afa0a2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:35.925267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd6170549f94a59898b65f2383e5d1e, user_id=ad359d9027834039a45d3904d5afa0a2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:35.929659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ad42-9c3b-4883-b2d6-0c7e5549974f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:35.957033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1920/3810] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:35 2022] PUT /identity/v3/projects/ecd6170549f94a59898b65f2383e5d1e/users/ad359d9027834039a45d3904d5afa0a2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:35.963825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599d5d-ab31-457c-bdeb-87a460211bf9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:35.964192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599d5d-ab31-457c-bdeb-87a460211bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:35.964363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599d5d-ab31-457c-bdeb-87a460211bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.001058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3b599d5d-ab31-457c-bdeb-87a460211bf9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:36.002326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3b599d5d-ab31-457c-bdeb-87a460211bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.033510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430ccf31dc5446dcbb83cb7d599ed895', 'request_id': 'req-1b236e7f-e57a-4371-bc1e-d7e46269463b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:36.070289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430ccf31dc5446dcbb83cb7d599ed895', 'request_id': 'req-1b236e7f-e57a-4371-bc1e-d7e46269463b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:36.129656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430ccf31dc5446dcbb83cb7d599ed895', 'request_id': 'req-1b236e7f-e57a-4371-bc1e-d7e46269463b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:36.163654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] The token cache is being invalidate because project 430ccf31dc5446dcbb83cb7d599ed895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:36.164419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:36.165791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:36.174419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1921/3811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:36.174677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1891/3812] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:35 2022] DELETE /identity/v3/projects/430ccf31dc5446dcbb83cb7d599ed895 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:36.192035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.194286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6032a0-322c-45ca-9974-0792899efff8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.194791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6032a0-322c-45ca-9974-0792899efff8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.195279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6032a0-322c-45ca-9974-0792899efff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.205902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.301958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8d6032a0-322c-45ca-9974-0792899efff8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:36.303396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d6032a0-322c-45ca-9974-0792899efff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.350417 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1922/3813] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:36.356165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.356715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.357222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.394723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:36.396545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.412576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1923/3814] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:36.420036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.437782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426968e-2973-4b97-9b56-981569bf69d3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.445761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.446783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.447261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.447734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.448836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:36.449367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.452759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.462034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236e7f-e57a-4371-bc1e-d7e46269463b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.476091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.478057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.479222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.480191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.486716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.488881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1924/3815] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:36.491607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.521182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.521443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650b47-fea1-4e37-8e49-75e0c2a12c8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.522841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.539330 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1892/3816] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:36.539723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.540800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.541665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.542181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.543391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.548843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.618893 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1925/3817] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:36 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:36.625069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.638809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33b9b-bdb7-4b63-940c-1c5702194505 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.696590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.698671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:36.713597 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:36.773457 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:36.792970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.794273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.794273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.794637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.795256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.801452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.848161 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1893/3818] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:36 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:36.849676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.866487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c177-b5f8-477b-b90c-18c762d6ff81 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.871383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16024cfd-48d3-4687-83f3-f155733b495f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.878283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.878946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.879232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.879506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] PATH_INFO: `/v3/projects/99bc91409fe24f088ae6a51eff7381e1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.881277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bc91409fe24f088ae6a51eff7381e1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.883246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.887730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.888357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.888643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.888924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:36.889603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:36.893315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:36.914921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1894/3819] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:36.919643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:36.943238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed187-a3cd-4dc4-90fa-fa82300d927a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:36.968817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:36.970549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:36.971857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:36.972777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] PATH_INFO: `/v3/projects/11547a55232f48218b24d2b833fc0027/users/67c581147f8c413689d55426e4b30a8a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.006192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bc91409fe24f088ae6a51eff7381e1', 'request_id': 'req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:37.019352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bc91409fe24f088ae6a51eff7381e1', 'request_id': 'req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:37.020445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11547a55232f48218b24d2b833fc0027, user_id=67c581147f8c413689d55426e4b30a8a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.030601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac95e4-8188-416a-b4ca-5f210813f386 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.036430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bc91409fe24f088ae6a51eff7381e1', 'request_id': 'req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:37.058022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] The token cache is being invalidate because project 99bc91409fe24f088ae6a51eff7381e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:37.061231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:37.064383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:37.066123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1926/3821] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:36 2022] DELETE /identity/v3/projects/99bc91409fe24f088ae6a51eff7381e1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:13:37.072223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1895/3821] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:36 2022] PUT /identity/v3/projects/11547a55232f48218b24d2b833fc0027/users/67c581147f8c413689d55426e4b30a8a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:37.074548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.076839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c33-8c65-4c0c-a401-7263be3f27b9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.077514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c33-8c65-4c0c-a401-7263be3f27b9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.077926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c33-8c65-4c0c-a401-7263be3f27b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.078268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:37.155003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-39019c33-8c65-4c0c-a401-7263be3f27b9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:37.157612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-39019c33-8c65-4c0c-a401-7263be3f27b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:37.202039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a789a-32f7-458d-9e90-9cc4fc41b5a6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.259138 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:37.286920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.287662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.288182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.288597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.289325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.291552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.312944 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1927/3822] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:37.316483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.330317 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1896/3823] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:37.341044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.341329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.342211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.346368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa17cf-3d9b-458e-9ce8-50b887992c70 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.363016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.363733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.364017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.364446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] PATH_INFO: `/v3/projects/11547a55232f48218b24d2b833fc0027/users/67c581147f8c413689d55426e4b30a8a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.368881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11547a55232f48218b24d2b833fc0027, user_id=67c581147f8c413689d55426e4b30a8a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.371982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:37.373235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:37.373870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f1fdc-d71a-4d31-a583-827ed745b9d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.394047 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1897/3824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:37.395359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.408769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc14fa-981d-4232-a62e-d1699157e109 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.423820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1928/3825] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:37 2022] PUT /identity/v3/projects/11547a55232f48218b24d2b833fc0027/users/67c581147f8c413689d55426e4b30a8a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:37.437636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.438261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.439111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.493025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] MFA Rules not processed for user `67c581147f8c413689d55426e4b30a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:37.494559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:37.503357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.504636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.505026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.506225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.507221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:37.507643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.510247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.527535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1898/3826] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:37.532572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.544935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38db945-de02-4501-ba2e-43642f1737ce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.550870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.551783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.552170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.552546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.553301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.555468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.596102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1899/3827] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:37.600177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.641603 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:37.682771 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1929/3828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:37.688229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.708325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7da69-82c0-49b7-bbb7-b69e19d995ed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.751865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c3ff-e56c-4dac-b2f6-1e53a601536c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.762882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.763961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.764449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.766098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.767036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.774129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.815672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1900/3829] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/users => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:37.819693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.826291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.828011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.828754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.829220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.830306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.833733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.839593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd380-6ae8-48e7-a28b-603e7bf8ca79 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.845951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.846840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.847249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.847597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.848324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.850127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.861671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1901/3830] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:37.866231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.878681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709b20-2214-4f01-a119-72b15b3da1b0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:37.884555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:37.886031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:37.886477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:37.887046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:37.887834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:37.890372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:37.890959 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1930/3831] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:37.896281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.912351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1902/3832] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:37.913273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:37.926623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69ca-1f18-49d2-b338-892849d70a6d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.012770 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:38.028061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.048886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.049276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.049581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] PATH_INFO: `/v3/projects/a97421bd12f74bb49bb3fb8f61ca6e15/users/832a1af87d2b490692389af891b790ae/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.089664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f589f-84b8-4060-b4c4-7a6a42fa6efe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.095259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97421bd12f74bb49bb3fb8f61ca6e15, user_id=832a1af87d2b490692389af891b790ae, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.100648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09c9f-f475-4265-8019-9c1c0c2d751e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.102006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.103430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.103900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.104334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.105436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.108051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.120720 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1903/3833] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:37 2022] PUT /identity/v3/projects/a97421bd12f74bb49bb3fb8f61ca6e15/users/832a1af87d2b490692389af891b790ae/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:38.134284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.135293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.135774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.163788 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1931/3834] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:37 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:38.166157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:38.192875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ce5f-a214-4aa6-b646-0e3b9aba9c2f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.195436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] MFA Rules not processed for user `832a1af87d2b490692389af891b790ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:38.196830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:38.325628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.326258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.326540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.326862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.328335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.332549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.340076 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:38.356618 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1932/3835] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:38.362705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1904/3836] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:38.362934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:38.373140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:38.379129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134456-efa5-49e6-af3d-aef5a8cd1f3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.381099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:38.393564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.394523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.395178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.395372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.396064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.398460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.421610 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1933/3837] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:38.425199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:38.439440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ddd71-f49e-410b-8e65-8a7cc3cbf305 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.445714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.446404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.447306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.447587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] PATH_INFO: `/v3/projects/07d4cf0555734adfb53e3aded4ff88f0/users/4ed0fd57870a40c4b2a51d3e0b48f3d5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.477316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d4cf0555734adfb53e3aded4ff88f0, user_id=4ed0fd57870a40c4b2a51d3e0b48f3d5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.480956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832761-d47f-42bd-941b-1f1e1d271abd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.508843 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1934/3838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:38 2022] PUT /identity/v3/projects/07d4cf0555734adfb53e3aded4ff88f0/users/4ed0fd57870a40c4b2a51d3e0b48f3d5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:38.521219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.521571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.522006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.581190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] MFA Rules not processed for user `4ed0fd57870a40c4b2a51d3e0b48f3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:38.582473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:38.590242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cc3c9-f7a1-4727-9dc2-af0d325072fc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:38.743363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:38.743994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:38.744273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:38.744652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:38.800009 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1935/3839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:38.838942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:38.840385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:38.892504 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:38.911099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:38.917631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:38.983000 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1905/3840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:38.995221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc121159-ce0b-428b-bed8-65bbfa9256ff None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:39.003630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:39.018385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:39.018385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:39.018385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:39.019114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:39.057304 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:39.104858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9fa2f-5961-4af8-a9d3-99d8be72833c service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:39.111369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:39.112113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:39.112482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:39.112824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] PATH_INFO: `/v3/users/832a1af87d2b490692389af891b790ae` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:39.114291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832a1af87d2b490692389af891b790ae)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:39.116837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:39.149290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:39.151899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fa25-8603-4119-91b8-553819400a2f service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:39.175057 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1936/3841] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:39.188327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832a1af87d2b490692389af891b790ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:39.189564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832a1af87d2b490692389af891b790ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:39.198765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832a1af87d2b490692389af891b790ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:39.215264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832a1af87d2b490692389af891b790ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:39.216292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832a1af87d2b490692389af891b790ae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:39.235717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1906/3842] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:39 2022] DELETE /identity/v3/users/832a1af87d2b490692389af891b790ae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:39.240824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa07d9-48bb-4c2d-a4c8-ead1784cc9b4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:39.241390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa07d9-48bb-4c2d-a4c8-ead1784cc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:39.241867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa07d9-48bb-4c2d-a4c8-ead1784cc9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:39.271125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c9aa07d9-48bb-4c2d-a4c8-ead1784cc9b4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:39.272584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9aa07d9-48bb-4c2d-a4c8-ead1784cc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:39.364097 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1937/3843] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:39.849051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:39.850681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:39.990273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1840-abd7-48fa-be08-6305b29fa8c7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:40.026373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:40.033297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.037326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.038264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.074058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:40.082917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:40.106774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1907/3844] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:40.206398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8855a-8f27-4e39-be3a-d0b1c959a720 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.206933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8855a-8f27-4e39-be3a-d0b1c959a720 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.207055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8855a-8f27-4e39-be3a-d0b1c959a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.274968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-86f8855a-8f27-4e39-be3a-d0b1c959a720 None None] MFA Rules not processed for user `f85a366f989648c7a62880578c0ea947`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:40.277526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-86f8855a-8f27-4e39-be3a-d0b1c959a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.401190 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:40.423003 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1938/3845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:40.434892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:40.436316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.437267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.437791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.438254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.465306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85306f-2d1a-4635-89a2-3a8310234a36 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:40.477257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:40.477667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.479931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.480271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] PATH_INFO: `/v3/users/67c581147f8c413689d55426e4b30a8a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.480357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] MFA Rules not processed for user `b984b9717fe94a6fb6c62a78af17f7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:40.482373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c581147f8c413689d55426e4b30a8a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:40.482682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.490229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:40.568408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c581147f8c413689d55426e4b30a8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:40.569539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c581147f8c413689d55426e4b30a8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:40.571278 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:40.582616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1939/3846] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:40.590233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c581147f8c413689d55426e4b30a8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:40.599293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:40.600861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.615785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c581147f8c413689d55426e4b30a8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:40.616930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f1d54eb3-f54c-4ed6-856f-75851b95e6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c581147f8c413689d55426e4b30a8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:40.641571 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1908/3847] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:40 2022] DELETE /identity/v3/users/67c581147f8c413689d55426e4b30a8a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:40.647056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.647605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.648065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.712601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:40.714622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.769208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3daad3-1e6a-449b-b408-e99e32b5810d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:40.846918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1909/3848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:40.880924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:40.883275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:40.966680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:40.968485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:40.969529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:40.970587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:40.985109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:41.039078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc92e6-78f4-416d-a123-3c8fa4472077 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.063238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.063941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.064227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.064501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.112661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.118292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.118816 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:41.191002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1910/3849] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:41.191002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:41.200119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:41.238059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.243921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979984c-97f3-417e-bae4-f183002a99ec service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.276779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebefa-46ec-426e-8637-0a90685dcf19 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.283843 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1940/3850] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:41.307261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.307915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.308207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.308484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] PATH_INFO: `/v3/projects/a97421bd12f74bb49bb3fb8f61ca6e15` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.315861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97421bd12f74bb49bb3fb8f61ca6e15)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.318242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.460611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97421bd12f74bb49bb3fb8f61ca6e15', 'request_id': 'req-928973dc-7a10-4b20-98f7-24ddc578b287'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:41.478905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97421bd12f74bb49bb3fb8f61ca6e15', 'request_id': 'req-928973dc-7a10-4b20-98f7-24ddc578b287'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:41.493994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97421bd12f74bb49bb3fb8f61ca6e15', 'request_id': 'req-928973dc-7a10-4b20-98f7-24ddc578b287'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:41.502111 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:41.536048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] The token cache is being invalidate because project a97421bd12f74bb49bb3fb8f61ca6e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:41.536701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:41.537720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-928973dc-7a10-4b20-98f7-24ddc578b287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:41.540286 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1911/3851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:41 2022] DELETE /identity/v3/projects/a97421bd12f74bb49bb3fb8f61ca6e15 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:41.545677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.546148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.546422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.578872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:41.581350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:41.657682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1941/3852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:41.666754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.669343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.669799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.694354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:41.695793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:41.706345 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1912/3853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:41.710644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:41.726079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad46441-ea0e-4815-9aff-6edf808762f7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.731267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.731916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.732174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.732443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.733115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:41.733504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.735251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.749560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1942/3854] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:13:41.753714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:41.764165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be479-4a75-415b-a3d7-162c7a23f710 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.769782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.770504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.770787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.771057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.771692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.775102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.816880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1913/3855] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:41 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:41.818793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:41.830529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48dfc0-ba57-4274-ab2b-eba08455e4cd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.930333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.931646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.932320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.932807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.933714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.936142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:41.970682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1943/3856] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:41 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:41.972475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:41.987133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065fa8-55ee-4561-88ac-80cc7377f2be admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:41.993586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:41.994507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:41.994614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:41.994875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:41.995844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:41.997729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:42.016892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1914/3857] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:42.033829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:42.065475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14bd6-8221-4658-b7c3-73c9bd1f0c3b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:42.075674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:42.076783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.076783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.076967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.078487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:42.081957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756a054-4f7a-4019-a596-58a6c7655c93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:42.101863 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1944/3858] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:42.103318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:42.119039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848358f5-bca5-4e7c-9822-14b4fa5f4c67 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:42.127101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:42.127884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.129556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.129556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] PATH_INFO: `/v3/projects/63c254bcf66542ae9c5bdeb70c07245d/users/6dbd1ce0900b45f7a853ceac99df932b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.192557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c254bcf66542ae9c5bdeb70c07245d, user_id=6dbd1ce0900b45f7a853ceac99df932b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:42.211280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:42.248895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1915/3859] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:42 2022] PUT /identity/v3/projects/63c254bcf66542ae9c5bdeb70c07245d/users/6dbd1ce0900b45f7a853ceac99df932b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:42.260306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.261566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.262084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.327993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] MFA Rules not processed for user `6dbd1ce0900b45f7a853ceac99df932b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:42.332120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:42.409491 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:42.434153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:42.437604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:42.496334 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1945/3860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:42.618046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e05f-c98e-4508-a580-7e6a7145aad9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:42.638473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:42.639149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.639435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.639767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] PATH_INFO: `/v3/projects/11547a55232f48218b24d2b833fc0027` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.645148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11547a55232f48218b24d2b833fc0027)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:42.647195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:42.685843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:42.687720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:42.742394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11547a55232f48218b24d2b833fc0027', 'request_id': 'req-16db6dce-cdf3-4842-b694-56cf33e8d700'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:42.749502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11547a55232f48218b24d2b833fc0027', 'request_id': 'req-16db6dce-cdf3-4842-b694-56cf33e8d700'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:42.756604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11547a55232f48218b24d2b833fc0027', 'request_id': 'req-16db6dce-cdf3-4842-b694-56cf33e8d700'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:42.774040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] The token cache is being invalidate because project 11547a55232f48218b24d2b833fc0027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:42.774784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:42.775785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:42.779294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1916/3861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:42 2022] DELETE /identity/v3/projects/11547a55232f48218b24d2b833fc0027 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:42.784311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:42.787107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:42.836654 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:42.859397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8bd7-ba0b-4683-a246-48cca4d30a78 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:42.918411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6dce-cdf3-4842-b694-56cf33e8d700 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:42.934593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:42.936746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.936746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.936746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] PATH_INFO: `/v3/users/4ed0fd57870a40c4b2a51d3e0b48f3d5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.937919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed0fd57870a40c4b2a51d3e0b48f3d5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:42.945223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:42.970203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:42.970850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:42.971135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:42.971413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:42.975910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:43.046488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed0fd57870a40c4b2a51d3e0b48f3d5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:43.047605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed0fd57870a40c4b2a51d3e0b48f3d5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:43.056364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed0fd57870a40c4b2a51d3e0b48f3d5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:43.106180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed0fd57870a40c4b2a51d3e0b48f3d5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:43.106934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed0fd57870a40c4b2a51d3e0b48f3d5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:43.121887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:43.124306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a5e41-fef5-405f-a921-5e879fa8531f service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:43.135681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1917/3862] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:42 2022] DELETE /identity/v3/users/4ed0fd57870a40c4b2a51d3e0b48f3d5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:43.146593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1946/3863] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:44.405443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:44.407939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:44.688174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08d82f-73bb-4dbf-a9e0-441f8cac8241 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:44.705008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:44.705920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:44.706161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:44.708043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] PATH_INFO: `/v3/projects/07d4cf0555734adfb53e3aded4ff88f0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:44.710823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d4cf0555734adfb53e3aded4ff88f0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:44.713674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:44.825166 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:44.843539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d4cf0555734adfb53e3aded4ff88f0', 'request_id': 'req-a994cc00-612e-4be2-b161-dc6668f7e7da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:44.856495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d4cf0555734adfb53e3aded4ff88f0', 'request_id': 'req-a994cc00-612e-4be2-b161-dc6668f7e7da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:44.870474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d4cf0555734adfb53e3aded4ff88f0', 'request_id': 'req-a994cc00-612e-4be2-b161-dc6668f7e7da'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:44.896683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] The token cache is being invalidate because project 07d4cf0555734adfb53e3aded4ff88f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:44.897021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:44.898299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a994cc00-612e-4be2-b161-dc6668f7e7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:44.901013 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1918/3864] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:44 2022] DELETE /identity/v3/projects/07d4cf0555734adfb53e3aded4ff88f0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:44.917190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:44.917757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:44.918522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:44.963093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:44.964356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:44.977015 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:45.110615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1947/3865] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:45.118470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.118765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.119043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.156917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:45.158222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:45.181347 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1919/3866] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:45.185675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.199679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815e64a-9ed7-4c5b-a8bb-e568a055bf40 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.210351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.210993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.211283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.211558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.212221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:45.212529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.214320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.248076 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1948/3867] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:45.253957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.274386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8974-a030-429e-a053-0d2bb539c11d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.281105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.282304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.282848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.283425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.294214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.297003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.333248 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1920/3868] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:45 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:45.337391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.365676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6688-246e-4744-8d4f-eb13796c4503 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.466072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.467126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.481014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.482060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.483753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.488798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.581741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1949/3869] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:45 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:45.587568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.612802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639c18-3255-4a29-88e0-1705c9f7e85f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.637970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.638534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.639001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.639306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.642605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.647391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.684135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1921/3870] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:45.687897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.714313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54419-c6d9-42a5-aafb-8994a932e3e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.726316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.727459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.727929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.728444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.729878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.740538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e75ff-af7f-47e6-97bc-8259bf21054f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.795243 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1950/3871] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:45.800122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:45.815678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614c63b-c322-4654-8a94-22f04b73b690 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:45.823435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:45.824328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.824850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.825337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] PATH_INFO: `/v3/projects/572a2f23f9254c2ea445a56a2beab773/users/ff6f7b8228b446f788a22d00c203a9e0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.857549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572a2f23f9254c2ea445a56a2beab773, user_id=ff6f7b8228b446f788a22d00c203a9e0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:45.861971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:45.894084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1922/3872] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:45 2022] PUT /identity/v3/projects/572a2f23f9254c2ea445a56a2beab773/users/ff6f7b8228b446f788a22d00c203a9e0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:45.906195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:45.906626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:45.906858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:45.971310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] MFA Rules not processed for user `ff6f7b8228b446f788a22d00c203a9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:45.974677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.100526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1951/3873] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:46.101676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:46.103876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.119171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:46.126840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.147274 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:46.255489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e33-05c2-4e09-bd1c-cddf3bffb825 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:46.269715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:46.270422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:46.270751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:46.271223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:46.295030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:46.296930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff1515-82a7-4592-8411-fa08d530636e service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:46.303222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee27fc-44ef-41ce-9d59-c7d56557f5dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:46.314747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:46.315625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:46.315936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:46.316207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] PATH_INFO: `/v3/users/6dbd1ce0900b45f7a853ceac99df932b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:46.329163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1923/3874] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:46.333534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbd1ce0900b45f7a853ceac99df932b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:46.336013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:46.426097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbd1ce0900b45f7a853ceac99df932b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:46.435017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbd1ce0900b45f7a853ceac99df932b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:46.449635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbd1ce0900b45f7a853ceac99df932b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:46.453258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbd1ce0900b45f7a853ceac99df932b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:46.454140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbd1ce0900b45f7a853ceac99df932b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:46.474972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:46.474972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:46.475298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:46.477557 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1952/3875] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:46 2022] DELETE /identity/v3/users/6dbd1ce0900b45f7a853ceac99df932b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:46.500194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:46.501709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.638872 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1924/3876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:46.646780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:46.650089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.773322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff31d-ebde-4926-8ab2-8edf32d9e739 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:46.780233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:46.780778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:46.781296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:46.781840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:46.802312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:46.813800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd4773-0e06-487e-a7b7-dead959f729b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:46.844866 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1953/3877] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:46.954532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:46.961166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:46.985349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae183-cb8d-4140-b24a-e8880c8e8857 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:46.994643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:46.995741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:46.996442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:46.996986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] PATH_INFO: `/v3/users/ff6f7b8228b446f788a22d00c203a9e0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.000039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6f7b8228b446f788a22d00c203a9e0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:47.003332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:47.006172 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:47.091095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6f7b8228b446f788a22d00c203a9e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.091909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6f7b8228b446f788a22d00c203a9e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.104127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6f7b8228b446f788a22d00c203a9e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.122847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6f7b8228b446f788a22d00c203a9e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.124472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6f7b8228b446f788a22d00c203a9e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.152386 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1925/3878] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:46 2022] DELETE /identity/v3/users/ff6f7b8228b446f788a22d00c203a9e0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:47.157129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.158045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.158539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.188047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:47.189298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:47.245375 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:47.328447 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1954/3879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:47.376343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:47.382997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:47.504517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:47.507248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:47.519095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaa91b-0b31-4f5a-8043-9e01c63df42f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:47.523790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d4ad-c443-42e8-a5c1-a4687e7cc066 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:47.527459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:47.528105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.529974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.530745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.536540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:47.537294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.537912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.538856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] PATH_INFO: `/v3/projects/63c254bcf66542ae9c5bdeb70c07245d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.540138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c254bcf66542ae9c5bdeb70c07245d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:47.542458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:47.558200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:47.559799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8858d-4747-47fc-8eee-c4753611fdf6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:47.580937 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1926/3880] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:47.620134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c254bcf66542ae9c5bdeb70c07245d', 'request_id': 'req-5a3e1936-9a9a-492e-9d68-c0283d657db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.629503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c254bcf66542ae9c5bdeb70c07245d', 'request_id': 'req-5a3e1936-9a9a-492e-9d68-c0283d657db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.636742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c254bcf66542ae9c5bdeb70c07245d', 'request_id': 'req-5a3e1936-9a9a-492e-9d68-c0283d657db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.662370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] The token cache is being invalidate because project 63c254bcf66542ae9c5bdeb70c07245d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:47.662670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.663372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a3e1936-9a9a-492e-9d68-c0283d657db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:47.665069 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1955/3881] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:47 2022] DELETE /identity/v3/projects/63c254bcf66542ae9c5bdeb70c07245d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:47.671245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.671755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.671980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.704422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:47.706123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:47.794450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1927/3882] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:47.803057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.803337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.803621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.831139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:47.832616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:47.842298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1956/3883] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:47.846743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:47.862519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d02208-6ea6-42d0-b998-28de4e5eb937 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:47.872258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:47.873122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.873534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.874610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.882085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:47.882570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:47.884330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:47.920862 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1928/3884] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:47.922309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:47.940222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ddfec-e684-4288-b2b4-bb1730502eb0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:47.948519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:47.949245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:47.950114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:47.950114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:47.950666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:47.954435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:47.990017 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1957/3885] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:47 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:47.993960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.009920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8d88-e0e8-4da6-9182-a229c52f4e21 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.019495 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:48.123514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.125319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.125761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.127356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.128489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.142348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:48.179194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1929/3886] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:47 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:13:48.183030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.196250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3045-1cb5-4957-ab1c-9f3fb3f7a4ac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.213203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.214195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.215914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.216400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.219036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.222303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:48.243249 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1958/3887] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:48.244968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.264778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291bbf-61d6-472f-a4a0-82fc666e5bf0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.279693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.280955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.281381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.281580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.282217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.287751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a95b3-4012-4410-b60d-b1301baff827 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:48.314194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1930/3888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:48.315765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.331624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a05d89-05af-4596-b9a8-bf26ea508deb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.338179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.339271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.352442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.353006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] PATH_INFO: `/v3/projects/b730f5960b50450b9f6e724945ae8613/users/88a8086a0ed34e4898db9e4d4a632a97/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.376784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b730f5960b50450b9f6e724945ae8613, user_id=88a8086a0ed34e4898db9e4d4a632a97, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.380038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:48.420085 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1959/3889] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:48 2022] PUT /identity/v3/projects/b730f5960b50450b9f6e724945ae8613/users/88a8086a0ed34e4898db9e4d4a632a97/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:48.426055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.426351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.426734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.477210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:48.478878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:48.574292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1931/3890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:48.585158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.587382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:48.700583 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:48.711619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424351-dcbb-4472-b963-a3b82b4908fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.737719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.738365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.738688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.739232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.776907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.778498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151740d-3099-4a0f-992e-392fc8f09563 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:48.798784 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1960/3891] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:48.873773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:48.875716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:48.900366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b638bf-cf3e-4cf8-acbe-987e1b1bb68c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:48.911695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:48.912392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:48.912995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:48.913279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] PATH_INFO: `/v3/projects/572a2f23f9254c2ea445a56a2beab773` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:48.914567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] RBAC: Authorizing `identity:delete_project(project_id=572a2f23f9254c2ea445a56a2beab773)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:48.916588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.023013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572a2f23f9254c2ea445a56a2beab773', 'request_id': 'req-904bfed9-f445-4b8d-858c-4c822e5202af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:49.038119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572a2f23f9254c2ea445a56a2beab773', 'request_id': 'req-904bfed9-f445-4b8d-858c-4c822e5202af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:49.066203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572a2f23f9254c2ea445a56a2beab773', 'request_id': 'req-904bfed9-f445-4b8d-858c-4c822e5202af'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:49.093270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] The token cache is being invalidate because project 572a2f23f9254c2ea445a56a2beab773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:49.093622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:49.095553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-904bfed9-f445-4b8d-858c-4c822e5202af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:49.097333 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1932/3892] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:48 2022] DELETE /identity/v3/projects/572a2f23f9254c2ea445a56a2beab773 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:49.102718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.103053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.103286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.137108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:49.138538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:49.250110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1961/3893] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:49.258089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.258320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.258496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.286250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:49.287702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:49.297436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1933/3894] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:49.308534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.328061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b685f8a-93ef-4f21-8d63-705f58f8f3ed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.334185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.335012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.335426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.335711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.336460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:13:49.337019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.338872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.355972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1962/3895] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:13:49.360897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.367404 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:49.371935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a1db8-2986-4362-b72c-3514795e9bb1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.380775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.381973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.383359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.383359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.388876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.388876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ff912-712e-4d4d-8542-ef3704f70633 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.434730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.435984 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1934/3896] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:49.451199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881c4ba-e3af-45af-a25b-76ea26b65f78 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.524343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.524715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.524999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.555138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] MFA Rules not processed for user `5db19a97588e41d1858915c9ccc48620`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:49.556843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:49.558365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.559337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.559921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.560402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.561907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.564427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.598258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1963/3897] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:49.602585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.618109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154f70-54ee-4f91-96df-d36e7688bf6a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.626118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.627175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.627693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.628116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.628975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.631492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.646853 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1964/3898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:49.651668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.693956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b28c4-6869-425c-b91a-b9c3ac1f7dc9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.707414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1935/3899] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:13:49.716564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.717203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.717549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.717949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.724001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.728509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1886a3-20e8-40e5-89b2-b49657407e1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.780378 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1965/3900] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:13:49.782429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:49.801214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb7fd-ca68-4be5-9d4d-58d61ba1cf75 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:49.814708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:49.817182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.817656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.818584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] PATH_INFO: `/v3/projects/d1a4d54d7b6f4c9daeb7f7bfe1ee4c26/users/7d79ece7f0c740dca1263085ee1392d6/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.869470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a4d54d7b6f4c9daeb7f7bfe1ee4c26, user_id=7d79ece7f0c740dca1263085ee1392d6, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:49.872163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:49.890244 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1936/3901] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:49 2022] PUT /identity/v3/projects/d1a4d54d7b6f4c9daeb7f7bfe1ee4c26/users/7d79ece7f0c740dca1263085ee1392d6/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:49.901671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:49.901962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:49.902236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:49.933681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] MFA Rules not processed for user `7d79ece7f0c740dca1263085ee1392d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:49.934967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:50.000183 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:50.088016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1966/3902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:50.092190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.200275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5387-36be-405d-9b33-f131ab789ef2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.205428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.206062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.206342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.206613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.207252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.209246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.241143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1937/3903] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:13:50 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:50.244330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.257749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee78b-5c1b-4d39-9a37-51d6eb39496d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.331254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.333153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.333741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.334172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.335148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.337347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.379159 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1967/3904] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:13:50 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:13:50.382675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.406268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673440-3232-4b64-b552-e451eff6519c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.422163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.423222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.423222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.423429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.424133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.429683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.492037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1938/3905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:50.492648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.509546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07d7cb-4146-46cc-b355-edf0d0a5e628 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.524375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.526661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.527140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.530595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] PATH_INFO: `/v3/projects/bec284af3a2d4ba5bf4206545220b331/users/0d145464a190472f9699e1bd44e3dd62/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.569853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec284af3a2d4ba5bf4206545220b331, user_id=0d145464a190472f9699e1bd44e3dd62, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.572875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.608542 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1968/3906] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:50 2022] PUT /identity/v3/projects/bec284af3a2d4ba5bf4206545220b331/users/0d145464a190472f9699e1bd44e3dd62/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:50.613107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.641646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a877-73c6-47d6-b2ca-66d8a8580f4e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.710623 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:50.774463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.775781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.776544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.776938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.778369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.781296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9741-1bb2-49ed-bfc1-51d0e0be8094 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.798688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1939/3907] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:13:50.803055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:50.821531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a766e09-ed75-4eb7-a25f-4ea589ff4777 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:50.838706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:50.839686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.839969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.840242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] PATH_INFO: `/v3/projects/bec284af3a2d4ba5bf4206545220b331/users/0d145464a190472f9699e1bd44e3dd62/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.846240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec284af3a2d4ba5bf4206545220b331, user_id=0d145464a190472f9699e1bd44e3dd62, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:50.854641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:50.905102 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1969/3908] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:13:50 2022] PUT /identity/v3/projects/bec284af3a2d4ba5bf4206545220b331/users/0d145464a190472f9699e1bd44e3dd62/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:50.907635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161f68-5956-4648-99fd-b574dbbc7630 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:50.908067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161f68-5956-4648-99fd-b574dbbc7630 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:50.908150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161f68-5956-4648-99fd-b574dbbc7630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:50.998353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-70161f68-5956-4648-99fd-b574dbbc7630 None None] MFA Rules not processed for user `0d145464a190472f9699e1bd44e3dd62`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:51.000573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-70161f68-5956-4648-99fd-b574dbbc7630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:51.164691 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1940/3909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:51.213561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:51.215483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:51.414855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4eb41-ed37-487b-ba0e-cf5ff9626228 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:51.425826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:51.426649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:51.427062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:51.427493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:51.457745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:51.461788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:51.491269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1970/3910] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:54.554813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:54.555810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:54.555810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:54.603412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] MFA Rules not processed for user `ad359d9027834039a45d3904d5afa0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:54.606698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:54.758476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1941/3911] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:54.771377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:54.774154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:54.835001 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:54.917184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930a754-374c-4ff8-9b2f-640834835ec0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:54.924172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:54.924897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:54.925245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:54.925619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:54.937491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:54.940132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee993-d58a-4a81-9b0d-0cf2854372e4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:54.965024 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1971/3912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:54 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:56.680385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:56.791134 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:56.853853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370edff-24ad-4e76-9f89-39df3b088c5c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:56.864775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:56.865454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:56.865740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:56.866015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] PATH_INFO: `/v3/users/7d79ece7f0c740dca1263085ee1392d6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:56.869045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d79ece7f0c740dca1263085ee1392d6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:56.871063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:57.056820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d79ece7f0c740dca1263085ee1392d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:57.057623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d79ece7f0c740dca1263085ee1392d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:57.082835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d79ece7f0c740dca1263085ee1392d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:57.129343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d79ece7f0c740dca1263085ee1392d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:57.130663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d79ece7f0c740dca1263085ee1392d6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:57.165097 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1942/3913] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:56 2022] DELETE /identity/v3/users/7d79ece7f0c740dca1263085ee1392d6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:57.167389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3c9e-5547-409f-b182-d96d59585e13 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:57.167884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3c9e-5547-409f-b182-d96d59585e13 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:57.167984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3c9e-5547-409f-b182-d96d59585e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:57.222504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-28fa3c9e-5547-409f-b182-d96d59585e13 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:57.224509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-28fa3c9e-5547-409f-b182-d96d59585e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:57.408466 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1972/3914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:57.450089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:57.452907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:57.620394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aac0e-7cc2-4af2-88c7-76f160cf471e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:57.636219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:57.637102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:57.637742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:57.639653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:57.651553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:57.653685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:57.682018 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1943/3915] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:58.393005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:58.397194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:58.397803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:58.484522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] MFA Rules not processed for user `88a8086a0ed34e4898db9e4d4a632a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:13:58.486174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:58.596073 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1973/3916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:13:59.384750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:59.386970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:59.403895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda35bb8-11fc-4f5a-b9e3-27cbf6f5071f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:59.422743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:59.423737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:59.424185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:59.424611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] PATH_INFO: `/v3/projects/d1a4d54d7b6f4c9daeb7f7bfe1ee4c26` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:59.426073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a4d54d7b6f4c9daeb7f7bfe1ee4c26)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:59.428489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:59.461425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:59.463119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:59.520344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a4d54d7b6f4c9daeb7f7bfe1ee4c26', 'request_id': 'req-8dd32c5a-fac7-483a-b237-e601f2597530'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.536442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a4d54d7b6f4c9daeb7f7bfe1ee4c26', 'request_id': 'req-8dd32c5a-fac7-483a-b237-e601f2597530'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.544065 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:59.553122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a4d54d7b6f4c9daeb7f7bfe1ee4c26', 'request_id': 'req-8dd32c5a-fac7-483a-b237-e601f2597530'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.562392 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:59.579361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] The token cache is being invalidate because project d1a4d54d7b6f4c9daeb7f7bfe1ee4c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:13:59.580362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.581158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.583446 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1944/3917] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:59 2022] DELETE /identity/v3/projects/d1a4d54d7b6f4c9daeb7f7bfe1ee4c26 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:13:59.588329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:13:59.589965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:59.642603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd653-aa07-4923-899c-b54dfc61fff6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:59.737941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd32c5a-fac7-483a-b237-e601f2597530 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:13:59.743813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:59.744563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:59.744955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:59.745339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] PATH_INFO: `/v3/users/0d145464a190472f9699e1bd44e3dd62` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:59.754194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d145464a190472f9699e1bd44e3dd62)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:59.755882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:13:59.756138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:59.756573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:13:59.756858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:13:59.757132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:13:59.758985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:13:59.840668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:13:59.844654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:13:59.876148 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1974/3918] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:13:59.891714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d145464a190472f9699e1bd44e3dd62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.897851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d145464a190472f9699e1bd44e3dd62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.914227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d145464a190472f9699e1bd44e3dd62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.948206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d145464a190472f9699e1bd44e3dd62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.949229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f2a191e-2b89-4ef5-884e-6e2b4e065f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d145464a190472f9699e1bd44e3dd62'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:13:59.981191 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1945/3919] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:13:59 2022] DELETE /identity/v3/users/0d145464a190472f9699e1bd44e3dd62 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:14:00.903770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:00.923544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a79a03-7c5e-43d9-a302-fbda93d739ab service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:01.132082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:01.133439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:01.133439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:01.133930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] PATH_INFO: `/v3/projects/bec284af3a2d4ba5bf4206545220b331` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:01.135613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec284af3a2d4ba5bf4206545220b331)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:01.137704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:01.203884 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:01.303137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec284af3a2d4ba5bf4206545220b331', 'request_id': 'req-95e821dd-f853-4df9-a022-c40ab0422fca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:01.313709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec284af3a2d4ba5bf4206545220b331', 'request_id': 'req-95e821dd-f853-4df9-a022-c40ab0422fca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:01.333538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec284af3a2d4ba5bf4206545220b331', 'request_id': 'req-95e821dd-f853-4df9-a022-c40ab0422fca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:01.357805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] The token cache is being invalidate because project bec284af3a2d4ba5bf4206545220b331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:01.361377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:01.365026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95e821dd-f853-4df9-a022-c40ab0422fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:01.370659 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1975/3920] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:00 2022] DELETE /identity/v3/projects/bec284af3a2d4ba5bf4206545220b331 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:01.372322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:01.372778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:01.372958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:01.431233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:01.434174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:01.554113 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1946/3921] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:01.560675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:01.561617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:01.561904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:01.624270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:01.632028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:01.672221 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1976/3922] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:01.672446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:01.678225 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:01.685124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af21c71-b386-4cfb-9dcd-f1981f6fadc7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:01.708773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:01.709746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:01.710018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:01.710347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:01.710935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:01.711234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:01.713034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:01.752115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1947/3923] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:14:01.758307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:01.777970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff580e5d-2892-416a-9d7a-08c71630990a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:01.794867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:01.796852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:01.797096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:01.797543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:01.799458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:01.802433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:01.848444 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1977/3924] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:01 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:01.852796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:01.866173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee51026-f019-4854-9302-52e3a866787f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:02.075661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:02.076308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.076644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.080402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.081444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:02.088585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:02.140431 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1948/3925] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:01 2022] POST /identity/v3/users => generated 279 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:14:02.144766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:02.161868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ef8b-f94a-47e4-94c2-dda28bbbdfc5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:02.177974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:02.179080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.179080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.179322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.179954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:02.183944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:02.207728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1978/3926] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:02.211447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:02.266241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212980-4a5c-4807-8f4d-7b183e65c3df admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:02.282769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:02.285956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.286454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.286898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.288447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:02.295891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ad05f-0e15-4187-bbd6-b29dc50e8576 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:02.310952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1949/3927] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:02.315622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:02.327732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f368-547d-41a5-8819-78d5fdc61037 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:02.334198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:02.335215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.335600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.335975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] PATH_INFO: `/v3/projects/d628c38090224426b9a82f9d77a42093/users/5e8a5c61fbdd42a6a5c888b2b5d53522/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.357020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d628c38090224426b9a82f9d77a42093, user_id=5e8a5c61fbdd42a6a5c888b2b5d53522, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:02.361779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:02.397429 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1979/3928] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:02 2022] PUT /identity/v3/projects/d628c38090224426b9a82f9d77a42093/users/5e8a5c61fbdd42a6a5c888b2b5d53522/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:02.409456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfcb04-4d98-4568-9fec-5b0e647cd36a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.410019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfcb04-4d98-4568-9fec-5b0e647cd36a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.410236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfcb04-4d98-4568-9fec-5b0e647cd36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.497734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e4bfcb04-4d98-4568-9fec-5b0e647cd36a None None] MFA Rules not processed for user `5e8a5c61fbdd42a6a5c888b2b5d53522`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:02.499409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e4bfcb04-4d98-4568-9fec-5b0e647cd36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:02.681915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1950/3929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:02.682868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:02.695177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.696113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.696403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.761281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] MFA Rules not processed for user `88a8086a0ed34e4898db9e4d4a632a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:02.763773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:02.848441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa512a-bea5-4bcd-bbeb-0ae85d0b1753 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:02.862849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:02.863613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:02.863968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:02.864315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:02.865038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:02.867283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:02.916171 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1980/3930] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:02 2022] POST /identity/v3/projects => generated 357 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:02.919764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:02.924538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1951/3931] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:03.025829 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:03.101516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054687-47fe-4c3d-a64c-5f9f4a86c068 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:03.106940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:03.107597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.109200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.109510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.110158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:03.112275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:03.144205 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1981/3932] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:02 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:03.145525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:03.153615 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:03.169218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc173d-ade1-4ede-91af-6c5fcecb3b9c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:03.185851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:03.186559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.186837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.187108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.188371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:03.191078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:03.211844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1952/3933] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:03.213552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:03.242113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f49e6d-8dac-4353-8876-36a9d96fe81f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:03.266375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:03.267905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.268538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.269751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] PATH_INFO: `/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227/users/11231d7f52c14f5793e552ffad59c81d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.314920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f01fe2ca4cb4b74a84fbdb60ef4e227, user_id=11231d7f52c14f5793e552ffad59c81d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:03.320826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:03.345748 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1982/3934] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:03 2022] PUT /identity/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227/users/11231d7f52c14f5793e552ffad59c81d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:03.350574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:03.378239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677f270-e6ea-4d6a-b0af-999d0896ed52 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:03.555689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:03.556383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.556639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.556923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.557698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:03.559655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40b78-67e8-427c-9113-6fb0f9f48cf4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:03.583831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1953/3935] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:03.584990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:03.610638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7d10-c06f-4cfc-8118-1ea9454ee260 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:03.624730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:03.626555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.626841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.627115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] PATH_INFO: `/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227/users/11231d7f52c14f5793e552ffad59c81d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.632917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f01fe2ca4cb4b74a84fbdb60ef4e227, user_id=11231d7f52c14f5793e552ffad59c81d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:03.638505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:03.719718 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1983/3936] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:03 2022] PUT /identity/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227/users/11231d7f52c14f5793e552ffad59c81d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:03.720793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:03.721215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:03.721584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:03.828339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] MFA Rules not processed for user `11231d7f52c14f5793e552ffad59c81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:03.830541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:03.959350 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1954/3937] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:03.964806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:03.992255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9862e-1385-489c-bec0-b65a95909566 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:04.020104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11231d7f52c14f5793e552ffad59c81d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:04.020625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:04.021032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:04.033432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:04.033432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:04.033432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:04.033432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:04.088833 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1984/3938] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:04.090942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:04.109703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb1f8-990f-4f0f-813a-aab35c29b427 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:04.131589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11231d7f52c14f5793e552ffad59c81d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:04.132387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:04.132673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:04.132948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:04.133902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:04.137948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:04.227770 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1955/3939] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:04 2022] POST /identity/v3/projects => generated 350 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:04.231680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:04.256279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6eb5-d48d-4559-9696-97343348ff90 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:04.431055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11231d7f52c14f5793e552ffad59c81d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:04.432316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:04.435570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:04.436440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:04.437155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:04.437492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:04.442549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:04.482312 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1985/3940] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:04.488127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:04.490708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:04.642528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620331-843e-4620-99ba-b7d5ecd3d8eb tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:04.652176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:04.652933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:04.653220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:04.654716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:04.675993 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:04.686324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:04.688140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:04.702752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1956/3941] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:04.937232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:04.960449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e201cb-4276-452a-8bdd-cc212d1afa84 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:04.975464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11231d7f52c14f5793e552ffad59c81d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:04.982298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:04.983192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:04.983582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] PATH_INFO: `/v3/projects/b8dd25bc55a2421c804399dda57d68ad` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:04.984912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8dd25bc55a2421c804399dda57d68ad)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:04.986910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:05.088132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dd25bc55a2421c804399dda57d68ad', 'request_id': 'req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.116796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dd25bc55a2421c804399dda57d68ad', 'request_id': 'req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.122599 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:05.125784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dd25bc55a2421c804399dda57d68ad', 'request_id': 'req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.145606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] The token cache is being invalidate because project b8dd25bc55a2421c804399dda57d68ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:05.145606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.145915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32f9a5a7-7af7-4414-9aaf-ccf9efaac191 tempest-QuotasTest-1906468339 tempest-QuotasTest-1906468339-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.147651 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1986/3942] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:04 2022] DELETE /identity/v3/projects/b8dd25bc55a2421c804399dda57d68ad => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:05.336787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:05.476161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806644e8-22d4-46ae-a15d-e19f9390259b service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:05.608023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:05.608023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:05.608023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:05.608446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] PATH_INFO: `/v3/users/5e8a5c61fbdd42a6a5c888b2b5d53522` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:05.615124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8a5c61fbdd42a6a5c888b2b5d53522)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:05.618786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:05.748693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8a5c61fbdd42a6a5c888b2b5d53522'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.750286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8a5c61fbdd42a6a5c888b2b5d53522'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.762918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8a5c61fbdd42a6a5c888b2b5d53522'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.786419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8a5c61fbdd42a6a5c888b2b5d53522'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.795845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8a5c61fbdd42a6a5c888b2b5d53522'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:05.828057 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1957/3943] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:05 2022] DELETE /identity/v3/users/5e8a5c61fbdd42a6a5c888b2b5d53522 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:05.832225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:05.833036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:05.833312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:05.863601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:05.871219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:05.996292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1987/3944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:06.008635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:06.018062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:06.090028 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:06.186827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309884-37ce-4500-95d0-6d6e3e9718ea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:06.190997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:06.191659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:06.192010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:06.192539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:06.212343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:06.214820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:06.233489 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1958/3945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:06.729790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:06.731274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:06.751440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26fda-17c9-4102-a13e-baeedfd68ec7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:06.758630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:06.759280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:06.759712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:06.760551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] PATH_INFO: `/v3/projects/d628c38090224426b9a82f9d77a42093` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:06.765721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d628c38090224426b9a82f9d77a42093)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:06.768080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:06.830099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd628c38090224426b9a82f9d77a42093', 'request_id': 'req-a917d132-3768-4788-a556-6f4369a71791'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:06.838810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd628c38090224426b9a82f9d77a42093', 'request_id': 'req-a917d132-3768-4788-a556-6f4369a71791'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:06.845963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd628c38090224426b9a82f9d77a42093', 'request_id': 'req-a917d132-3768-4788-a556-6f4369a71791'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:06.861500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] The token cache is being invalidate because project d628c38090224426b9a82f9d77a42093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:06.861755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:06.862428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:06.864576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1988/3946] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:06 2022] DELETE /identity/v3/projects/d628c38090224426b9a82f9d77a42093 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:06.868575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:06.879767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bef98-39e6-4350-96d3-75e3e1c15a36 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:06.999436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:07.002171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:07.005516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:07.005968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] PATH_INFO: `/v3/users/11231d7f52c14f5793e552ffad59c81d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:07.009625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11231d7f52c14f5793e552ffad59c81d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:07.016915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:07.149724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11231d7f52c14f5793e552ffad59c81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.150316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11231d7f52c14f5793e552ffad59c81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.163257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11231d7f52c14f5793e552ffad59c81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.189236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11231d7f52c14f5793e552ffad59c81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.190125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5140c263-6c4c-4595-94b4-021e668f2997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11231d7f52c14f5793e552ffad59c81d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.213749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1959/3947] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:06 2022] DELETE /identity/v3/users/11231d7f52c14f5793e552ffad59c81d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:07.573734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:07.575197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:07.591220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d132-3768-4788-a556-6f4369a71791 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:07.685757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:07.686891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:07.687339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:07.687616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] PATH_INFO: `/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:07.688876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f01fe2ca4cb4b74a84fbdb60ef4e227)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:07.691301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:07.705952 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:07.759920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'request_id': 'req-3e4ab543-c870-4787-90d7-3de9c334e548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.769644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'request_id': 'req-3e4ab543-c870-4787-90d7-3de9c334e548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.778682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f01fe2ca4cb4b74a84fbdb60ef4e227', 'request_id': 'req-3e4ab543-c870-4787-90d7-3de9c334e548'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.794272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] The token cache is being invalidate because project 9f01fe2ca4cb4b74a84fbdb60ef4e227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:07.794824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.797527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e4ab543-c870-4787-90d7-3de9c334e548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:07.800211 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1989/3948] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:07 2022] DELETE /identity/v3/projects/9f01fe2ca4cb4b74a84fbdb60ef4e227 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:07.806276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:07.806582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:07.806846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:07.829522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:07.831962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:07.917334 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:07.943165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1960/3949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:07.954667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:07.955538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:07.955969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:07.982701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:07.985159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:08.001895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.003052 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1990/3950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:08.015035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ccf6-178f-4a2e-9d2a-5e00cc621ab4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.021878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.022964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.023592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.024101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.025370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:08.028784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.032849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.054055 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1961/3951] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:08.057884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.070006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673663-81ff-4290-af6c-77bd79fcedea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.097990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.099130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.100225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.100877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.101707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.106614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.196457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1991/3952] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:08 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:08.200265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.220329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621861b-b79b-4ea4-b27f-0d0ff4925500 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.315570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.316505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.316957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.317384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.318844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.321465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.359081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1962/3953] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:08 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:08.359951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.371914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ec83-1eb8-4866-9862-af9f58f7eb43 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.378763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.379489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.379860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.380205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.380926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.382723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.402010 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1992/3954] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:14:08.406302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.418766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff6927-c5e8-4c39-be75-f6455a11d1d1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.427662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.428283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.428563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.428837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.429853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.433077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2650-30e4-4865-8c8a-0636594dad5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.453328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1963/3955] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:08.454182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.466669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf22ea-3a2a-4871-b2fa-e91ec6c14dec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.479468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.480649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.481163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.484804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] PATH_INFO: `/v3/projects/c01d5f10d55e46b1a3972d9ca8623e5d/users/f836b902bf1d4a15b9236b27e103d92a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.518803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01d5f10d55e46b1a3972d9ca8623e5d, user_id=f836b902bf1d4a15b9236b27e103d92a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.523553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.557453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1993/3956] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:08 2022] PUT /identity/v3/projects/c01d5f10d55e46b1a3972d9ca8623e5d/users/f836b902bf1d4a15b9236b27e103d92a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:08.562839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.563216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.563589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.599800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] MFA Rules not processed for user `f836b902bf1d4a15b9236b27e103d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:08.601037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:08.710583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1964/3957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:08.719075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.722052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:08.818265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a838a-fce8-4585-a24b-5f6f2100adc5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.822517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.823362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.823758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.824031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.835207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:08.836860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:08.848463 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1994/3958] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:08.872798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:08.926595 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:08.964411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf272b-fc85-442d-9d7f-4422c8d33ef2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:08.992335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:08.993792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:08.994327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:08.994935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] PATH_INFO: `/v3/users/f836b902bf1d4a15b9236b27e103d92a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:08.996530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f836b902bf1d4a15b9236b27e103d92a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:09.000138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:09.065035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f836b902bf1d4a15b9236b27e103d92a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:09.066249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f836b902bf1d4a15b9236b27e103d92a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:09.075632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f836b902bf1d4a15b9236b27e103d92a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:09.096063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f836b902bf1d4a15b9236b27e103d92a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:09.096825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a76a9d9d-38a5-4dab-a7c4-86b7727d3cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f836b902bf1d4a15b9236b27e103d92a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:09.117495 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1965/3959] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:08 2022] DELETE /identity/v3/users/f836b902bf1d4a15b9236b27e103d92a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:09.118708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:09.120422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:09.120717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:09.120998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:09.121443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:09.147404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:09.148903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:09.211975 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:09.297932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8532e-abb8-45bd-98c9-cf1f107e978e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:09.309340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1966/3960] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:09.321553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:09.324141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:09.416476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f377b-beb3-4b14-885c-1c0a6a2591d3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:09.425603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:09.426472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:09.426869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:09.427265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:09.428728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:09.429014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:09.429298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:09.429605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:09.431821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:09.441245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:09.443642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:09.471140 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1967/3961] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:09.533085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:09.534781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014bc55-4d23-4a3b-a70b-e9ec73a2419c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:09.548612 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1995/3962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:14:10.117830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:10.118780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:10.147919 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:10.164736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391d79-c273-4d6b-bc21-4f16f5874a2f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:10.195396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:10.200234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:10.200608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:10.201636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] PATH_INFO: `/v3/users/3949c16e4fde47108c4242a3f99ec5df` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:10.206103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3949c16e4fde47108c4242a3f99ec5df)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:10.216656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:10.379805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3949c16e4fde47108c4242a3f99ec5df'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.388211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3949c16e4fde47108c4242a3f99ec5df'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.410582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3949c16e4fde47108c4242a3f99ec5df'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.442093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3949c16e4fde47108c4242a3f99ec5df'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.443739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3949c16e4fde47108c4242a3f99ec5df'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.468828 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1968/3963] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:10 2022] DELETE /identity/v3/users/3949c16e4fde47108c4242a3f99ec5df => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:10.472323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:10.472916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:10.472916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:10.507975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:10.510265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:10.639227 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1996/3964] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:10.693502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:10.695109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:10.738476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:10.740114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:10.760697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277bd0-7b1a-4518-bb6c-6d291a73fd55 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:10.776764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:10.777638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:10.778034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:10.778407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] PATH_INFO: `/v3/projects/c01d5f10d55e46b1a3972d9ca8623e5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:10.781053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01d5f10d55e46b1a3972d9ca8623e5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:10.783163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:10.794546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09738878-2d4e-4d96-9f1c-122672ad65c2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:10.803600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:10.805026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:10.806707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:10.807130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:10.815160 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:10.852655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:10.854756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb61c-1674-48ce-a635-dc220ba723a5 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:10.869916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1969/3965] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:10.910635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01d5f10d55e46b1a3972d9ca8623e5d', 'request_id': 'req-09bf3a65-4978-43b1-9728-a6eb791072bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.917788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01d5f10d55e46b1a3972d9ca8623e5d', 'request_id': 'req-09bf3a65-4978-43b1-9728-a6eb791072bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.925492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01d5f10d55e46b1a3972d9ca8623e5d', 'request_id': 'req-09bf3a65-4978-43b1-9728-a6eb791072bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.959607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] The token cache is being invalidate because project c01d5f10d55e46b1a3972d9ca8623e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:10.959963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.961870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-09bf3a65-4978-43b1-9728-a6eb791072bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:10.964317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1997/3966] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:10 2022] DELETE /identity/v3/projects/c01d5f10d55e46b1a3972d9ca8623e5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:14:10.971966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:10.972638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:10.972918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.035927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:11.039590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:11.193595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1970/3967] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:11.194833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.195199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.195540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.245697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:11.247262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:11.262687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1998/3968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:11.268752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.303663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2d560-69a2-4174-901b-aa200abda055 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.319918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.324259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.324259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.324738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.326531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:11.327081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:11.331432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:11.368031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1971/3969] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:11.372564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.437881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4b20-2886-4102-99df-183847f6b6fc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.461159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.462266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.462749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.463221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.466024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:11.475234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:11.561394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1999/3970] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:11 2022] POST /identity/v3/projects => generated 393 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:11.565299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.573557 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:11.585477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bed-bfca-46ca-b181-2520f9e67f12 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.680346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.680909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.681195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.681518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.689590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:11.718478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:11.774003 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1972/3971] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:11 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:14:11.778163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.791060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9a497-113e-478e-98ee-bf9a6e92d51a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.821612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.823177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.824286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.824622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.826071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:11.829821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:11.877090 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2000/3972] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:14:11.881276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.898878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e19e-7cdc-44f2-b291-4ed9f256c195 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.917917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.918534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.918818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.919093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:11.920194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:11.923936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de169-3703-4cf6-8af6-df4d0a3a4395 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:11.960204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1973/3973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:11.961135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:11.976258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404927-6b28-4acd-ad65-50991d18ac74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:11.981554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:11.983045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:11.983454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:11.994137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] PATH_INFO: `/v3/projects/c2ff12df0f98431fb179990ca297b5c0/users/2c993fd92d3441b9a754afdc4341442c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:12.038341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ff12df0f98431fb179990ca297b5c0, user_id=2c993fd92d3441b9a754afdc4341442c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:12.044142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:12.086356 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2001/3974] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:11 2022] PUT /identity/v3/projects/c2ff12df0f98431fb179990ca297b5c0/users/2c993fd92d3441b9a754afdc4341442c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:12.096820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:12.097108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:12.097384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:12.166517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] MFA Rules not processed for user `2c993fd92d3441b9a754afdc4341442c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:12.168179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:12.294381 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1974/3975] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:12.347480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:12.349772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:12.613212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406a14-3eef-4ac8-890d-724c0b95a34e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:12.631107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:12.636912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:12.641649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:12.642170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:12.665769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:12.668682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:12.684399 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2002/3976] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:12.965944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:12.967919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:13.164367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa096b4-9bbb-449e-893a-8257a8c95dbe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:13.176100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:13.180588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:13.181030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:13.181691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] PATH_INFO: `/v3/projects/934b22e1c24a45cc87d50b89a0540f46` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:13.183136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934b22e1c24a45cc87d50b89a0540f46)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:13.192458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:13.245393 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:13.359405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934b22e1c24a45cc87d50b89a0540f46', 'request_id': 'req-aa726021-4e72-4547-a161-38d8f3094833'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.374227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934b22e1c24a45cc87d50b89a0540f46', 'request_id': 'req-aa726021-4e72-4547-a161-38d8f3094833'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.392734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934b22e1c24a45cc87d50b89a0540f46', 'request_id': 'req-aa726021-4e72-4547-a161-38d8f3094833'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.426528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] The token cache is being invalidate because project 934b22e1c24a45cc87d50b89a0540f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:13.431027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.434781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.443324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:13.444704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1975/3977] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:12 2022] DELETE /identity/v3/projects/934b22e1c24a45cc87d50b89a0540f46 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:13.465627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc248b-ff03-4b46-be19-5d174c0f5dff service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:13.610295 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:13.693189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:13.695726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:13.696013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:13.696319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] PATH_INFO: `/v3/users/ca3aabb3c55f430cb645fcf4325ea3dd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:13.698378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3aabb3c55f430cb645fcf4325ea3dd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:13.706185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:13.919061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3aabb3c55f430cb645fcf4325ea3dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:13.955713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3aabb3c55f430cb645fcf4325ea3dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:14.005146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3aabb3c55f430cb645fcf4325ea3dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:14.007544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3aabb3c55f430cb645fcf4325ea3dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:14.012917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3aabb3c55f430cb645fcf4325ea3dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:14.063347 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2003/3978] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:13 2022] DELETE /identity/v3/users/ca3aabb3c55f430cb645fcf4325ea3dd => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:15.251667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:15.253146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:15.276075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726021-4e72-4547-a161-38d8f3094833 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:15.334315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:15.336090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:15.438195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:15.438851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:15.439492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:15.439993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] PATH_INFO: `/v3/projects/fac1cae88d324f0981e18f3a5905260b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:15.441799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac1cae88d324f0981e18f3a5905260b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:15.444380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:15.541564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9894-b763-40c5-8c41-aca9252c83fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:15.552071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac1cae88d324f0981e18f3a5905260b', 'request_id': 'req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:15.567072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac1cae88d324f0981e18f3a5905260b', 'request_id': 'req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:15.580605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac1cae88d324f0981e18f3a5905260b', 'request_id': 'req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:15.615689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] The token cache is being invalidate because project fac1cae88d324f0981e18f3a5905260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:15.619234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:15.622324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8ddb06e0-bab9-42cc-86a4-7b5b5b425479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:15.627849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1976/3979] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:15 2022] DELETE /identity/v3/projects/fac1cae88d324f0981e18f3a5905260b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:15.633833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:15.634293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:15.634729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:15.721928 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:15.739827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:15.741351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:15.741351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:15.742014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:15.742434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:15.744143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:15.750344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:15.797467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:15.801378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce68bd-e1a4-40c3-aab4-4a1eae84022f service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:15.845578 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2004/3980] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:15.866420 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:16.006979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1977/3981] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:16.014685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.014977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.015256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.069527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:16.070781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:16.102769 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2005/3982] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:16.107841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.121484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99749-9bf0-45ce-ae72-f3a1ab251188 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.136730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.138815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.139556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.141100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.142220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:16.144998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.148845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.157602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.159116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:16.186310 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1978/3983] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:16.190559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.226768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347d34b-9ef6-44c4-a015-78dbb58cb755 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.246203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.246939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.247358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.247688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.249021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.254430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.344085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116026d-c4d6-46ad-85da-2a49fd7de638 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.362774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1979/3984] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:16 2022] POST /identity/v3/projects => generated 397 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:16.365164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.492583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86407a0-abad-48ab-a455-facfe89bfc17 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.505018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.506440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.506995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.507450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.508397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.509963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.511415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.514513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.515245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.515949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.518579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:16.535059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.538306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.551378 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1980/3985] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:16 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:16.555151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.555498 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2006/3986] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:16.575470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72bdf-530a-456e-92fd-ded456db8178 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.584975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.590095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.590752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.591191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.592948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.594955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.633505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1981/3987] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:14:16.637816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.656458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e24bd-f95a-4472-ab71-14264d0ecdb5 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.676274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.681534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.682577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.683059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.684435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.689634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81baed2-c562-4a23-b490-16d9ed395565 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.717295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2007/3988] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:16.721886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:16.754068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7607-0050-4b46-b3a3-8be53c1f06db admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:16.763906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:16.765739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.766502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.767015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] PATH_INFO: `/v3/projects/744c3c67433f4d268891a810016366cc/users/95b7650e677d47ab9576bc3cb6ea07e7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.796033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744c3c67433f4d268891a810016366cc, user_id=95b7650e677d47ab9576bc3cb6ea07e7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:16.801920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:16.834835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1982/3989] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:16 2022] PUT /identity/v3/projects/744c3c67433f4d268891a810016366cc/users/95b7650e677d47ab9576bc3cb6ea07e7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:16.839803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:16.840874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:16.841393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:16.891028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:16.897709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:17.048358 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2008/3990] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:17.067142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:17.069504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:17.284589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725fd60-ccf6-4691-a15e-e00dca101884 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:17.292981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:17.294023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:17.298714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:17.299072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:17.315565 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:17.322462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:17.329114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:17.383772 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1983/3991] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:21.903225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:21.905991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:21.927772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bb5b4-48b6-4054-8722-6a83264b49c0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:21.943083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:21.944991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:21.945277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:21.946775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] PATH_INFO: `/v3/users/ad359d9027834039a45d3904d5afa0a2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:21.949508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad359d9027834039a45d3904d5afa0a2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:21.956803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:22.028338 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:22.079020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad359d9027834039a45d3904d5afa0a2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:22.096801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad359d9027834039a45d3904d5afa0a2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:22.137759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad359d9027834039a45d3904d5afa0a2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:22.138650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad359d9027834039a45d3904d5afa0a2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:22.139732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-14919551-2730-498c-ac73-081c297aacfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad359d9027834039a45d3904d5afa0a2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:22.182084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2009/3992] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:21 2022] DELETE /identity/v3/users/ad359d9027834039a45d3904d5afa0a2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:23.890341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:23.907497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2aebf-33d0-4f1f-82a6-566ec86798b8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:24.157963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:24.159096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:24.159610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:24.160073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] PATH_INFO: `/v3/projects/ecd6170549f94a59898b65f2383e5d1e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:24.173136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd6170549f94a59898b65f2383e5d1e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:24.179784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:24.311665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd6170549f94a59898b65f2383e5d1e', 'request_id': 'req-5293ccf9-1974-484c-9324-c5091cda3b89'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:24.329696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd6170549f94a59898b65f2383e5d1e', 'request_id': 'req-5293ccf9-1974-484c-9324-c5091cda3b89'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:24.342176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd6170549f94a59898b65f2383e5d1e', 'request_id': 'req-5293ccf9-1974-484c-9324-c5091cda3b89'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:24.376580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] The token cache is being invalidate because project ecd6170549f94a59898b65f2383e5d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:24.378283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:24.379506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5293ccf9-1974-484c-9324-c5091cda3b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:24.382840 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1984/3993] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:23 2022] DELETE /identity/v3/projects/ecd6170549f94a59898b65f2383e5d1e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:24.391533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723d75-6510-47c5-a320-876db05587ac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:24.392666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723d75-6510-47c5-a320-876db05587ac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:24.395610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02723d75-6510-47c5-a320-876db05587ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:24.454885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-02723d75-6510-47c5-a320-876db05587ac None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:24.458325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02723d75-6510-47c5-a320-876db05587ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:24.583218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2010/3994] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:24.592615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:24.593466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:24.593986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:24.933079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:24.936031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:24.958135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1985/3995] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:24.962490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02723d75-6510-47c5-a320-876db05587ac None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:24.978745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02723d75-6510-47c5-a320-876db05587ac None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:24.992980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.003786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.004349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.005245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.007495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:25.008040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:25.017299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e630e-693a-4db7-b2fc-51d67017c3c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:25.063464 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2011/3996] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:25.067651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:25.083943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05c36-5dbf-4ece-99bd-747b669cf354 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:25.097048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.097701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.097973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.098241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.099022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:25.101429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:25.140135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.140715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.141115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.179469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] MFA Rules not processed for user `bb85bd8db516469abb729c1fdc0a1ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:25.183293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:25.188796 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1986/3997] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:25 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:25.192793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:25.314826 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:25.333392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb059-4674-4729-8684-16e896cbeabd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:25.355922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.359125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.360654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.361101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.362174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:25.371929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:25.382165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2012/3998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:25.445205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1987/3999] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:25 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:14:25.449196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:25.471713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c83c-3fce-4cdd-8a46-1f3a2dcfbfc1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:25.489613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.500968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.501715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.502145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.502976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:25.504806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:25.539608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:25.540709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2013/4000] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:25.557806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b946-ac55-421b-a5ce-95e02717f6c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:25.570521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.571412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.571852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.572321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.573135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:25.575151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f072272-4c03-428a-9930-a50529ef5782 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:25.610129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1988/4001] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:25.614501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:25.635513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cca17-92e3-4465-a715-0e23af2dd893 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:25.653480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:25.654430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:25.654866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:25.655286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] PATH_INFO: `/v3/projects/68f6dd104c6c4f5b856d5ea62a769c14/users/09320560cb2d48228041e62efe9fa018/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:25.996844 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:26.004571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f6dd104c6c4f5b856d5ea62a769c14, user_id=09320560cb2d48228041e62efe9fa018, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:26.009456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:26.041372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2014/4002] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:25 2022] PUT /identity/v3/projects/68f6dd104c6c4f5b856d5ea62a769c14/users/09320560cb2d48228041e62efe9fa018/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:26.045810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:26.046409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:26.046559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:26.097907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:26.099208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:26.250246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1989/4003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:26.300992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:26.303455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:26.457148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528d4b-e398-4be7-9b0d-076ae1a16508 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:26.471151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:26.471875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:26.472143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:26.472586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:26.490320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:26.492081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:26.503322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2015/4004] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:28.804398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:28.805907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:28.846743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc3b5c-dc42-421e-a0d4-6d339a66dcdf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:28.868199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:28.871649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:28.872307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:28.872999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] PATH_INFO: `/v3/users/4c25e53535f348718d8bf85e020ec15d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:28.875138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c25e53535f348718d8bf85e020ec15d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:28.881316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:29.009922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c25e53535f348718d8bf85e020ec15d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:29.011130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c25e53535f348718d8bf85e020ec15d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:29.044964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c25e53535f348718d8bf85e020ec15d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:29.094130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c25e53535f348718d8bf85e020ec15d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:29.096702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6b00d454-94ce-42d6-8548-92ff41b65965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c25e53535f348718d8bf85e020ec15d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:29.139878 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1990/4005] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:28 2022] DELETE /identity/v3/users/4c25e53535f348718d8bf85e020ec15d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:30.959338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:30.975931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840c20d-e32d-4a49-85f8-fc74466445ed service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:31.096006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:31.096523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:31.097359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:31.097934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] PATH_INFO: `/v3/projects/51f36d0acd3e457cbb8fc3d10b486ad1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:31.099971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f36d0acd3e457cbb8fc3d10b486ad1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:31.103234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:31.254810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f36d0acd3e457cbb8fc3d10b486ad1', 'request_id': 'req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:31.270092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f36d0acd3e457cbb8fc3d10b486ad1', 'request_id': 'req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:31.287839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f36d0acd3e457cbb8fc3d10b486ad1', 'request_id': 'req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:31.328074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] The token cache is being invalidate because project 51f36d0acd3e457cbb8fc3d10b486ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:31.329388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:31.330873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb00e71-0818-42ee-9a8a-a6d766c71ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:31.336536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2016/4006] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:30 2022] DELETE /identity/v3/projects/51f36d0acd3e457cbb8fc3d10b486ad1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:31.338129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:31.338999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:31.339494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:31.377974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:31.381702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:31.518634 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:31.564889 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1991/4007] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:31.572698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:31.572698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:31.572698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:31.633710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:31.634853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:31.673235 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2017/4008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:31.674529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:31.692144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbc942-7cb1-428e-92a3-448f20e01151 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:31.708840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:31.709815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:31.710296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:31.710725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:31.711632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:31.712127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:31.713940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:31.751886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1992/4009] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:31.756197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:31.775895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6099-24a9-4970-80b2-37257b2da551 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:31.794852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:31.795807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:31.797611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:31.799328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:31.800154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:31.808382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:31.853836 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:31.882214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2018/4010] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:31 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:31.886059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:31.905986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c708-52bd-4b50-9447-bd2615dd8cc5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:32.069774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:32.074249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.074998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.074998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:32.076182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:32.084245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:32.133820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1993/4011] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:31 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:32.139734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:32.174942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a675d-4c6c-4629-a0ea-d51ee0c93b1b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:32.199344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:32.200282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.200642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.200990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:32.206324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:32.208086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:32.260057 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2019/4012] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:14:32.266206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:32.286721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2416-8e41-4f7f-82a6-23676d4d30a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:32.299594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:32.300250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.300534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.300813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:32.301518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:32.309014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984251eb-88b1-4388-861b-a3af8b3ea0e2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:32.337919 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1994/4013] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:32.343878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:32.366582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fccb74-7af4-4ac4-aefe-b23d40f1b508 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:32.440970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:32.443176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.447125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.447125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] PATH_INFO: `/v3/projects/714fdb4cc705469688b389dab75ce03e/users/8c4d799cd1354609a8604a2db0fc12f1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:32.491418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714fdb4cc705469688b389dab75ce03e, user_id=8c4d799cd1354609a8604a2db0fc12f1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:32.496384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:32.543591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2020/4014] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:32 2022] PUT /identity/v3/projects/714fdb4cc705469688b389dab75ce03e/users/8c4d799cd1354609a8604a2db0fc12f1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:32.549037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.549592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.549592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:32.598660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:32.599922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:32.745492 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1995/4015] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:32.805708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:32.807698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:32.962088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4fdd-66ec-4cd9-80af-4d8f1c6b7dc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:32.974902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:32.976944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:32.977744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:32.978979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:33.002935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:33.004846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7361ca-b7b5-4630-8d2c-67b13e93945b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:33.021607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2021/4016] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:33.856397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:33.867820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:33.907098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282eefe-bf23-4670-90ba-3116e2923aef None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:33.928310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:33.928974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:33.929256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:33.929556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] PATH_INFO: `/v3/users/2c993fd92d3441b9a754afdc4341442c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:33.933966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c993fd92d3441b9a754afdc4341442c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:33.943402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:34.056828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c993fd92d3441b9a754afdc4341442c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:34.057921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c993fd92d3441b9a754afdc4341442c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:34.066513 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:34.074274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c993fd92d3441b9a754afdc4341442c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:34.094357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c993fd92d3441b9a754afdc4341442c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:34.095305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c993fd92d3441b9a754afdc4341442c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:34.121367 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1996/4017] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:33 2022] DELETE /identity/v3/users/2c993fd92d3441b9a754afdc4341442c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:34.123162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:34.123772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:34.124087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:34.151139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:34.152732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:34.342797 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2022/4018] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:34.413550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:34.415037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:34.561163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e67da-53d8-45b2-b15e-3dda9e9bd637 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:34.582115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:34.582751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:34.583028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:34.583310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:34.626505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:34.628186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cfe0a-a697-41b8-9abe-8fe6161bc574 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:34.666735 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1997/4019] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:36.146797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:36.148387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:36.174105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b04c-92f5-49ba-98d8-528b53e23de8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:36.181618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:36.182700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.193204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.193776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] PATH_INFO: `/v3/projects/c2ff12df0f98431fb179990ca297b5c0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.196772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ff12df0f98431fb179990ca297b5c0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:36.205204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:36.338334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ff12df0f98431fb179990ca297b5c0', 'request_id': 'req-d36d2003-e416-4692-bd6d-e27f71556e28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:36.361731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ff12df0f98431fb179990ca297b5c0', 'request_id': 'req-d36d2003-e416-4692-bd6d-e27f71556e28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:36.379668 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:36.390494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ff12df0f98431fb179990ca297b5c0', 'request_id': 'req-d36d2003-e416-4692-bd6d-e27f71556e28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:36.421184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] The token cache is being invalidate because project c2ff12df0f98431fb179990ca297b5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:36.421841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:36.423100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d36d2003-e416-4692-bd6d-e27f71556e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:36.425432 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2023/4020] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:36 2022] DELETE /identity/v3/projects/c2ff12df0f98431fb179990ca297b5c0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:36.430283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.430797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.431046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.463106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:36.465173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:36.656711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1998/4021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:36.666679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.667221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.667647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.705204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:36.711612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:36.729250 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2024/4022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:36.730296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:36.741740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feba111-8ee6-4153-b305-7ea6d03ffc3f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:36.752859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:36.753542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.753820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.754238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.754888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:36.755363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:36.757158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:36.781296 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 1999/4023] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:36.785789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:36.800224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134484-ed77-481e-b14c-4d5658dfad5e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:36.807650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:36.808105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.809052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.809337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.810592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:36.812795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:36.856993 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2025/4024] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:36 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:36.860821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:36.872840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f5cf-a324-466e-8804-b6c13b98e416 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:36.945997 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:36.955510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:36.957495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:36.958399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:36.960219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:36.960742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:36.976970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:37.043233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2000/4025] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:36 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:37.048044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:37.064152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886328-2e10-45f0-bc2e-e11cd7c738fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:37.070177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:37.070958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:37.071486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:37.073281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:37.074355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:37.077385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:37.095899 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2026/4026] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:14:37.100104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:37.112643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3ce1d-dd16-4f69-b6de-1c71fdebdacf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:37.119120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:37.119762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:37.120040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:37.120318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:37.121026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:37.123454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8aa0-94c8-4d5b-ba39-4a9f89252aba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:37.141488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:37.148368 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2001/4027] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:37.154481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754c4a-0ee9-4616-a897-c974484fc6af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:37.170977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:37.171705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:37.171989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:37.172265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] PATH_INFO: `/v3/projects/f71527cf54534e5780071b6d7b9fb841/users/1868f63bfca24744812566901f5ddb61/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:37.195721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71527cf54534e5780071b6d7b9fb841, user_id=1868f63bfca24744812566901f5ddb61, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:37.198992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:37.226894 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2027/4028] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:37 2022] PUT /identity/v3/projects/f71527cf54534e5780071b6d7b9fb841/users/1868f63bfca24744812566901f5ddb61/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:37.236224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fc40-ef9d-4912-8bd9-e2115f254815 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:37.236513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fc40-ef9d-4912-8bd9-e2115f254815 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:37.236789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fc40-ef9d-4912-8bd9-e2115f254815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:37.293217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a7b2fc40-ef9d-4912-8bd9-e2115f254815 None None] MFA Rules not processed for user `1868f63bfca24744812566901f5ddb61`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:37.294829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7b2fc40-ef9d-4912-8bd9-e2115f254815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:37.403714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2002/4029] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:37.464754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:37.468278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:37.640241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec682d4-6cbb-4325-927e-ed4cf6add9ef admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:37.646631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:37.647030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:37.647415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:37.647791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:37.687326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:37.689227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f14ce-8e61-4275-b948-580c7f0d5261 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:37.705077 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2028/4030] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:14:38.123177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03791-b791-4b19-823c-ca693925c645 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:38.123177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03791-b791-4b19-823c-ca693925c645 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:38.123776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03791-b791-4b19-823c-ca693925c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:38.181857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-62b03791-b791-4b19-823c-ca693925c645 None None] MFA Rules not processed for user `95b7650e677d47ab9576bc3cb6ea07e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:38.183096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-62b03791-b791-4b19-823c-ca693925c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:38.397733 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2003/4031] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:38.397987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:38.397987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:38.397987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:38.434732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] MFA Rules not processed for user `95b7650e677d47ab9576bc3cb6ea07e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:38.436195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:38.470944 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2029/4032] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:38.483207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b03791-b791-4b19-823c-ca693925c645 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:38.485261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-62b03791-b791-4b19-823c-ca693925c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:38.782667 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:38.892220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b03791-b791-4b19-823c-ca693925c645 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:38.927221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:38.927878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:38.928133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:38.928875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:38.950957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:38.952706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583bb12-eb34-42be-8dfb-da14fdfc79db service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:39.021834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2004/4033] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:41.730478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:41.733526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:41.876870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1eff-226f-4563-b4d7-c6076bf5f5a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:41.885509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:41.886477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:41.888244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:41.888773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:41.891835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:41.912807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:41.915514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b124a1-e1a8-40d1-84f3-c8475ec60711 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:41.932877 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2030/4034] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:47.212003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:47.212517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:47.212631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:47.282337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] MFA Rules not processed for user `09320560cb2d48228041e62efe9fa018`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:47.283570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:47.562474 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2005/4035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:47.564129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:47.564647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:47.564647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:47.613017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] MFA Rules not processed for user `09320560cb2d48228041e62efe9fa018`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:47.614336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:47.634374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2031/4036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:48.176690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:48.178260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:48.217993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b2a28-25da-4469-b9ae-c2bef2921f41 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:48.228580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:48.229265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:48.229568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:48.229841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:48.252150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:48.253986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:48.300273 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2006/4037] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:49.621458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:49.625701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:49.661028 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:49.685196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960292b-e38d-43fc-831e-9f792bcd7ef8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:49.699044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:49.702548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:49.703075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:49.704912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:49.711894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:49.749270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:49.753941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e39d26-89a0-4df2-a627-caf2278cc854 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:49.796636 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2032/4038] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:53.237685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:53.238960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:53.413118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d80-890f-455e-a326-8778085544b1 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:53.430946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:53.432725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:53.433009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:53.434125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] PATH_INFO: `/v3/users/b984b9717fe94a6fb6c62a78af17f7aa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:53.439367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b984b9717fe94a6fb6c62a78af17f7aa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:53.445030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:53.556431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b984b9717fe94a6fb6c62a78af17f7aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:53.557221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b984b9717fe94a6fb6c62a78af17f7aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:53.568724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b984b9717fe94a6fb6c62a78af17f7aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:53.573312 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:53.592889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b984b9717fe94a6fb6c62a78af17f7aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:53.594074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6c076-f15e-43ce-9a6a-a2f8a9ab45be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b984b9717fe94a6fb6c62a78af17f7aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:53.622778 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2007/4039] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:53 2022] DELETE /identity/v3/users/b984b9717fe94a6fb6c62a78af17f7aa => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:54.590587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:54.591179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:54.591584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:54.648625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:54.649900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:54.818532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2033/4040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:54.820627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:54.821148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:54.821597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:54.878967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:54.882056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:54.912890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2008/4041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:55.458803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:55.464737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:55.467117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:55.467735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:55.628465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d74f6-1b7a-4cc3-a9c0-c6b8427bf55b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:55.633581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:55.635338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:55.635796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:55.636338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] PATH_INFO: `/v3/projects/fd4027e26a844b0dbd34ac452b22b3ae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:55.638679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4027e26a844b0dbd34ac452b22b3ae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:55.638830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b055-5be8-4252-aaf8-24cfdc589e7e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:55.641539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:55.669367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:55.671655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:55.672180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:55.675634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:55.692411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:55.697060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:55.723335 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2009/4042] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:14:55.728067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4027e26a844b0dbd34ac452b22b3ae', 'request_id': 'req-bb478697-990e-406e-901f-02e755b9170e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:55.738945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4027e26a844b0dbd34ac452b22b3ae', 'request_id': 'req-bb478697-990e-406e-901f-02e755b9170e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:55.750007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4027e26a844b0dbd34ac452b22b3ae', 'request_id': 'req-bb478697-990e-406e-901f-02e755b9170e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:55.768846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] The token cache is being invalidate because project fd4027e26a844b0dbd34ac452b22b3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:55.769436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:55.770320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:55.777480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2034/4043] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:55 2022] DELETE /identity/v3/projects/fd4027e26a844b0dbd34ac452b22b3ae => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:55.779270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:55.799859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554559e-4caa-4b4f-a5b0-a7c309185aae service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:55.877194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:55.878395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:55.879625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:55.880062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] PATH_INFO: `/v3/users/f85a366f989648c7a62880578c0ea947` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:55.881812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85a366f989648c7a62880578c0ea947)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:55.884524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:56.014033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85a366f989648c7a62880578c0ea947'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.016319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85a366f989648c7a62880578c0ea947'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.035453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85a366f989648c7a62880578c0ea947'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.040197 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:56.078930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85a366f989648c7a62880578c0ea947'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.084089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d2fe4af-11f3-4614-b753-c4261882dcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85a366f989648c7a62880578c0ea947'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.116602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2010/4044] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:55 2022] DELETE /identity/v3/users/f85a366f989648c7a62880578c0ea947 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:56.674829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:56.676401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:56.700403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb478697-990e-406e-901f-02e755b9170e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:56.724748 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:56.869835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:56.870631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:56.871023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:56.871491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] PATH_INFO: `/v3/projects/153e3aa4f1ab42319781e527a271bd6a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:56.872891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=153e3aa4f1ab42319781e527a271bd6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:56.875389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:56.950855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153e3aa4f1ab42319781e527a271bd6a', 'request_id': 'req-5f29c70f-2790-4064-8265-ed97a82ba92e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.959975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153e3aa4f1ab42319781e527a271bd6a', 'request_id': 'req-5f29c70f-2790-4064-8265-ed97a82ba92e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.970817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153e3aa4f1ab42319781e527a271bd6a', 'request_id': 'req-5f29c70f-2790-4064-8265-ed97a82ba92e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.989677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] The token cache is being invalidate because project 153e3aa4f1ab42319781e527a271bd6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:14:56.989677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.990338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f29c70f-2790-4064-8265-ed97a82ba92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:56.992460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2035/4045] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:14:56 2022] DELETE /identity/v3/projects/153e3aa4f1ab42319781e527a271bd6a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:56.997329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:56.998210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:56.998486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.020976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:57.022576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:57.150879 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2011/4046] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:57.159626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.159917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.160196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.215213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:57.216988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:57.229064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2036/4047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:57.233644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.249107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eca5d2-d5b0-4f7b-98da-406ce84e5f01 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.258096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.258815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.259160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.259499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.260220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:14:57.260586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.266326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.289773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2012/4048] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:14:57.291061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.309057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e76ca-4a66-4cee-a166-12cc063f14cc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.315845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.316465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.316748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.317074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.317847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.326887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.380905 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2037/4049] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:14:57 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:57.384724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.405159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e854776-6b30-432b-ba0e-cbb64929c934 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.499129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.499767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.500050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.500323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.500965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.516018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.571205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2013/4050] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:14:57 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:14:57.575887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.608710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd6b6b-a1eb-41f0-b435-a8ff178e89ac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.615518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.618470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.619288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.619778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.620662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.624318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.640974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2038/4051] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:57.645194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.662014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7e20-9ee0-4a42-975a-7ebf53fb36e5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.668657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.669895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.670428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.671028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.672263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.674372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae89d60-297a-44c4-ab11-df061d258062 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.692348 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2014/4052] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:14:57.696799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:57.719814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c7f0d-c48b-468f-86fd-f33dc1219692 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:57.725750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:57.726958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.727716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.728580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] PATH_INFO: `/v3/projects/c731b4d4378542d684dd06a777cf6355/users/5baf89182898492483843fc94f567a7e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.749615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c731b4d4378542d684dd06a777cf6355, user_id=5baf89182898492483843fc94f567a7e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:57.752932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:57.772766 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2039/4053] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:14:57 2022] PUT /identity/v3/projects/c731b4d4378542d684dd06a777cf6355/users/5baf89182898492483843fc94f567a7e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:14:57.789586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc226d2-5534-44b3-9e32-d240998ba720 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:57.790390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc226d2-5534-44b3-9e32-d240998ba720 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:57.790821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc226d2-5534-44b3-9e32-d240998ba720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:57.976504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8dc226d2-5534-44b3-9e32-d240998ba720 None None] MFA Rules not processed for user `5baf89182898492483843fc94f567a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:57.983685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8dc226d2-5534-44b3-9e32-d240998ba720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:58.107807 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:58.269009 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2015/4054] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:14:59.497519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:59.590987 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:59.632913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af59e-2347-4b34-bfcb-baf7950ef1d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:14:59.640922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:14:59.641721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:59.642112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:59.642631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] PATH_INFO: `/v3/users/5baf89182898492483843fc94f567a7e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:59.644429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baf89182898492483843fc94f567a7e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:14:59.647388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:14:59.727820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baf89182898492483843fc94f567a7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:59.753510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baf89182898492483843fc94f567a7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:59.776659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baf89182898492483843fc94f567a7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:59.779289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baf89182898492483843fc94f567a7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:59.780990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baf89182898492483843fc94f567a7e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:14:59.802441 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2040/4055] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:14:59 2022] DELETE /identity/v3/users/5baf89182898492483843fc94f567a7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:14:59.807397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:14:59.808305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:14:59.808669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:14:59.839346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:14:59.841681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:14:59.934004 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2016/4056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:14:59.960308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:14:59.961798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:00.041457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bdb1-fe4f-496e-9627-f71db254dd48 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:00.045966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:00.046593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:00.046879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:00.047327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:00.057031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:00.058667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6580415-dad0-4e8e-b5f9-ddbe349e42ca service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:00.080170 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2041/4057] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:00.740012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:00.742092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:00.765434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a9b2-3a2d-4296-b108-5c743dca9cc4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:00.778707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:00.779406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:00.779690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:00.781227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] PATH_INFO: `/v3/projects/c731b4d4378542d684dd06a777cf6355` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:00.784066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c731b4d4378542d684dd06a777cf6355)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:00.785792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:00.901702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c731b4d4378542d684dd06a777cf6355', 'request_id': 'req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:00.914281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c731b4d4378542d684dd06a777cf6355', 'request_id': 'req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:00.941510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c731b4d4378542d684dd06a777cf6355', 'request_id': 'req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:00.961153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] The token cache is being invalidate because project c731b4d4378542d684dd06a777cf6355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:00.961492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:00.962198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d96b7eb5-3689-403d-baf2-f5e48e0c73ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:00.968483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2017/4058] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:00 2022] DELETE /identity/v3/projects/c731b4d4378542d684dd06a777cf6355 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:00.969941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:00.970724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:00.971140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.031807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:01.036501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:01.150101 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:01.177356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a047-efcb-4732-9748-554899459138 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.178208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a047-efcb-4732-9748-554899459138 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.178778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a047-efcb-4732-9748-554899459138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.184645 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2042/4059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:01.210425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a2e2a047-efcb-4732-9748-554899459138 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:01.211915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2e2a047-efcb-4732-9748-554899459138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:01.224747 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2018/4060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:01.229296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.251815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc6881-f374-4f06-a3a6-806b88f9db5a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.267801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.271692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.273554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.275150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.276199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:01.279740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.285155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.320210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2043/4061] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:01.321497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2a047-efcb-4732-9748-554899459138 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.341531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2a047-efcb-4732-9748-554899459138 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.354596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.355704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.355704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.356021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.357786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.359758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.414434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2019/4062] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:01 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:01.419613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.453181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d789ad-4b69-42fe-a100-feda456b13d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.592109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.592857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.593247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.593916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.594696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.597804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.635044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2044/4063] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:01 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:01.635505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.652346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c045-4ae6-4492-95c7-b9120fd1aebe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.687711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.688507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.688895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.690971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.692198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.696564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.717279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.718768 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2020/4064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:01.729032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510f79-84d8-4d02-9be4-40a2d570e8e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.736077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.737322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.738399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.738905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.739803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.741766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86029ff-0eca-4a1a-bb35-eae04b06ce22 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.759062 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2045/4065] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:01.763072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:01.776555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aab488-2cfa-48ef-aa70-2964caffa726 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:01.782757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:01.784118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.785376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.785985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] PATH_INFO: `/v3/projects/0f3bbbfc09c341518cab791c59e82f68/users/724033f958e24511b67b0ebed31d1ba0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.816256 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:01.825728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3bbbfc09c341518cab791c59e82f68, user_id=724033f958e24511b67b0ebed31d1ba0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:01.831889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:01.859112 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2021/4066] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:01 2022] PUT /identity/v3/projects/0f3bbbfc09c341518cab791c59e82f68/users/724033f958e24511b67b0ebed31d1ba0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:01.870076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:01.870370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:01.870642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:01.905837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] MFA Rules not processed for user `724033f958e24511b67b0ebed31d1ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:01.907158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:02.023947 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2046/4067] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:03.543657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:03.545709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:03.736588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316643-52ee-4960-94d6-6f056a20f57b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:03.758423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:03.759654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:03.760015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:03.760304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:03.783796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:03.794878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c4d24-41ab-4eb4-88ed-a214db5af0ab service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:03.830690 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2022/4068] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:04.617274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:04.757323 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:04.775509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe8729-d18a-40d1-b9e0-0e50739bd90f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:04.783481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:04.784411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:04.784994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:04.785540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] PATH_INFO: `/v3/users/724033f958e24511b67b0ebed31d1ba0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:04.787416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724033f958e24511b67b0ebed31d1ba0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:04.790253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:04.854529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724033f958e24511b67b0ebed31d1ba0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:04.865648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724033f958e24511b67b0ebed31d1ba0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:04.882934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724033f958e24511b67b0ebed31d1ba0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:04.884190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724033f958e24511b67b0ebed31d1ba0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:04.885848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724033f958e24511b67b0ebed31d1ba0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:04.907924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2047/4069] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:04 2022] DELETE /identity/v3/users/724033f958e24511b67b0ebed31d1ba0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:04.908883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:04.910082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:04.910361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:04.946613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:04.948146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:05.110460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2023/4070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:05.170278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:05.173648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:05.304055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550a691-2899-46cd-8769-ccf1156ef949 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:05.308197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:05.309416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:05.309891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:05.310433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:05.321716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:05.323200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902211d1-88cc-4a3d-ab44-ed0d1c165085 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:05.346621 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2048/4071] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:06.718971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:06.720908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:06.737066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13423799-dea8-42d1-86b8-31ae8c114a51 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:06.742307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:06.743056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:06.743442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:06.743960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] PATH_INFO: `/v3/projects/0f3bbbfc09c341518cab791c59e82f68` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:06.745199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3bbbfc09c341518cab791c59e82f68)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:06.749017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:06.850405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3bbbfc09c341518cab791c59e82f68', 'request_id': 'req-28c2141b-c712-484b-bb94-8d72ad35c14a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:06.869420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3bbbfc09c341518cab791c59e82f68', 'request_id': 'req-28c2141b-c712-484b-bb94-8d72ad35c14a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:06.881483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3bbbfc09c341518cab791c59e82f68', 'request_id': 'req-28c2141b-c712-484b-bb94-8d72ad35c14a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:06.895370 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:06.905740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] The token cache is being invalidate because project 0f3bbbfc09c341518cab791c59e82f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:06.906487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:06.908198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-28c2141b-c712-484b-bb94-8d72ad35c14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:06.913245 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2024/4072] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:06 2022] DELETE /identity/v3/projects/0f3bbbfc09c341518cab791c59e82f68 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:06.916626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:06.917284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:06.917485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:06.982677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:06.984070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:07.073902 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2049/4073] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:07.074646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.075356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.075636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.114432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:07.116082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:07.138628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.151558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2025/4074] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:07.155487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c620d-ec21-4e01-ab55-402eba4a779a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.164454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.165203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.165673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.166252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.167015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:07.167859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.170930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.196697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.206062 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2050/4075] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:07.212030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7f29-9db1-4f95-8302-0a9bf4d153d5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.217832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.218564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.218941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.219636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.220579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.222817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.268143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2026/4076] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:07 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:07.272379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.278967 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:07.285059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9e56-b409-4166-8160-8b265ab9e114 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.351883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.352778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.354223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.354578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.355600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.357682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.407829 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2051/4077] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:07 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:07.410018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.430240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c80668-e8eb-4598-868a-de8e61cf3b4c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.437954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.439481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.439977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.440560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.441456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.443305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.458405 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2027/4078] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:07.463978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.489213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49090ba4-214b-4bc2-8966-8624d073edb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.514945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.516425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.516989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.517638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.518975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.522084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90947efe-0d93-47be-a05f-2ff8838140b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.552698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2052/4079] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:07.557397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.575461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172264cd-fc2c-41c0-92fd-6301b2b0b076 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.591592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.592467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.592771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.593052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] PATH_INFO: `/v3/projects/301ca3fd945d4caa8d08f31e417d939a/users/fdc97745ff004daca738ef986ea8d9cf/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.634510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=301ca3fd945d4caa8d08f31e417d939a, user_id=fdc97745ff004daca738ef986ea8d9cf, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:07.642491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:07.677831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2028/4080] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:07 2022] PUT /identity/v3/projects/301ca3fd945d4caa8d08f31e417d939a/users/fdc97745ff004daca738ef986ea8d9cf/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:07.685200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.685513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.685781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:07.733063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:07.734365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:07.831735 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2053/4081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:07.860083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:07.861818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:07.992767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af232f3-7265-42da-87ca-cc87af46a0cc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:07.998412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:07.999201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:07.999562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:07.999960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:08.016961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:08.019388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229754e0-ec53-445f-919d-4e4f74ce92d0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:08.039892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2029/4082] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:08.598455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:08.600412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:08.616386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4c2ef-b84e-46f9-8635-b8eb50ac82c9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:08.633885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:08.641665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:08.642027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:08.642632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] PATH_INFO: `/v3/users/1868f63bfca24744812566901f5ddb61` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:08.646644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1868f63bfca24744812566901f5ddb61)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:08.653556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:08.764732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1868f63bfca24744812566901f5ddb61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:08.792167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1868f63bfca24744812566901f5ddb61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:08.812672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1868f63bfca24744812566901f5ddb61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:08.813429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1868f63bfca24744812566901f5ddb61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:08.814207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1868f63bfca24744812566901f5ddb61'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:08.822852 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:08.849181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2054/4083] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:08 2022] DELETE /identity/v3/users/1868f63bfca24744812566901f5ddb61 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:08.853435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a871-390d-4fea-9e37-9f5c7c665987 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:08.853736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a871-390d-4fea-9e37-9f5c7c665987 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:08.854017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a871-390d-4fea-9e37-9f5c7c665987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:08.892973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d400a871-390d-4fea-9e37-9f5c7c665987 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:08.895913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d400a871-390d-4fea-9e37-9f5c7c665987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.038519 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2030/4084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:09.069643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:09.071122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.190728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428a45a-2ba4-483c-9eb5-eff8200053ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:09.198076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:09.200506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:09.201101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:09.201628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:09.212698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:09.214680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d2b1-f523-498a-9c6c-aba4245d4df2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:09.231718 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2055/4085] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:09.416262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:09.417619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:09.418737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:09.485982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] MFA Rules not processed for user `fdc97745ff004daca738ef986ea8d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:09.487301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.517187 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:09.564080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2031/4086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:09.573919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbf10-ad7d-4684-a850-ac694d07d5ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:09.575027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbf10-ad7d-4684-a850-ac694d07d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:09.575440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbf10-ad7d-4684-a850-ac694d07d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:09.629891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8c8dbf10-ad7d-4684-a850-ac694d07d5ec None None] MFA Rules not processed for user `fdc97745ff004daca738ef986ea8d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:09.631320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c8dbf10-ad7d-4684-a850-ac694d07d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.640134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2056/4087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:09.778283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:09.779190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:09.779666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:09.779809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.779966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:09.805930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] MFA Rules not processed for user `95b7650e677d47ab9576bc3cb6ea07e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:09.807323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:09.892894 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2057/4088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:09.903347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e15057-1934-4af7-9ed6-0a6545bb3075 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:09.910410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:09.911029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:09.911307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:09.911567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:09.922942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:09.925418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c78ce-1a1f-4967-8130-1e47c103ef3f service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:09.940902 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2032/4089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:10.373479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:10.375709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:10.396653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804ac49-e447-492b-9053-5381d5cc933d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:10.401737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:10.402943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.403383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.403658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] PATH_INFO: `/v3/projects/f71527cf54534e5780071b6d7b9fb841` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.404804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71527cf54534e5780071b6d7b9fb841)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:10.406765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:10.483054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71527cf54534e5780071b6d7b9fb841', 'request_id': 'req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:10.494279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71527cf54534e5780071b6d7b9fb841', 'request_id': 'req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:10.504270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71527cf54534e5780071b6d7b9fb841', 'request_id': 'req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:10.521779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] The token cache is being invalidate because project f71527cf54534e5780071b6d7b9fb841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:10.522449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:10.523292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27a84a7c-942d-4f6d-bb0c-c79cc0600b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:10.525388 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2058/4090] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:10 2022] DELETE /identity/v3/projects/f71527cf54534e5780071b6d7b9fb841 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:10.531298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.531787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.532252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.580469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:10.581736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:10.661447 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2033/4091] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:10.666221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.666754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.666754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.693715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:10.695209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:10.704500 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2059/4092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:10.708514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:10.719693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821cd19-3885-47fa-87c2-a6c8996608f9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:10.726067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:10.726737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.726863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.727370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.728151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:10.728996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:10.730438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:10.745453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2034/4093] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:10.751587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:10.763509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b33066-769d-433a-9342-37e5e653cbc2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:10.768339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:10.770128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.771408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.771408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.771902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:10.773869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:10.786325 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:10.812546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2060/4094] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:10 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:10.816688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:10.833440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f6f-6bf5-42b5-bd65-d36ef9f4e4bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:10.899801 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:10.922121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:10.922847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.923001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.923266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.924031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:10.925989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:10.952411 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2035/4095] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:10 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:10.953900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:10.964399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d078-eff6-4512-907e-aa48aacc008a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:10.969923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:10.970471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:10.970747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:10.971044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:10.971686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:10.973329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:10.984157 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2061/4096] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:10.988166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:11.010694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573abda-f4c5-40f8-9646-9c6a8edde93f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:11.017391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:11.018028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:11.018803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:11.019258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:11.019983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:11.021548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29b62-d93a-4faf-b8fd-3f697b255701 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:11.037607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2036/4097] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:11.041898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:11.052508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4598-eb9f-42d6-b3c7-ee28f1fa16fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:11.059496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:11.060443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:11.060919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:11.061457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] PATH_INFO: `/v3/projects/05f7754e4ccb4b4da87d15a8b9b78887/users/e21a877f17db40c0a226b54049f73ed0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:11.078818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f7754e4ccb4b4da87d15a8b9b78887, user_id=e21a877f17db40c0a226b54049f73ed0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:11.082324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:11.105729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2062/4098] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:11 2022] PUT /identity/v3/projects/05f7754e4ccb4b4da87d15a8b9b78887/users/e21a877f17db40c0a226b54049f73ed0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:11.111084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:11.112158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:11.114087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:11.152054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] MFA Rules not processed for user `e21a877f17db40c0a226b54049f73ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:11.153916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:11.240286 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2037/4099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:11.253182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:11.254999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:11.322431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef1ad-8e37-47bf-b229-bfe281a2abc3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:11.327309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:11.328002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:11.328364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:11.328687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:11.338594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:11.340403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:11.351342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2063/4100] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:12.306875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:12.309927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:12.470852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1df8b-5155-45cd-94d7-1731f38e97de None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:12.476909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:12.477594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:12.477877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:12.478151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] PATH_INFO: `/v3/users/fdc97745ff004daca738ef986ea8d9cf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:12.479302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc97745ff004daca738ef986ea8d9cf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:12.482167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:12.556885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc97745ff004daca738ef986ea8d9cf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:12.558482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc97745ff004daca738ef986ea8d9cf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:12.562715 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:12.572239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc97745ff004daca738ef986ea8d9cf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:12.596816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc97745ff004daca738ef986ea8d9cf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:12.597639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0660355b-9086-40e6-8670-df288cfb5da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc97745ff004daca738ef986ea8d9cf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:12.617086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2038/4101] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:12 2022] DELETE /identity/v3/users/fdc97745ff004daca738ef986ea8d9cf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:13.093623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:13.113300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025276d-bc63-42bf-a6b6-23b93e0fbbcd service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:13.228499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:13.229611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:13.230041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:13.230994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] PATH_INFO: `/v3/projects/301ca3fd945d4caa8d08f31e417d939a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:13.242516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=301ca3fd945d4caa8d08f31e417d939a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:13.246786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:13.365736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301ca3fd945d4caa8d08f31e417d939a', 'request_id': 'req-1862c02f-93e0-4392-b951-5a6ff584f8be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:13.380123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301ca3fd945d4caa8d08f31e417d939a', 'request_id': 'req-1862c02f-93e0-4392-b951-5a6ff584f8be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:13.393049 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:13.398127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301ca3fd945d4caa8d08f31e417d939a', 'request_id': 'req-1862c02f-93e0-4392-b951-5a6ff584f8be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:13.443183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] The token cache is being invalidate because project 301ca3fd945d4caa8d08f31e417d939a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:13.443481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:13.444948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1862c02f-93e0-4392-b951-5a6ff584f8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:13.449637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2064/4102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:13 2022] DELETE /identity/v3/projects/301ca3fd945d4caa8d08f31e417d939a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:13.455232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:13.455754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:13.455754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:13.492874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:13.496598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:13.658407 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2039/4103] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:13.660297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:13.660583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:13.660861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:13.692030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:13.699684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:13.732168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2065/4104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:13.738122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:13.758811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234a9da-5f5f-4b0a-859f-202143e113aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:13.778094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:13.779079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:13.780331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:13.781797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:13.784251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:13.785686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:13.797858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:13.839433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2040/4105] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:13.847055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:13.874354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b13d10-9412-46b5-b7f3-603cd2aed681 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:13.904049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:13.912835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:13.912953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:13.913481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:13.914143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:13.926537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:13.989506 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2066/4106] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:13 2022] POST /identity/v3/projects => generated 359 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:13.997429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:14.005347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ec03-dac5-4f12-a710-6f2d546f0043 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:14.122936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:14.123433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.123787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.124158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:14.129785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:14.142533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:14.205650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:14.206759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2041/4107] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:13 2022] POST /identity/v3/users => generated 280 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:14.220734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ad5d-2c46-4f91-bfc3-8846987f09fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:14.242794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:14.243695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.244170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.244599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:14.245428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:14.269327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:14.304729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2067/4108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:14.308071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:14.327536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af48a-99e0-4e43-bbab-c1d842d7cc96 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:14.338934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:14.339577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.339577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.340229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:14.340997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:14.348854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc65684-3611-4926-811b-853543d995ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:14.393713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2042/4109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:14.420826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:14.441786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7fa6-b2f1-4e0e-8670-e12714586b74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:14.457181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:14.457980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.458172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.458499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] PATH_INFO: `/v3/projects/f00c1696167d428aa9cf3a9feaed642c/users/59831c953ef0480196c7a14b028a38ec/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:14.496929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00c1696167d428aa9cf3a9feaed642c, user_id=59831c953ef0480196c7a14b028a38ec, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:14.506506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:14.548798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2068/4110] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:14 2022] PUT /identity/v3/projects/f00c1696167d428aa9cf3a9feaed642c/users/59831c953ef0480196c7a14b028a38ec/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:14.565147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a30b26-eeae-4b69-b97a-c71cc7a265d6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.565721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a30b26-eeae-4b69-b97a-c71cc7a265d6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.565721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a30b26-eeae-4b69-b97a-c71cc7a265d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:14.638529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d3a30b26-eeae-4b69-b97a-c71cc7a265d6 None None] MFA Rules not processed for user `59831c953ef0480196c7a14b028a38ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:14.642119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d3a30b26-eeae-4b69-b97a-c71cc7a265d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:14.687438 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:14.828335 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2043/4111] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:14.876085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:14.990941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa57ac9-0714-4800-8808-cf923d146347 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:14.996754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:14.998100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:14.998935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:14.998935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] PATH_INFO: `/v3/users/59831c953ef0480196c7a14b028a38ec` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:15.000073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59831c953ef0480196c7a14b028a38ec)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:15.002289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:15.097914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59831c953ef0480196c7a14b028a38ec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:15.109895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59831c953ef0480196c7a14b028a38ec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:15.141664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59831c953ef0480196c7a14b028a38ec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:15.143025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59831c953ef0480196c7a14b028a38ec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:15.145865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-38771729-10de-4eae-a35f-f188c40f1431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59831c953ef0480196c7a14b028a38ec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:15.178421 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2069/4112] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:14 2022] DELETE /identity/v3/users/59831c953ef0480196c7a14b028a38ec => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:15:15.185090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:15.185390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:15.185806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:15.222439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:15.223684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:15.328485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:15.328974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:15.329074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:15.344067 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:15.374346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] MFA Rules not processed for user `5db19a97588e41d1858915c9ccc48620`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:15.375584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:15.406032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2044/4113] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:15.422531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:15.426238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:15.624615 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2070/4114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:15.633556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788891a-f9fa-43cc-ab76-8a889d081096 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:15.650292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:15.650924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:15.651208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:15.651472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:15.669166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:15.670673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa53f6-35ca-4f13-ab50-03f47eedc1e6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:15.692789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2045/4115] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:17.815586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:17.823232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:17.850467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249556af-33ad-4867-9255-f2d4110ab7e7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:17.860567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:17.861228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:17.861534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:17.861989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] PATH_INFO: `/v3/projects/f00c1696167d428aa9cf3a9feaed642c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:17.864931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00c1696167d428aa9cf3a9feaed642c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:17.867096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:17.986369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00c1696167d428aa9cf3a9feaed642c', 'request_id': 'req-ed8dcc70-1fb5-414f-adae-d00291b178df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:18.004362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00c1696167d428aa9cf3a9feaed642c', 'request_id': 'req-ed8dcc70-1fb5-414f-adae-d00291b178df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:18.022004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00c1696167d428aa9cf3a9feaed642c', 'request_id': 'req-ed8dcc70-1fb5-414f-adae-d00291b178df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:18.044113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] The token cache is being invalidate because project f00c1696167d428aa9cf3a9feaed642c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:18.044779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:18.046158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed8dcc70-1fb5-414f-adae-d00291b178df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:18.051960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2071/4116] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:17 2022] DELETE /identity/v3/projects/f00c1696167d428aa9cf3a9feaed642c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:18.053166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.053739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.053914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.089987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:18.091560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:18.221870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2046/4117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:18.224706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.224994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.225266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.248970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:18.250476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:18.263818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2072/4118] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:18.264705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.280101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7f1c-d609-44ad-8c97-19f96acc09e2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.285795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.286498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.287043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.287530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.288406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:18.288884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.290733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.292563 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:18.305096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2047/4119] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:18.309348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.325851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd84f6a-db9c-4913-896d-1c966daef921 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.335742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.337055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.337337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.337891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.339115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.341921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.382011 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2073/4120] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:18 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:18.386890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.405426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef7c0a-d20f-4680-b3ff-21f635e03a7f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.514925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.515613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.515902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.516234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.517203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.521928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.578616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2048/4121] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:18 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:18.583569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.600179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caef96-1c7e-433a-b646-f2c64522ab68 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.610643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.612099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.612506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.613076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.613968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.616589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.660070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2074/4122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:18.663916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.675529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0313-bf42-495f-8367-5f1f18d4c2ff admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.681741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.682311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.682836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.682964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.685540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.685929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b8d5-dd8d-42c4-b2b0-b49ad166a9f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.705453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2049/4123] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:18.709007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:18.723134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4439680-79ab-49fa-985e-eb027449729d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:18.729860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:18.730938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.731212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.731493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] PATH_INFO: `/v3/projects/5b0e0dcc1ebd4d86b73985558a7ec17f/users/eb9dae9153254b83b63660ce0c895c7a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.750190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0e0dcc1ebd4d86b73985558a7ec17f, user_id=eb9dae9153254b83b63660ce0c895c7a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:18.752878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:18.772146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2075/4124] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:18 2022] PUT /identity/v3/projects/5b0e0dcc1ebd4d86b73985558a7ec17f/users/eb9dae9153254b83b63660ce0c895c7a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:18.873353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83632-54d0-4f14-ac73-8b042b8c07dc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:18.873661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83632-54d0-4f14-ac73-8b042b8c07dc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:18.873934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83632-54d0-4f14-ac73-8b042b8c07dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:18.912210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-27f83632-54d0-4f14-ac73-8b042b8c07dc None None] MFA Rules not processed for user `eb9dae9153254b83b63660ce0c895c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:18.913951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27f83632-54d0-4f14-ac73-8b042b8c07dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:19.060219 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2050/4125] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:19.072474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:19.074404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:19.173977 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:19.342965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b299-1411-401b-ac92-2be3d9afab13 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:19.372044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:19.374630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:19.390979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:19.391620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:19.405804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:19.413671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:19.439027 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2076/4126] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:22.285455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1a3-2605-4250-b33d-74ddda806177 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:22.285998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1a3-2605-4250-b33d-74ddda806177 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:22.285998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1a3-2605-4250-b33d-74ddda806177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:22.318741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b432f1a3-2605-4250-b33d-74ddda806177 None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:22.320197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b432f1a3-2605-4250-b33d-74ddda806177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:22.423231 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2051/4127] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:28.714581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:28.861667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4eae9-0e0d-4f54-b8e1-38b4f8b77bf0 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:28.871025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:28.872047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:28.872554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:28.873042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] PATH_INFO: `/v3/users/eb9dae9153254b83b63660ce0c895c7a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:28.878450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9dae9153254b83b63660ce0c895c7a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:28.880713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:28.974161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9dae9153254b83b63660ce0c895c7a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:28.986279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9dae9153254b83b63660ce0c895c7a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:29.054609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9dae9153254b83b63660ce0c895c7a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:29.059819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9dae9153254b83b63660ce0c895c7a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:29.062625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9dae9153254b83b63660ce0c895c7a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:29.101823 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2077/4128] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:28 2022] DELETE /identity/v3/users/eb9dae9153254b83b63660ce0c895c7a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:29.106424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:29.106923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:29.107028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:29.150382 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:29.158204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:29.160132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:29.312361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2052/4129] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:29.325562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:29.328257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:29.465782 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:29.572310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b1cbb-3020-4e25-8a20-17d34b20bae2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:29.582088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:29.582738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:29.583021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:29.583352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:29.614552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:29.618713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426dda7-f16c-4bcf-ad3a-f6429ca1b5b5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:29.650126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2078/4130] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:30.561172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:30.563278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:30.577144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502f2d-f2f4-4a3c-9143-e68f70df12f8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:30.593935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:30.594900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:30.595350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:30.596124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] PATH_INFO: `/v3/projects/5b0e0dcc1ebd4d86b73985558a7ec17f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:30.597542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0e0dcc1ebd4d86b73985558a7ec17f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:30.600020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:30.663483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0e0dcc1ebd4d86b73985558a7ec17f', 'request_id': 'req-63f7b326-dda8-4c54-817c-391d9662d790'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:30.673787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0e0dcc1ebd4d86b73985558a7ec17f', 'request_id': 'req-63f7b326-dda8-4c54-817c-391d9662d790'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:30.684951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0e0dcc1ebd4d86b73985558a7ec17f', 'request_id': 'req-63f7b326-dda8-4c54-817c-391d9662d790'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:30.705337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] The token cache is being invalidate because project 5b0e0dcc1ebd4d86b73985558a7ec17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:30.706170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:30.707120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-63f7b326-dda8-4c54-817c-391d9662d790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:30.709711 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2053/4131] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:30 2022] DELETE /identity/v3/projects/5b0e0dcc1ebd4d86b73985558a7ec17f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:30.718066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:30.718658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:30.718658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:30.760443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:30.764683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:30.842567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2079/4132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:30.850672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:30.850961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:30.851479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:30.874604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:30.876012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:30.884764 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2054/4133] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:30.890276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:30.901595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a0f84-adf2-48dc-a844-efdb97cc306f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:30.908100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:30.909047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:30.909529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:30.909978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:30.910997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:30.911477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:30.913501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:30.928605 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2080/4134] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:30.933524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:30.944794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4972-2d6d-41eb-ac2c-f5d25a90213b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:30.950342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:30.950967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:30.951461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:30.951726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:30.952376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:30.954395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:30.991371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2055/4135] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:30 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:30.992689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.004585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e22e-ee04-4ed8-ac42-68c92e61a1a0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.096683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.097339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.097673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.097956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.099479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.101751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.136260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2081/4136] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:30 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:31.141524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.161891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734e12-d68f-4306-b5de-3901cd169469 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.168276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.169394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.169906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.170186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.170855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.173432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.186714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2056/4137] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:31.191119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.202774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca2cb-397a-4fe1-8652-59396451d155 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.208591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.209212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.209530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.209806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.210453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.212069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f301c7-e8c4-43ee-ad1d-bce37b113385 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.226207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2082/4138] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:31.235187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.250628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082649-1b5b-46d8-831b-079ffd8f9197 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.257038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.257995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.258435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.258866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] PATH_INFO: `/v3/projects/17e6b70235974bb7b23aa65d759a62b6/users/b62b254713f24182af50b9153685ca9d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.277392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6b70235974bb7b23aa65d759a62b6, user_id=b62b254713f24182af50b9153685ca9d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.280465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.305494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2057/4139] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:31 2022] PUT /identity/v3/projects/17e6b70235974bb7b23aa65d759a62b6/users/b62b254713f24182af50b9153685ca9d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:31.314736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.315093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.315443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.377041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] MFA Rules not processed for user `b62b254713f24182af50b9153685ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:31.378463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:31.460866 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:31.553471 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2083/4140] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:31.557190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.596161 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:31.672999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879a93-26bc-4d0b-9dc5-62f6bb91cc7e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.681144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.682673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.683687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.684838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.685844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.688339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.733060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2058/4141] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:31 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:31.737633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.751452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1db51a-9d97-47d6-880c-e98321765416 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.888959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.890097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.890562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.890943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.892397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.895182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.938114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:31.941725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2084/4142] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:31 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:31.961684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1caab-d6f3-4ef0-897e-aa6b0008f26f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:31.969652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:31.970635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:31.971327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:31.971871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:31.972582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:31.976312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:31.998793 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2059/4143] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:31.999555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.013505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9182-d68e-4478-9981-ff7215572993 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.035308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.036194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.036678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.037688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] PATH_INFO: `/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6/users/93ea655a4b684935a3abf93ff407351c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.070625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f3d8f3c4464e91bc2e2e8e5fd6b4f6, user_id=93ea655a4b684935a3abf93ff407351c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.076673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.138202 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2085/4144] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:31 2022] PUT /identity/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6/users/93ea655a4b684935a3abf93ff407351c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:32.142386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.161064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e844c-4ce2-4653-a5f0-389e6084c36e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.246387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.247153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.247452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.248144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.249287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.250717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a021-ae04-451e-abbd-4c79e78a5285 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.267406 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2060/4145] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:32.269125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.281667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2520-4267-40bf-b94e-4be0e25b870c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.290963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.292358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.292798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.292913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] PATH_INFO: `/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6/users/93ea655a4b684935a3abf93ff407351c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.295181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f3d8f3c4464e91bc2e2e8e5fd6b4f6, user_id=93ea655a4b684935a3abf93ff407351c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.298184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.310150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2086/4146] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:32 2022] PUT /identity/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6/users/93ea655a4b684935a3abf93ff407351c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:32.323283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.324026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.325643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.364849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] MFA Rules not processed for user `93ea655a4b684935a3abf93ff407351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:32.366297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:32.464343 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2061/4147] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:32.470169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.482416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c441-4f41-46bd-9a28-8dc5f1c88344 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.493789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.494425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.494713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.494987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.495753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.497592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.522430 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2087/4148] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:15:32 2022] POST /identity/v3/domains => generated 276 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:32.523614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.534766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cefc4-6ba9-45c2-bdb3-fd9e72eb4c9f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.562401 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:32.609930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.610689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.611242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.611584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.612365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.614173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.634049 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2062/4149] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:15:32 2022] POST /identity/v3/domains => generated 275 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:32.640540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.657922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067138d0-79aa-4edb-a3a0-2726677577d1 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.736393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.737119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.737303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.737630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.738382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.740200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.765493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2088/4150] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:15:32 2022] POST /identity/v3/domains => generated 277 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:32.771068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.783535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270300c-dbd2-4fca-89a3-b9a34447382c tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.871170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.871882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.872168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.872444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:32.873126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:32.874824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:32.897762 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2063/4151] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 25 01:15:32 2022] POST /identity/v3/domains => generated 277 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:32.899126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:32.905759 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:32.913236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543bdb5-fbab-4161-9592-4a360fb9b455 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:32.997903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:32.998830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:32.999227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:32.999602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/bf619a5cc6d84f69859dae073d3ea057` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:33.014239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bf619a5cc6d84f69859dae073d3ea057)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:33.016218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:33.043896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.047734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.104408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.113914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.122643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.138986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project bf619a5cc6d84f69859dae073d3ea057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:33.152945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.154233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.172354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.179689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.180952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bf619a5cc6d84f69859dae073d3ea057', 'request_id': 'req-bb5e4835-d136-4815-b724-d9561fe37220'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.200262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2089/4152] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:32 2022] DELETE /identity/v3/domains/bf619a5cc6d84f69859dae073d3ea057 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:15:33.204354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:33.206261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:33.233142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f394c-e9b7-487b-964d-e92e164d7602 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:33.340922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:33.342019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:33.342520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:33.343035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:33.343909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:33.346093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:33.383391 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2064/4153] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:33 2022] POST /identity/v3/domains => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:33.391734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:33.407850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4835-d136-4815-b724-d9561fe37220 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:33.463361 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:33.485752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:33.486530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:33.487608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:33.487608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/1bff1440b85c4c61b2be6d3bbfa09cdf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:33.502672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1bff1440b85c4c61b2be6d3bbfa09cdf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:33.506027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:33.536980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.538182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.580657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.581395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.587132 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2090/4154] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:33 2022] PATCH /identity/v3/domains/1bff1440b85c4c61b2be6d3bbfa09cdf => generated 249 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:33.588599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:33.591278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:33.606011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d2d6-dc33-4b76-bd87-c78e55e0b28b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:33.688486 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:33.716186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:33.717493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:33.718024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:33.718734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/1bff1440b85c4c61b2be6d3bbfa09cdf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:33.733738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1bff1440b85c4c61b2be6d3bbfa09cdf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:33.736290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:33.767827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.773916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.829988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.838540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.846337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.870137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project 1bff1440b85c4c61b2be6d3bbfa09cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:33.870706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.871770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.881455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.886800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.887978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1bff1440b85c4c61b2be6d3bbfa09cdf', 'request_id': 'req-08443436-1dde-4cbe-84b5-97fb39861313'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:33.903544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2065/4155] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:33 2022] DELETE /identity/v3/domains/1bff1440b85c4c61b2be6d3bbfa09cdf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:33.904737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:33.916252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3b93-454b-498a-be5c-a3d8c5969fd8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.029470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.031249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.031595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.032047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:34.032813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:34.035294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:34.065329 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2091/4156] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:33 2022] POST /identity/v3/domains => generated 277 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:34.069497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:34.071971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:34.088861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443436-1dde-4cbe-84b5-97fb39861313 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.193602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.194442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.194835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.195208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/5f566c33d18d4ede938e1e1581ddcb95` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:34.217674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5f566c33d18d4ede938e1e1581ddcb95)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:34.219933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:34.253314 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:34.262958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.264347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.317108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.317822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.320850 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2066/4157] 10.222.0.16 () {60 vars in 1250 bytes} [Sun Sep 25 01:15:34 2022] PATCH /identity/v3/domains/5f566c33d18d4ede938e1e1581ddcb95 => generated 279 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:34.325178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:34.327216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:34.356019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632010b-2cd4-4132-af4c-ffbb5a514974 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.462108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.462997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.463504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.463878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/5f566c33d18d4ede938e1e1581ddcb95` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:34.482895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=5f566c33d18d4ede938e1e1581ddcb95)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:34.489688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:34.494725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2092/4158] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:15:34 2022] GET /identity/v3/domains/5f566c33d18d4ede938e1e1581ddcb95 => generated 279 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:34.497479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:34.510145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f912-ff6a-4955-9251-35e910525843 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.518248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.518248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.518862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.519374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/5f566c33d18d4ede938e1e1581ddcb95` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:34.521047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5f566c33d18d4ede938e1e1581ddcb95)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:34.522932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:34.563542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.571632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.664025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.679618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.686834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.709972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project 5f566c33d18d4ede938e1e1581ddcb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:34.709972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.709972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.722418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.727225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.728119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5f566c33d18d4ede938e1e1581ddcb95', 'request_id': 'req-7d73bab2-df1a-40c1-804c-9483a2e7d400'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:34.736202 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2067/4159] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:34 2022] DELETE /identity/v3/domains/5f566c33d18d4ede938e1e1581ddcb95 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:34.739982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:34.742126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:34.763730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177a64-03ad-4920-96d2-2874d0af93ea tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.842172 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:34.931152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.931927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.932045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.932381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:34.934090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:34.935775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:34.952867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2093/4160] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:15:34 2022] GET /identity/v3/domains => generated 1346 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:34.957242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:34.971989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73bab2-df1a-40c1-804c-9483a2e7d400 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:34.981007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:34.981752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:34.982041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:34.982321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/5f566c33d18d4ede938e1e1581ddcb95` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.000197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find domain: 5f566c33d18d4ede938e1e1581ddcb95.: keystone.exception.DomainNotFound: Could not find domain: 5f566c33d18d4ede938e1e1581ddcb95. Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5f566c33d18d4ede938e1e1581ddcb95. Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:35.005789 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:35.006987 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5f566c33d18d4ede938e1e1581ddcb95. Sep 25 01:15:35.013015 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:35.014400 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2068/4161] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:34 2022] PATCH /identity/v3/domains/5f566c33d18d4ede938e1e1581ddcb95 => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:35.014501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:35.037218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec56a9b-5308-4a90-927d-2ec4d4fcf07a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:35.048585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:35.048779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:35.049106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:35.049388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.050158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:35.052083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:35.080155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2094/4162] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:35 2022] POST /identity/v3/domains => generated 276 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:35.084131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:35.104181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edddb0-3ff9-4e42-8a49-683ac29d4bca tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:35.286715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:35.287679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:35.289021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:35.289430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.290224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:35.294964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:35.366457 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:35.392308 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2069/4163] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:35 2022] POST /identity/v3/users => generated 348 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:35.397906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:35.420160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35729-dbb3-49a2-a404-56398d229064 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:35.428985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:35.434089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:35.435039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:35.435039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.435745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:35.437372 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:35.437372 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:35.437372 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:35.438420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:35.462213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2095/4164] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:35 2022] POST /identity/v3/groups => generated 323 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:35.463974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:35.506542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6382-b6bd-48c9-8e13-18e0e5c35108 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:35.520569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:35.521785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:35.522276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:35.522774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/fe300d5f169a4327a9be822a48589760` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.527759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fe300d5f169a4327a9be822a48589760)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:35.530348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:35.573217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:35.573868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:35.644659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:35.645313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:35.651038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2070/4165] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:35 2022] PATCH /identity/v3/domains/fe300d5f169a4327a9be822a48589760 => generated 277 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:35.652789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:35.654863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:35.668743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73bbd-ec18-4d7c-80a9-88e5e2fbc03f tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:35.787885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:35.788689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:35.789815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:35.789815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/fe300d5f169a4327a9be822a48589760` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:35.803094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fe300d5f169a4327a9be822a48589760)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:35.805146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:35.848547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:35.857694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fe300d5f169a4327a9be822a48589760'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.036793 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:36.171400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3d6855cc1f4b49a8d1e354c757e4c7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.182629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3d6855cc1f4b49a8d1e354c757e4c7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.204301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3d6855cc1f4b49a8d1e354c757e4c7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.205639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3d6855cc1f4b49a8d1e354c757e4c7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.206739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3d6855cc1f4b49a8d1e354c757e4c7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.297681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.315242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.335102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.380135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project fe300d5f169a4327a9be822a48589760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:36.380347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.382270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.417173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.421418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.422341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fe300d5f169a4327a9be822a48589760', 'request_id': 'req-c2312846-4454-40b4-b449-750ea3d4163d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:36.439350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:36.439898 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2096/4166] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:35 2022] DELETE /identity/v3/domains/fe300d5f169a4327a9be822a48589760 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:36.453104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096453-911f-4f4b-badd-b97928a422f4 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:36.574523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:36.575178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:36.575461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:36.575732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/fe300d5f169a4327a9be822a48589760` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:36.595795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=fe300d5f169a4327a9be822a48589760)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:36.597869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find domain: fe300d5f169a4327a9be822a48589760.: keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:36.624688 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:36.625994 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:36.627030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2071/4167] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:15:36 2022] GET /identity/v3/domains/fe300d5f169a4327a9be822a48589760 => generated 112 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:15:36.634099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:36.637241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:36.686064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312846-4454-40b4-b449-750ea3d4163d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:36.703760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:36.705377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:36.705811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:36.706101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/users/cb3d6855cc1f4b49a8d1e354c757e4c7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:36.738504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:get_user(user_id=cb3d6855cc1f4b49a8d1e354c757e4c7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:36.738504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7.: keystone.exception.UserNotFound: Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7. Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 25 01:15:36.774438 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:36.775958 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7. Sep 25 01:15:36.778022 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:36.780082 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2097/4168] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:15:36 2022] GET /identity/v3/users/cb3d6855cc1f4b49a8d1e354c757e4c7 => generated 110 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:36.780727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:36.805220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495201b-8034-4e6c-8668-5d2f650639d2 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:36.811309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:36.812113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:36.812465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:36.812744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/groups/96dbdcb7a46a436395ac57a582de680c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:36.820416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:get_group(group_id=96dbdcb7a46a436395ac57a582de680c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:36.821524 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:36.821524 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:15:36.821524 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:15:36.822690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find group: 96dbdcb7a46a436395ac57a582de680c.: keystone.exception.GroupNotFound: Could not find group: 96dbdcb7a46a436395ac57a582de680c. Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_group(group_id) Sep 25 01:15:36.843479 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:36.844634 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 96dbdcb7a46a436395ac57a582de680c. Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:36.845839 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2072/4169] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:36 2022] GET /identity/v3/groups/96dbdcb7a46a436395ac57a582de680c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:36.849487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:36.865926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05994c-e161-4115-9afe-715ef7ba255d tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:36.882580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:36.884637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:36.886162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:36.886522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/groups/96dbdcb7a46a436395ac57a582de680c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:36.897629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find group: 96dbdcb7a46a436395ac57a582de680c.: keystone.exception.GroupNotFound: Could not find group: 96dbdcb7a46a436395ac57a582de680c. Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Sep 25 01:15:36.912239 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:36.913432 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 96dbdcb7a46a436395ac57a582de680c. Sep 25 01:15:36.914805 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:36.922027 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2098/4170] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:15:36 2022] DELETE /identity/v3/groups/96dbdcb7a46a436395ac57a582de680c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:36.923525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:36.937622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c285994-d3bb-4f3f-8065-37007afe9cd5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:36.950564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:36.951225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:36.951510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:36.951790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/users/cb3d6855cc1f4b49a8d1e354c757e4c7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:36.968698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cb3d6855cc1f4b49a8d1e354c757e4c7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:36.972078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7.: keystone.exception.UserNotFound: Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7. Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Sep 25 01:15:37.001898 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:37.003333 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cb3d6855cc1f4b49a8d1e354c757e4c7. Sep 25 01:15:37.004677 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:37.005942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2073/4171] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:36 2022] DELETE /identity/v3/users/cb3d6855cc1f4b49a8d1e354c757e4c7 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:37.010317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.029121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27e69-1f39-4288-ba4e-e932770c7dbc tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.052102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.053294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.055460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.055880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/fe300d5f169a4327a9be822a48589760` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.077106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find domain: fe300d5f169a4327a9be822a48589760.: keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:37.096800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:37.098169 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.099485 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.109469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2099/4172] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:37 2022] PATCH /identity/v3/domains/fe300d5f169a4327a9be822a48589760 => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:37.109663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.137549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a6fc6-3115-4b8a-afa1-b8e0fe9e3a99 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.152821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.153816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.155024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.156467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.157884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.162930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.216159 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2074/4173] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:15:37 2022] GET /identity/v3/domains => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:37.221508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.248292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e45ea-8a7c-44bf-acd4-e9e0d0b6a091 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.270058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.276227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.280389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.280753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.282539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:37.285628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.293447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.368504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.368800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2100/4174] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:37 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:37.394931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9c03-5f42-4d9d-bd6c-f6134e82d760 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.409539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.410326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.410717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.411093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.411861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-624236606) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:37.412403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.414288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.442582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2075/4175] 10.222.0.16 () {58 vars in 1197 bytes} [Sun Sep 25 01:15:37 2022] GET /identity/v3/domains?name=tempest-test_domain-624236606 => generated 407 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:37.448067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.460730 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:37.469631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba4f8-5707-41ae-a498-a4b92a97601b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.484286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.484965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.485296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.485592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/fe300d5f169a4327a9be822a48589760` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.507208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Could not find domain: fe300d5f169a4327a9be822a48589760.: keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:37.517774 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:37.519772 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fe300d5f169a4327a9be822a48589760. Sep 25 01:15:37.521210 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:37.529068 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2101/4176] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:37 2022] PATCH /identity/v3/domains/fe300d5f169a4327a9be822a48589760 => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:37.531030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.549442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3e34b-63ce-4669-8ec2-df9a4cb6078a tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.556530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.558754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.559285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.559717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/8a2591a7e01641c2be50e86e8159fbd0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.586431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8a2591a7e01641c2be50e86e8159fbd0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.591157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.625643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.629093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:37.671851 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:37.687145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2076/4177] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:37 2022] PATCH /identity/v3/domains/8a2591a7e01641c2be50e86e8159fbd0 => generated 277 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:37.690305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.702034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b05d-027d-4bc9-8a65-5bf0b6dca6d8 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.713777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.714906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.715342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.715771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/8a2591a7e01641c2be50e86e8159fbd0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.734242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8a2591a7e01641c2be50e86e8159fbd0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.736009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.779226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.784197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.791217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726e12d-e98a-4e88-bbd8-d7cb437a2b54 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:37.800005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:37.801432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:37.801730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:37.802005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] PATH_INFO: `/v3/users/09320560cb2d48228041e62efe9fa018` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:37.803187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09320560cb2d48228041e62efe9fa018)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:37.805974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:37.862910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.875810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.884002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.886345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09320560cb2d48228041e62efe9fa018'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.900346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09320560cb2d48228041e62efe9fa018'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.907609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project 8a2591a7e01641c2be50e86e8159fbd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:37.908397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.910700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.927410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09320560cb2d48228041e62efe9fa018'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.928650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09320560cb2d48228041e62efe9fa018'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.929927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09320560cb2d48228041e62efe9fa018'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.930253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.934872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.936268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8a2591a7e01641c2be50e86e8159fbd0', 'request_id': 'req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:37.949480 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2077/4178] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:37 2022] DELETE /identity/v3/domains/8a2591a7e01641c2be50e86e8159fbd0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:37.955641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:37.957209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:37.961715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2102/4179] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:37 2022] DELETE /identity/v3/users/09320560cb2d48228041e62efe9fa018 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:15:38.068933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fffbb-8f0a-44cf-a51d-5a0c9ef0ca5b tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:38.176529 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:38.192064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:38.193772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:38.235422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:38.236519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.237052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.237580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/ad5940aca1f54dc8bb5e160fdf1718aa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.255577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ad5940aca1f54dc8bb5e160fdf1718aa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:38.262828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:38.294042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.295309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.332588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.334545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.339767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86290e-7d11-4b1e-b21c-1979a2a07b2c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:38.349871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2078/4180] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:37 2022] PATCH /identity/v3/domains/ad5940aca1f54dc8bb5e160fdf1718aa => generated 276 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:38.364652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:38.371128 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:38.373161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:38.442900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:38.445069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.446702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.447261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] PATH_INFO: `/v3/projects/68f6dd104c6c4f5b856d5ea62a769c14` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.450571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f6dd104c6c4f5b856d5ea62a769c14)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:38.453435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:38.475600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa94f69-9f55-4660-885c-35a85240be03 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:38.482219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:38.483196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.484253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.484541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/ad5940aca1f54dc8bb5e160fdf1718aa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.502998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ad5940aca1f54dc8bb5e160fdf1718aa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:38.506525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:38.540136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f6dd104c6c4f5b856d5ea62a769c14', 'request_id': 'req-56d287c6-9532-419b-8875-a0ac961bdc59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.547253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.552266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f6dd104c6c4f5b856d5ea62a769c14', 'request_id': 'req-56d287c6-9532-419b-8875-a0ac961bdc59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.554036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.566456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f6dd104c6c4f5b856d5ea62a769c14', 'request_id': 'req-56d287c6-9532-419b-8875-a0ac961bdc59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.597149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] The token cache is being invalidate because project 68f6dd104c6c4f5b856d5ea62a769c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:38.597830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.602631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56d287c6-9532-419b-8875-a0ac961bdc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.607097 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2103/4181] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:38 2022] DELETE /identity/v3/projects/68f6dd104c6c4f5b856d5ea62a769c14 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:38.611938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008b04b-acb6-4f11-907a-6cf233c7b788 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.612234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008b04b-acb6-4f11-907a-6cf233c7b788 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.612486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008b04b-acb6-4f11-907a-6cf233c7b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.643209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.644134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b008b04b-acb6-4f11-907a-6cf233c7b788 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:38.645497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b008b04b-acb6-4f11-907a-6cf233c7b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:38.656908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.670469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.674877 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:38.703526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project ad5940aca1f54dc8bb5e160fdf1718aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:38.703857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.705803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.721973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.725723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.726510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ad5940aca1f54dc8bb5e160fdf1718aa', 'request_id': 'req-a7693d78-f2b8-4605-8b32-a54523789dc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.737955 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2079/4182] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:38 2022] DELETE /identity/v3/domains/ad5940aca1f54dc8bb5e160fdf1718aa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:38.738805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:38.741179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:38.772045 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2104/4183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:38.799058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.803158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.805823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.849873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693d78-f2b8-4605-8b32-a54523789dc5 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:38.857590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:38.858399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:38.858776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:38.859181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/8ddcd4d504a14806b5303a1a5a953d06` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:38.881279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8ddcd4d504a14806b5303a1a5a953d06)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:38.891465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:38.908028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:38.912651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:38.920202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.921676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.937781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2105/4184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:38.940872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:38.959543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5565cd-cef5-42c7-8e63-71dc5c90966e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:38.969747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.970665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:38.974403 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2080/4185] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:38 2022] PATCH /identity/v3/domains/8ddcd4d504a14806b5303a1a5a953d06 => generated 277 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:38.978408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:38.982482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.068980 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:39.128221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12a3ea-56e5-47bd-aa78-8b59c1b31cdd tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.128831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.129734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.130225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.130655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.131479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:39.131960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.133890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ea655a4b684935a3abf93ff407351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.134176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.134732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.135109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.135478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] PATH_INFO: `/v3/domains/8ddcd4d504a14806b5303a1a5a953d06` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.150267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2106/4186] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:39.151328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8ddcd4d504a14806b5303a1a5a953d06)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.151666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:39.153663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.154559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.183438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.186215 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=1,keystone:DELETE=5,keystone:SELECT=93,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:39.195259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.283351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b397a3-fc6b-4114-a356-6a6bca9d2c3f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.297455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.305458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.311604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.344199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] The token cache is being invalidate because project 8ddcd4d504a14806b5303a1a5a953d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:39.344788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.345542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.357538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.363176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.363832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8ddcd4d504a14806b5303a1a5a953d06', 'request_id': 'req-d458617b-2546-4f57-ac91-aeadcdb53fb7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.366938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.368293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.369170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.369693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.372413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.379651 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2081/4187] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:38 2022] DELETE /identity/v3/domains/8ddcd4d504a14806b5303a1a5a953d06 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:39.379651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:39.381035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.498726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.500577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.503265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458617b-2546-4f57-ac91-aeadcdb53fb7 tempest-DomainsTestJSON-1136517507 tempest-DomainsTestJSON-1136517507-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.510549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.512422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.513103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.513719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.516050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.516235 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2107/4188] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:39.529195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:39.538112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.625592 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:39.636517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.648991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.668674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2082/4189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:39.669953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:39.673540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.680679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9ad52-38b5-41e1-beb3-b1222f8de62c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.690028 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:39.696328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.696706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.696985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.697268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.697972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.702496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.709514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6a8f1-94f3-42d6-a3c0-b35fffc3d4ec service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.724603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.725107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.725391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.725706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] PATH_INFO: `/v3/users/b62b254713f24182af50b9153685ca9d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:39.746431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62b254713f24182af50b9153685ca9d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:39.756193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:39.814232 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2108/4190] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:39 2022] POST /identity/v3/projects => generated 395 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:39.815266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:39.825361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:39.939197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62b254713f24182af50b9153685ca9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.941740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62b254713f24182af50b9153685ca9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.967352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62b254713f24182af50b9153685ca9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:39.970201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b5c9-81c4-4151-92ed-5097114b4087 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:39.980170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:39.996277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:39.996593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:39.996904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.005358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.008660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62b254713f24182af50b9153685ca9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:40.009787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62b254713f24182af50b9153685ca9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:40.059075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2083/4191] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:39 2022] DELETE /identity/v3/users/b62b254713f24182af50b9153685ca9d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:40.059075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.064031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.280173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.282042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9d8c-c427-4cf2-9ce9-4bd7bdd1f16f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.295357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc73b-31b1-48f7-9fdb-cd6046948e2b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.304073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.304781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.305164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.305465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.306155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.308692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.330376 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2109/4192] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:40.335515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.335632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.336146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.343974 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2084/4193] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:40 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:40.359104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.374540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:40.376603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.382708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804ca65-5017-49ed-b8b6-d6c8229f8b86 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.398870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.400072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.402551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.402882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.407812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.408795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2110/4194] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:40.413193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.429775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.434633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.452263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2085/4195] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:40.455598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.478838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a40c6-5d76-46eb-9322-d361ba14b116 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.493266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.493927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.494218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.495049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.495668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.504047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.529905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2086/4196] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:40.534388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.556358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e796e-62e7-4fcb-b958-087a3881f64e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.564582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9881-d1e9-44de-93e7-3904cdad582e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.571423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.572121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.572399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.572675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] PATH_INFO: `/v3/projects/b6abc3d488644783b602df7b193d10c4/users/e51b184054f54546b1ba12f799acf04e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.574892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.576371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.577265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.577595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.603651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6abc3d488644783b602df7b193d10c4, user_id=e51b184054f54546b1ba12f799acf04e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.606637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.607958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48055c6-44f6-43c6-a5d1-b2a43f1f1ac7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.611152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.634261 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:40.636601 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2087/4197] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:40 2022] PUT /identity/v3/projects/b6abc3d488644783b602df7b193d10c4/users/e51b184054f54546b1ba12f799acf04e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:40.647859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801421-4b2a-4bdf-88fa-95c2e8efa8d7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.648161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801421-4b2a-4bdf-88fa-95c2e8efa8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.648605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801421-4b2a-4bdf-88fa-95c2e8efa8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.657549 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2111/4198] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:40.709900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7f801421-4b2a-4bdf-88fa-95c2e8efa8d7 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:40.711659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7f801421-4b2a-4bdf-88fa-95c2e8efa8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.727443 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:40.778355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:40.780472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.798465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff85e60-7c84-4795-8959-89a1c74555ca service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:40.873292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2088/4199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:40.874950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.875392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.875779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.883119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:40.883902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:40.884181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:40.884650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:40.888546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.920022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:40.925349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:40.929473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:40.932677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:40.950203 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2112/4200] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:15:40.956570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2089/4201] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:41.091215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:41.095986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:41.196338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:41.198962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:41.342933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de625b4-fb60-48df-860e-3d3d076b3256 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:41.359904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:41.362180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:41.363648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:41.364055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:41.401424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:41.405945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24742824-981d-4955-9618-bdb51b3385e9 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:41.407506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dd11-b737-4d7a-a4b2-db4129e44885 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:41.428199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:41.431711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:41.431711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:41.431711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:41.437464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:41.441958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2113/4202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:41.456591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:41.458373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a071f-0ff1-49d8-8589-bc99a90d1636 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:41.485492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:41.485938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:41.486349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:41.502275 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2090/4203] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:15:41.512309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:41.513745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:41.527477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2114/4204] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:41.934788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e91f-ec7d-4361-bb98-345acd81ed44 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:41.935414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e91f-ec7d-4361-bb98-345acd81ed44 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:41.935414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e91f-ec7d-4361-bb98-345acd81ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:41.964956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:41.984756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9a60e91f-ec7d-4361-bb98-345acd81ed44 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:41.985853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a60e91f-ec7d-4361-bb98-345acd81ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.004123 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2091/4205] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:42.008779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf5a2-23fe-48f6-be6b-a3a347175d82 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:42.032234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:42.034269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.037255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.037765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236700e-f5bc-442c-a5d9-fb6f68c4d939 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.038063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236700e-f5bc-442c-a5d9-fb6f68c4d939 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.038346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236700e-f5bc-442c-a5d9-fb6f68c4d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.039256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.044073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.064716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:42.068790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:42.075626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9236700e-f5bc-442c-a5d9-fb6f68c4d939 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:42.078344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9236700e-f5bc-442c-a5d9-fb6f68c4d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.093545 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2115/4206] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:15:42.095248 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2092/4207] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:42.307003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:42.309536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.433804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.434347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.435072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.460362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] MFA Rules not processed for user `e51b184054f54546b1ba12f799acf04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:42.462882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.478963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2093/4208] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:42.486215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd057611-fa3a-435f-86b7-34fe3eb5b30b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:42.519238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:42.522028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.522579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.523013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] PATH_INFO: `/v3/projects/17e6b70235974bb7b23aa65d759a62b6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.525233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e6b70235974bb7b23aa65d759a62b6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:42.547805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:42.554372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:42.578833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e377e-7822-43ac-8292-7583048178a6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:42.579029 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:42.598838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:42.601362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.602800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.603301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] PATH_INFO: `/v3/users/e51b184054f54546b1ba12f799acf04e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.607627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51b184054f54546b1ba12f799acf04e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:42.614098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:42.705706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e6b70235974bb7b23aa65d759a62b6', 'request_id': 'req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.729989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e6b70235974bb7b23aa65d759a62b6', 'request_id': 'req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.747149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e6b70235974bb7b23aa65d759a62b6', 'request_id': 'req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.756095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51b184054f54546b1ba12f799acf04e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.757149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51b184054f54546b1ba12f799acf04e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.771310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] The token cache is being invalidate because project 17e6b70235974bb7b23aa65d759a62b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:42.773004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.775133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.775837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51b184054f54546b1ba12f799acf04e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.780307 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2116/4209] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:42 2022] DELETE /identity/v3/projects/17e6b70235974bb7b23aa65d759a62b6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:42.784223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:42.786526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:42.808937 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:42.825238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51b184054f54546b1ba12f799acf04e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.827546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3689fdd4-5375-473f-a5e6-d435f3bb3343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51b184054f54546b1ba12f799acf04e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:42.861507 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2094/4210] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:42 2022] DELETE /identity/v3/users/e51b184054f54546b1ba12f799acf04e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:42.863621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:42.863911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:42.865262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:42.943269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:42.946934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:43.001206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fa01-8aba-4e8f-930c-e0a1dcea2ff4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:43.103761 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2095/4211] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:43.125033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:43.130318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:43.133140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:43.134051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:43.134518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:43.134965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] PATH_INFO: `/v3/users/93ea655a4b684935a3abf93ff407351c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:43.137041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ea655a4b684935a3abf93ff407351c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:43.144948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:43.247840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a025f55-a358-499f-a30c-5418c49b835b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:43.252549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:43.253695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:43.254300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:43.254711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:43.269154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ea655a4b684935a3abf93ff407351c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:43.270985 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:43.282440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:43.285995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:43.306823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ea655a4b684935a3abf93ff407351c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:43.311749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2096/4212] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:43.348006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ea655a4b684935a3abf93ff407351c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:43.349597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ea655a4b684935a3abf93ff407351c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:43.350762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ea655a4b684935a3abf93ff407351c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:43.375814 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2117/4213] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:42 2022] DELETE /identity/v3/users/93ea655a4b684935a3abf93ff407351c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:45.539438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:45.559351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c081c-2dd7-4fa0-8e93-d4c7c633faae service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:45.608124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:45.609671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:45.765072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:45.766025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:45.766446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:45.766818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] PATH_INFO: `/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:45.769775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f3d8f3c4464e91bc2e2e8e5fd6b4f6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:45.771985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:45.822905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939365a9-9ac5-4862-b309-96801ec37f45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:45.838073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:45.839031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:45.839515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:45.839955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] PATH_INFO: `/v3/projects/b6abc3d488644783b602df7b193d10c4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:45.844788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6abc3d488644783b602df7b193d10c4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:45.845828 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:45.848244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:45.907080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'request_id': 'req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.918621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'request_id': 'req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.934595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f3d8f3c4464e91bc2e2e8e5fd6b4f6', 'request_id': 'req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.961117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] The token cache is being invalidate because project a2f3d8f3c4464e91bc2e2e8e5fd6b4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:45.961556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.962808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.967668 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2097/4214] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:45 2022] DELETE /identity/v3/projects/a2f3d8f3c4464e91bc2e2e8e5fd6b4f6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:45.969442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:45.973537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6abc3d488644783b602df7b193d10c4', 'request_id': 'req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:45.974771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.006688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6abc3d488644783b602df7b193d10c4', 'request_id': 'req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:46.023115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6abc3d488644783b602df7b193d10c4', 'request_id': 'req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:46.058816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] The token cache is being invalidate because project b6abc3d488644783b602df7b193d10c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:46.059165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:46.059861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aff5cd62-a57e-4355-adc4-5d6dfd6c3f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:46.061980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2118/4215] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:45 2022] DELETE /identity/v3/projects/b6abc3d488644783b602df7b193d10c4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:46.063299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b1be-f96d-4e47-b8f9-eb8828524925 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.063592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b1be-f96d-4e47-b8f9-eb8828524925 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.063871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b1be-f96d-4e47-b8f9-eb8828524925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.088117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e879b1be-f96d-4e47-b8f9-eb8828524925 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:46.089438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e879b1be-f96d-4e47-b8f9-eb8828524925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.126974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31b30b-86db-4a57-a7c4-9da609b6e3ce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.175248 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:46.207790 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2119/4216] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:46.209254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18bf6-5c26-4ec8-b490-49814c72780f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.209573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18bf6-5c26-4ec8-b490-49814c72780f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.209856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e18bf6-5c26-4ec8-b490-49814c72780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.246108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.246747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.247491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.247780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.252085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.258664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c7e18bf6-5c26-4ec8-b490-49814c72780f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:46.259896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7e18bf6-5c26-4ec8-b490-49814c72780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.272934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.274555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb66b3-056d-4862-bec9-32de97bb56f5 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.282845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2120/4217] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:46.284307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.284595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.284873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.285780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2098/4218] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:46.287890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.288342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.288688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.323878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:46.325140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.329657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:46.333969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:46.337603 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2121/4219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:46.338927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.351751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2099/4220] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:46.353349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30163d-7594-487d-9ab6-0bc03aa9de7c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.356228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.367752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.368485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.368893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.369234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.370723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:46.372766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.377098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.393313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ba80-33de-4455-bd96-dbf386e41f89 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.437175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.437839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.438121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.438399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.445734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:46.446479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.449042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.455821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2122/4221] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:46.458571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.467221 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2100/4222] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:46.472482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.485540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178cd1-81a7-49ae-9b64-1f2e79d7c9ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.486573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d5bc-b75d-4ac5-a19c-5c74b1436f36 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.492227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.493369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.493913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.494538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.495932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.498287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.500123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.500762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.501026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.503941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.504622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.507806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.549178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2123/4223] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:46.553156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.564775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2101/4224] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:46.566291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.639018 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:46.657000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5deac-1a90-4a46-83cb-23958f069713 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.695682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff4972-5ccf-4d7e-9588-6a2a093dc2a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.701302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.701986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.702671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.702671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.703227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.706185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.753258 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2102/4225] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:46.756908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.770589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242770-59f1-4ad1-916e-7e5ed47e4583 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.777315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.778985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.779471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.780084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.781123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.783105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.807953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.808724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.809079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.809451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.810180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.812279 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2103/4226] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:46.814107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.817262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.833363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a84e8-5bca-4d11-8490-6cb261c54936 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.842822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.843960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.844403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.845110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.845952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.849852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.865743 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2124/4227] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:15:46.869462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.879835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2104/4228] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:46.881802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.894472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e2ab1-ccbc-4dd2-8f73-02d5cc5d74df admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.899490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.900700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.900996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.901870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] PATH_INFO: `/v3/projects/936e54ee92b84e5c96db824056728d1a/users/907d7867b6484e6c9470ffc137e98a91/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.903482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d421-6497-4909-a2e2-1b8f7be6aac2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.915124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.916015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.916479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.917763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.918649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.920473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.931830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2125/4229] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:46.936352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.940954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936e54ee92b84e5c96db824056728d1a, user_id=907d7867b6484e6c9470ffc137e98a91, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.943902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120747-728e-4493-89df-4ebfcf830806 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.948859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1973b4-aff1-443e-8bbc-40f6d86d6dc0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:46.954721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:46.955351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.955635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.955918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.956566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:46.958750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:46.973278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2126/4230] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:46.977570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:46.984292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2105/4231] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:46 2022] PUT /identity/v3/projects/936e54ee92b84e5c96db824056728d1a/users/907d7867b6484e6c9470ffc137e98a91/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:46.986034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe5c-1477-4bef-9551-1c5090f652f7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:46.986285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe5c-1477-4bef-9551-1c5090f652f7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:46.986563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe5c-1477-4bef-9551-1c5090f652f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:46.989304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614117a7-2c81-444a-b48b-9214d5a947cc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.048387 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:47.061345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ea34fe5c-1477-4bef-9551-1c5090f652f7 None None] MFA Rules not processed for user `907d7867b6484e6c9470ffc137e98a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:47.063326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ea34fe5c-1477-4bef-9551-1c5090f652f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:47.138781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:47.140949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.141275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.141877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] PATH_INFO: `/v3/projects/7e35a159a9fa4e2e9574bfee71a81bd4/users/6d030c0e23a748deb33182046b68c742/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.174554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e35a159a9fa4e2e9574bfee71a81bd4, user_id=6d030c0e23a748deb33182046b68c742, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:47.184608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9922-a47a-41fe-a5d5-72ecfc28b675 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:47.220914 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2127/4232] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:46 2022] PUT /identity/v3/projects/7e35a159a9fa4e2e9574bfee71a81bd4/users/6d030c0e23a748deb33182046b68c742/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:15:47.224279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.232022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.234287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.245003 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2106/4233] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:47.311593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] MFA Rules not processed for user `6d030c0e23a748deb33182046b68c742`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:47.312701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:47.348859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.349804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.349804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.383859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] MFA Rules not processed for user `907d7867b6484e6c9470ffc137e98a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:47.388627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:47.509210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2128/4234] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:47.512756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:47.513624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2107/4235] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:47.636715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86774-f7e6-4d74-b655-5579d3ef95c0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.648231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:47.648952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.649238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.649561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.650213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:47.653257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:47.690064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2129/4236] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:47 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:47.694077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:47.712855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1b57-2fc2-49fe-9979-e99133ef40bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.722964 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:47.799852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:47.800675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.801026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.801368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.802202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:47.806382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:47.837344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2108/4237] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:47 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:47.841292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:47.857052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87eeb-bf4b-4ab0-9824-c1faa0d070c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.863560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:47.864273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.864556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.864830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.865544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:47.867393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:47.883288 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2130/4238] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:47.887905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:47.903394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767cbca-1979-4850-bec5-01fc2dce8400 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.909088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:47.910270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:47.910766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:47.911516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] PATH_INFO: `/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:47.931747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1255edf9b74783ba61a6d2f4dbc5b3, user_id=0eaa3437ffc84adf91a5d3f5d9c0a0ab, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:47.936153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:47.955254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2109/4239] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:47 2022] PUT /identity/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:47.959201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:47.971337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6619e2-5bf7-4406-8789-267f87b08b39 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:47.977063 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:48.061735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.062459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.062875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.063280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.064555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.066139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33ed0-f6ea-4006-893c-e12cfb2e9ea5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.081830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2131/4240] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:48.083297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.096420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca259e-8a35-4da6-a568-beb8495636de admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.102125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.103587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.103980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.105040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] PATH_INFO: `/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.107493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1255edf9b74783ba61a6d2f4dbc5b3, user_id=0eaa3437ffc84adf91a5d3f5d9c0a0ab, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.111368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.132774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2110/4241] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:48 2022] PUT /identity/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:48.134841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bafaf-d334-48b7-9529-116340757c97 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.135349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bafaf-d334-48b7-9529-116340757c97 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.135897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bafaf-d334-48b7-9529-116340757c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.160510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.162771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:48.182110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-925bafaf-d334-48b7-9529-116340757c97 None None] MFA Rules not processed for user `0eaa3437ffc84adf91a5d3f5d9c0a0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:48.183847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-925bafaf-d334-48b7-9529-116340757c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:48.302715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2132/4242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:48.303932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bafaf-d334-48b7-9529-116340757c97 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.315024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bafaf-d334-48b7-9529-116340757c97 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.320133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.320810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.321101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.321378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.322347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.324582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invalid input for field 'name': '' is too short Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: '' Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise error Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application '' Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.345286 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:15:48.351506 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application '' Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2133/4243] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:48 2022] POST /identity/v3/domains => generated 283 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:15:48.352856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.353775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e089bd-c4ec-4c6a-b1da-b5974b63b729 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.367551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a06a-82cf-437d-9042-62297fa20005 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.374821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.376154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.376154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.376407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.378305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.378930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.379213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.380980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.381690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.383799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise error Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.395936 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 25 01:15:48.402630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.403797 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2134/4244] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:48 2022] POST /identity/v3/domains => generated 412 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:15:48.408465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.428245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683843-7de1-4fd9-be66-b497987278c0 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.433627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.434381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.434665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.434941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.435614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.439258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.470250 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2135/4245] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:48 2022] POST /identity/v3/domains => generated 276 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:48.471406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.473615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.475464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.482177 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:48.490559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2111/4246] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:15:48.562489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a288-9377-4b14-bae0-3e7d2623d1c2 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.568827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.569659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.570047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.570426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.587545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b1568c22bc704a4eb81a7d0f2055c9c3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.589968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.592525 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Sep 25 01:15:48.616003 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 25 01:15:48.617001 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:48.625031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2136/4247] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:48 2022] DELETE /identity/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3 => generated 120 bytes in 154 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:48.628716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.646452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fabc2-19f9-4430-86a6-f5d077d49e0f service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.658758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.659337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.659623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.659904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.661709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b1568c22bc704a4eb81a7d0f2055c9c3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.667615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:48.726846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:48.727967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:48.780618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:48.782136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:48.789232 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2112/4248] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:48 2022] PATCH /identity/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3 => generated 277 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:48.790764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.793631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:48.820019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c2f28-5096-46cd-b209-d54b3f459965 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:48.962180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:48.962852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:48.963145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:48.963461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:48.992464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:48.993752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b1568c22bc704a4eb81a7d0f2055c9c3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:48.994675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:48.995508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:49.048497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.055618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.109766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7fca-6773-45da-8a17-e9273ca49b48 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:49.117162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:49.118005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:49.118396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:49.118794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:49.121112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:49.128750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.138426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.138942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:49.140842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:49.152507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.155675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2113/4249] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:15:49.178825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] The token cache is being invalidate because project b1568c22bc704a4eb81a7d0f2055c9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:49.179427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.183124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.204153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.210503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.212492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b1568c22bc704a4eb81a7d0f2055c9c3', 'request_id': 'req-a89cef01-aa40-4d75-99ae-b86bd4badc69'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:49.228164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2137/4250] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:48 2022] DELETE /identity/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:49.233556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:49.250732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54ffe3-5404-4b1f-b737-2a9860b3577b service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:49.457528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:49.473087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:49.473618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:49.473927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/41e64aadb7294a829007ea595b782ba9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:49.503829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Could not find domain: 41e64aadb7294a829007ea595b782ba9.: keystone.exception.DomainNotFound: Could not find domain: 41e64aadb7294a829007ea595b782ba9. Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41e64aadb7294a829007ea595b782ba9. Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:49.515380 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:49.516595 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:49.517706 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41e64aadb7294a829007ea595b782ba9. Sep 25 01:15:49.519385 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.519385 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2114/4251] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:49 2022] DELETE /identity/v3/domains/41e64aadb7294a829007ea595b782ba9 => generated 112 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:49.523035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:49.524937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:49.540096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cef01-aa40-4d75-99ae-b86bd4badc69 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:49.546173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:49.547263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:49.547791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:49.548301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:49.549379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:49.551869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:49.575536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2138/4252] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:49 2022] POST /identity/v3/domains => generated 252 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:49.580146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:49.598520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7c1a-acff-4f9b-8e31-69157a333dbc tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:49.718592 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:49.762382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:49.765297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:49.765745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:49.766187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:49.769188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:49.772200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:49.802675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.sql.core [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-275428824' for key 'project.ixu_project_name_domain_id'") Sep 25 01:15:49.802675 n-d-master-1 devstack@keystone.service[81862]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 01:15:49.802675 n-d-master-1 devstack@keystone.service[81862]: [parameters: {'id': '1e08d73acd364c1cbda797676a507479', 'name': 'tempest-domain-dup-275428824', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 25 01:15:49.802675 n-d-master-1 devstack@keystone.service[81862]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81862) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-275428824.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-275428824. Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:15:49.837188 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-275428824' for key 'project.ixu_project_name_domain_id'") Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 25 01:15:49.838426 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application yield resource Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise self.value Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.commit() Sep 25 01:15:49.840282 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.flush() Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application compat.raise_( Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:15:49.841378 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 01:15:49.844080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:15:49.846125 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-275428824' for key 'project.ixu_project_name_domain_id'") Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [parameters: {'id': '1e08d73acd364c1cbda797676a507479', 'name': 'tempest-domain-dup-275428824', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.849644 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-275428824. Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:49.852283 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-275428824. Sep 25 01:15:49.855059 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:49.858945 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2115/4253] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:15:49 2022] POST /identity/v3/domains => generated 211 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:15:49.859731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:49.892587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba024-383a-4333-9e5c-4750044e2f25 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:49.910199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:49.911283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:49.912726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:49.913792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/d5f55f779996466782ff6abf4e1f0f34` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:49.947379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d5f55f779996466782ff6abf4e1f0f34)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:49.954593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:49.969076 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.012830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.014189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.070163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.072681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.087635 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2139/4254] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:49 2022] PATCH /identity/v3/domains/d5f55f779996466782ff6abf4e1f0f34 => generated 253 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:50.091281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:50.093619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:50.118918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933b76-34a9-42a5-8715-9e119187b957 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:50.261440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:50.262122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:50.262410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:50.262688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/d5f55f779996466782ff6abf4e1f0f34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:50.305340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d5f55f779996466782ff6abf4e1f0f34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:50.313824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:50.351609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.356787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.434717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.445999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.456153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.487595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] The token cache is being invalidate because project d5f55f779996466782ff6abf4e1f0f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:50.487858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.489123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.505232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.509494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.511643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd5f55f779996466782ff6abf4e1f0f34', 'request_id': 'req-8c50c90c-1922-4764-bc09-ff500ca97f3c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:50.524919 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2116/4255] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:15:50 2022] DELETE /identity/v3/domains/d5f55f779996466782ff6abf4e1f0f34 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:50.530928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:50.551172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc00e-1e5a-4d0d-8cbf-cc4b04fab734 tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:50.682686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eaa3437ffc84adf91a5d3f5d9c0a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:50.683772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:50.684215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:50.684668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] PATH_INFO: `/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:50.694267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-57a4d2e8-bc00-4d84-a8ac-c2436234f32e tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Could not find domain: b1568c22bc704a4eb81a7d0f2055c9c3.: keystone.exception.DomainNotFound: Could not find domain: b1568c22bc704a4eb81a7d0f2055c9c3. Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b1568c22bc704a4eb81a7d0f2055c9c3. Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:50.701457 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:15:50.702587 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:15:50.703661 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b1568c22bc704a4eb81a7d0f2055c9c3. Sep 25 01:15:50.704724 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:15:50.704724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2140/4256] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:15:50 2022] PATCH /identity/v3/domains/b1568c22bc704a4eb81a7d0f2055c9c3 => generated 112 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:15:50.710162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:50.711715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:50.793655 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.880340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c90c-1922-4764-bc09-ff500ca97f3c tempest-DomainsNegativeTestJSON-1973221372 tempest-DomainsNegativeTestJSON-1973221372-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:50.909126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:50.910051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:50.910485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:50.910935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] PATH_INFO: `/v3/users/6d030c0e23a748deb33182046b68c742` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:50.916511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d030c0e23a748deb33182046b68c742)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:50.919440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:51.058467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d030c0e23a748deb33182046b68c742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:51.071822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d030c0e23a748deb33182046b68c742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:51.091699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d030c0e23a748deb33182046b68c742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:51.115103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d030c0e23a748deb33182046b68c742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:51.116217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d030c0e23a748deb33182046b68c742'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:51.149607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2117/4257] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:50 2022] DELETE /identity/v3/users/6d030c0e23a748deb33182046b68c742 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:51.151435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:51.152036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:51.152384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:51.187857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:51.189375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:51.375296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2141/4258] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:51.383026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:51.390482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:51.467208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376f2f7-8047-4265-957d-4c3063d18819 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:51.473110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:51.474005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:51.474285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:51.474596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:51.489540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:51.493058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:51.512982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2118/4259] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:52.810125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:52.812628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:52.840523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d237-833d-47c1-a03a-cb56c87f7271 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:52.853534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:52.856128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:52.857881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:52.858345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] PATH_INFO: `/v3/projects/7e35a159a9fa4e2e9574bfee71a81bd4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:52.861962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e35a159a9fa4e2e9574bfee71a81bd4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:52.866700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:52.966261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e35a159a9fa4e2e9574bfee71a81bd4', 'request_id': 'req-329e46b0-d85d-487b-a808-c67e88342ee4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:52.974922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e35a159a9fa4e2e9574bfee71a81bd4', 'request_id': 'req-329e46b0-d85d-487b-a808-c67e88342ee4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:52.983834 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:52.986001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e35a159a9fa4e2e9574bfee71a81bd4', 'request_id': 'req-329e46b0-d85d-487b-a808-c67e88342ee4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.030023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] The token cache is being invalidate because project 7e35a159a9fa4e2e9574bfee71a81bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:53.030603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.031720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.034244 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2142/4260] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:52 2022] DELETE /identity/v3/projects/7e35a159a9fa4e2e9574bfee71a81bd4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:53.038419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:53.055067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546368e-44ad-4940-8e34-75e3645415fa service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:53.141163 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:53.164649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:53.165203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:53.165593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:53.165874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] PATH_INFO: `/v3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:53.167851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa3437ffc84adf91a5d3f5d9c0a0ab)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:53.169866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:53.252232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa3437ffc84adf91a5d3f5d9c0a0ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.253161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa3437ffc84adf91a5d3f5d9c0a0ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.262866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa3437ffc84adf91a5d3f5d9c0a0ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.278978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa3437ffc84adf91a5d3f5d9c0a0ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.280056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d0892a5-2e2b-44d8-a843-525ce97cc743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa3437ffc84adf91a5d3f5d9c0a0ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:53.297352 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2119/4261] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:53 2022] DELETE /identity/v3/users/0eaa3437ffc84adf91a5d3f5d9c0a0ab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:54.246332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:54.248421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:54.268888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e46b0-d85d-487b-a808-c67e88342ee4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:54.409389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:54.410795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:54.411254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:54.413560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] PATH_INFO: `/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:54.415479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1255edf9b74783ba61a6d2f4dbc5b3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:54.418423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:54.541254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'request_id': 'req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:54.559502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'request_id': 'req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:54.584113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1255edf9b74783ba61a6d2f4dbc5b3', 'request_id': 'req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:54.608409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] The token cache is being invalidate because project 4e1255edf9b74783ba61a6d2f4dbc5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:15:54.609007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:54.609897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-97c4283f-f4c6-49fa-8eec-2c4b4d7a1e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:54.618247 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2143/4262] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:54 2022] DELETE /identity/v3/projects/4e1255edf9b74783ba61a6d2f4dbc5b3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:54.621316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:54.622061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:54.622367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:54.675191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:54.678670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:54.842024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2120/4263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:54.857877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:54.858164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:54.858636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:54.902550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:54.904215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:54.924559 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2144/4264] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:54.925701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:54.942786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8689-bae1-4f20-923b-23cba0be1a67 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:54.955720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:54.956811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:54.957224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:54.957631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:54.959020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:15:54.960004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:54.962160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:54.988403 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2121/4265] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:54.992931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.007037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0ed2f-7320-4f29-9fb9-fea3faa1ceb2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.019623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.020253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.020531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.020816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.021450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.023389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.101484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2145/4266] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:54 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:55.106895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.123994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060861-6b3a-4ece-a53e-435dfd5ffe54 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.192000 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:55.207947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.208475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.208716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.209674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.210327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.214567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.250949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2122/4267] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:55 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:55.255232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.279763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4dbe-343b-4640-972b-bbdc593c7c51 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.285617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.287033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.287312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.287585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.288460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.290416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.306395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2146/4268] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:15:55.308455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.319396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f84e2f-b039-4f25-8207-b092351abd10 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.324822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.325694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.326165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.326611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.327594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.329586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2f90d-d8f6-4cc3-b4e9-dca46a71340c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.348805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.350306 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2123/4269] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:55.390253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c32e-832f-433f-86ee-3c581aca5b8a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.400558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.402392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.402860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.403309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] PATH_INFO: `/v3/projects/61d9b79667794a6a85ed0a4a8ac0d638/users/8cbae4740b144dedb46bbb535c4241a6/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.444284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d9b79667794a6a85ed0a4a8ac0d638, user_id=8cbae4740b144dedb46bbb535c4241a6, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.447160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.474630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2147/4270] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:55 2022] PUT /identity/v3/projects/61d9b79667794a6a85ed0a4a8ac0d638/users/8cbae4740b144dedb46bbb535c4241a6/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:55.488677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.489154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.489658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.535374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] MFA Rules not processed for user `8cbae4740b144dedb46bbb535c4241a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:55.537105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:55.639496 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2124/4271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:55.644414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.700583 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:55.700801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:55.703835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:55.793947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a47fa-054b-41d5-b77c-e154c660700b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.804360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:55.805110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:55.805365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:55.805666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:55.806315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:55.808349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:55.887925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2148/4272] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:55 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:55.892835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fd0e2-4912-49a7-9bbf-43eae8d313f5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:55.893276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.030163 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:56.064144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.065063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.066063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.067331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.075954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:56.107871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.111485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.139501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5cac8-aac3-4c9b-9b79-085507bcf2fe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.162665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.163051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.163338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.163872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.166347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.168045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2125/4273] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:56.168900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.249852 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2149/4274] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:15:55 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:56.253927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.276465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2886d-bdf2-479d-916b-76a888b9b040 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.293676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.294339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.294660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.294996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.295675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.297493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.328476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2126/4275] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:56.332030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.343612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e119-85eb-496b-b7ac-92a9d2bb0f56 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.350538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.352781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.353291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.353771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] PATH_INFO: `/v3/projects/ec16fc5122c24614bfa84a768dd5835e/users/d9f7ddb156444b4ca14e96e2a06947b3/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.393348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec16fc5122c24614bfa84a768dd5835e, user_id=d9f7ddb156444b4ca14e96e2a06947b3, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.397744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.443858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2150/4276] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:56 2022] PUT /identity/v3/projects/ec16fc5122c24614bfa84a768dd5835e/users/d9f7ddb156444b4ca14e96e2a06947b3/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:56.444182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.456166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f09ad-389c-4589-b88e-18b92146d372 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.538319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.539027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.539420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.539801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.540590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.543209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ed0f9-4955-4a71-9216-1f38d5fbd3d4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.559213 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2127/4277] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:15:56.560466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.576713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c983-fc85-44df-8b3b-f09c1c19dd41 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.583393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.584587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.585094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.585375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] PATH_INFO: `/v3/projects/ec16fc5122c24614bfa84a768dd5835e/users/d9f7ddb156444b4ca14e96e2a06947b3/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.588168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec16fc5122c24614bfa84a768dd5835e, user_id=d9f7ddb156444b4ca14e96e2a06947b3, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.592454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.618662 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2151/4278] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:15:56 2022] PUT /identity/v3/projects/ec16fc5122c24614bfa84a768dd5835e/users/d9f7ddb156444b4ca14e96e2a06947b3/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:56.619392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da935d-6861-44c8-be28-994f33465c21 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.620412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da935d-6861-44c8-be28-994f33465c21 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.620604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da935d-6861-44c8-be28-994f33465c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.672572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-40da935d-6861-44c8-be28-994f33465c21 None None] MFA Rules not processed for user `d9f7ddb156444b4ca14e96e2a06947b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:56.675291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-40da935d-6861-44c8-be28-994f33465c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:56.783775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2128/4279] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:15:56.788782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.807722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcd68f-4d7c-4446-be31-5ca59d825774 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.814999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.815991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.816491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.817063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.818036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.819996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.855093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2152/4280] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:56 2022] POST /identity/v3/services => generated 288 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:56.855396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da935d-6861-44c8-be28-994f33465c21 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.865784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da935d-6861-44c8-be28-994f33465c21 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.882670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.883425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.883868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.884151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.884816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.886606 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:56.886606 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:15:56.886606 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:15:56.887591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.902303 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2129/4281] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 25 01:15:56 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:56.909787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.925968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c94655-862d-4f47-b7e3-b5fdebd505a9 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.931407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.933240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.933881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:56.934223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:56.934960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:56.936673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:56.956316 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2153/4282] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:56 2022] POST /identity/v3/services => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:56.961141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:56.973364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4371-719c-4679-bc12-0ecbb159cdfb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:56.995238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:56.999467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:56.999976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.000816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.001435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.003127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.019102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.020901 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2130/4283] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 25 01:15:56 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:57.038827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8e06-5617-40d5-ab72-144ab6506efa tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.047648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.048422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.049000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.049348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.050243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.051506 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.051506 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:57.051506 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:57.052576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.064986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2154/4284] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:15:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:57.066380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.082550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e817ba-0332-4603-bc9d-a1e780cddf68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.089468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.090264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.090668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.091057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.091794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e698bcf7379d45df8262860347945337)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.092921 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.092921 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:15:57.092921 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:15:57.094326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.101456 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2131/4285] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 25 01:15:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337 => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:15:57.107478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.123321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ade7-144c-4b20-82bc-aa383e3f740d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.128472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.129125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.129716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.130140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.130750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e698bcf7379d45df8262860347945337)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.131773 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.131773 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:57.131773 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:57.132670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.144238 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2155/4286] 10.222.0.16 () {58 vars in 1291 bytes} [Sun Sep 25 01:15:57 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 25 01:15:57.145937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.181875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78516e3e-12ba-4348-8e44-f01d7559a684 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.187923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.188590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.188780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.189218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.189752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e698bcf7379d45df8262860347945337)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.191104 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.191104 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:15:57.191104 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:15:57.192055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.195622 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:57.212065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2132/4287] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.216587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.232047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01fb9-e30b-4d3c-8284-bdce45403f13 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.237754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.238416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.238704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.238984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.239611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.241838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.243961 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:57.252274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2156/4288] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:15:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:57.254457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.280366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba50fc1-048f-4b69-acc8-3a1b47280f68 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.287295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.288011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.288356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.288638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.289344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e698bcf7379d45df8262860347945337)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.291688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Could not find Endpoint Group: e698bcf7379d45df8262860347945337.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e698bcf7379d45df8262860347945337. Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Sep 25 01:15:57.317355 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e698bcf7379d45df8262860347945337. Sep 25 01:15:57.318718 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:15:57.323546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2133/4289] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e698bcf7379d45df8262860347945337 => generated 120 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:15:57.325631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.340762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ad7c1-f9dd-4465-a512-b506b79ed560 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.360831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.361955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.362442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.362951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services/63972a3419084bca86167248a437a803` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.363817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_service(service_id=63972a3419084bca86167248a437a803)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.366773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.440629 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2157/4290] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/services/63972a3419084bca86167248a437a803 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.442421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.455094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2bc86-dbbe-4edc-af96-32e1f6f804eb tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.476743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.477692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.478208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.478587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.479622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.482137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.507882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2134/4291] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:57 2022] POST /identity/v3/services => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:57.509566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.524304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a62-4e1a-4455-b461-6e76b4ffb5bf tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.542924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.544000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.544449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.544890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.545762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.547189 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.547189 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:57.547189 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:57.548484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.566697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.574883 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2158/4292] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 25 01:15:57 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:57.582459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137829d-b32b-43bb-a8ee-a36495c68acd tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.592007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.593808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.594523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.595011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.596224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.598421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.626750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2135/4293] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:15:57 2022] POST /identity/v3/services => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:15:57.628941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.643941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740487-93db-4569-b24f-bdcd0934da65 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.666637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.667525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.667936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.668318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93787f02d77549b4b10d050370fda632` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.669143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=93787f02d77549b4b10d050370fda632)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.670735 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.670735 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:57.670735 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:57.671989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.693961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.704780 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2159/4294] 10.222.0.16 () {60 vars in 1313 bytes} [Sun Sep 25 01:15:57 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/93787f02d77549b4b10d050370fda632 => generated 335 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:15:57.709463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edca6b-17f0-423d-911f-0b82fdea44b0 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.722845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.724778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.727774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.728342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services/48ae68f3b18a4e858b39399708e06ee4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.732549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_service(service_id=48ae68f3b18a4e858b39399708e06ee4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.735474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.795121 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2136/4295] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/services/48ae68f3b18a4e858b39399708e06ee4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.796953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.811967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11baef-42a7-495c-a90e-604df7907938 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.829658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.830304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.830577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.831034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93787f02d77549b4b10d050370fda632` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.835254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=93787f02d77549b4b10d050370fda632)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.836650 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:15:57.836650 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:15:57.836650 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:15:57.838223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.852739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2160/4296] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/93787f02d77549b4b10d050370fda632 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.856881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.875953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69be52-54c8-4e04-b710-a214d307518d tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.882408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.883298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.883585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.883855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services/65949cc1104f4ee9993fd10772447fe1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.884441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_service(service_id=65949cc1104f4ee9993fd10772447fe1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.888696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.922780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2137/4297] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/services/65949cc1104f4ee9993fd10772447fe1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.924297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:57.939099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3048b-a418-4f7b-b75a-a1075290005c tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:57.960839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:57.961691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:57.962061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:57.962457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5240bebe52a442039b363786de0623d8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:57.963112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5240bebe52a442039b363786de0623d8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:57.965818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:57.982475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2161/4298] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5240bebe52a442039b363786de0623d8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:57.987079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:58.006048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9823-846c-44c2-a1db-bc445f2429b8 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:58.013535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f7ddb156444b4ca14e96e2a06947b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec16fc5122c24614bfa84a768dd5835e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:58.014259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:58.014604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:58.015421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] PATH_INFO: `/v3/services/21ca7135fd894f99b30b7926e42d065a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:58.016254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorizing `identity:delete_service(service_id=21ca7135fd894f99b30b7926e42d065a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:58.018335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb94e25-f9f2-4d99-be3b-75b8f9674499 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:58.054488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2138/4299] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:15:57 2022] DELETE /identity/v3/services/21ca7135fd894f99b30b7926e42d065a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:58.059267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:58.217602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe4d2-605e-4aaa-8796-2a68bb437540 tempest-EndPointGroupsTest-1688149634 tempest-EndPointGroupsTest-1688149634-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:58.234290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:58.234943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:58.235228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:58.235507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] PATH_INFO: `/v3/users/8cbae4740b144dedb46bbb535c4241a6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:58.236685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbae4740b144dedb46bbb535c4241a6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:58.238694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:58.318502 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:58.339546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbae4740b144dedb46bbb535c4241a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:58.358781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbae4740b144dedb46bbb535c4241a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:58.396115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbae4740b144dedb46bbb535c4241a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:58.397794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbae4740b144dedb46bbb535c4241a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:58.399497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbae4740b144dedb46bbb535c4241a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:15:58.436985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2162/4300] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:15:58 2022] DELETE /identity/v3/users/8cbae4740b144dedb46bbb535c4241a6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:15:58.439276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:58.439566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:58.439841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:58.465639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:15:58.467462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:58.605959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2139/4301] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:15:58.658213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:15:58.660035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:15:58.877240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc06a-a694-44c0-a9a7-46ab2ad5cc54 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:15:58.887340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:15:58.888166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:15:58.888521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:15:58.888949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:15:58.905821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:15:58.908661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:15:58.927925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2163/4302] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:01.089987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:01.091574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:01.097569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:01.099148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:01.116142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dd53-0139-4c62-bd8e-6fd01c8367d0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:01.121880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c31d8-2bba-433d-aea8-304e7cda6fa1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:01.137554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:01.138485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:01.138983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:01.139420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] PATH_INFO: `/v3/projects/61d9b79667794a6a85ed0a4a8ac0d638` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:01.140758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d9b79667794a6a85ed0a4a8ac0d638)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:01.142113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:01.142909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:01.143132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:01.143407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] PATH_INFO: `/v3/users/e21a877f17db40c0a226b54049f73ed0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:01.144049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:01.147752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21a877f17db40c0a226b54049f73ed0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:01.150013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:01.227119 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:01.240040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d9b79667794a6a85ed0a4a8ac0d638', 'request_id': 'req-2ffadcc9-eb21-462d-9386-f0f738bbef59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.247502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21a877f17db40c0a226b54049f73ed0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.247762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d9b79667794a6a85ed0a4a8ac0d638', 'request_id': 'req-2ffadcc9-eb21-462d-9386-f0f738bbef59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.248635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21a877f17db40c0a226b54049f73ed0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.259645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21a877f17db40c0a226b54049f73ed0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.263339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d9b79667794a6a85ed0a4a8ac0d638', 'request_id': 'req-2ffadcc9-eb21-462d-9386-f0f738bbef59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.282269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] The token cache is being invalidate because project 61d9b79667794a6a85ed0a4a8ac0d638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:01.282569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.283821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.287443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2164/4303] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:01 2022] DELETE /identity/v3/projects/61d9b79667794a6a85ed0a4a8ac0d638 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:01.292539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:01.293636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:01.311025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21a877f17db40c0a226b54049f73ed0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.313702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9a9575a0-a75d-4488-8d6e-a98c34e47430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21a877f17db40c0a226b54049f73ed0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.345761 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2140/4304] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:01 2022] DELETE /identity/v3/users/e21a877f17db40c0a226b54049f73ed0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:01.347734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:01.348022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:01.348295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:01.395729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:01.399760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:01.430050 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:01.495483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadcc9-eb21-462d-9386-f0f738bbef59 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:01.527368 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2141/4305] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:01.537763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:01.542667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:01.596126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:01.597136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:01.597645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:01.598116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] PATH_INFO: `/v3/users/d9f7ddb156444b4ca14e96e2a06947b3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:01.601188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f7ddb156444b4ca14e96e2a06947b3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:01.603498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:01.690920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa67ed-d1ba-4f56-813f-53f8615058cf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:01.705919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f7ddb156444b4ca14e96e2a06947b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.709714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:01.710737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:01.711025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:01.715824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:01.726012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f7ddb156444b4ca14e96e2a06947b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.739523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:01.741264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:01.760307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f7ddb156444b4ca14e96e2a06947b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.762208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f7ddb156444b4ca14e96e2a06947b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.762971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b98b71b2-cd27-48a1-851f-52bf562731e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f7ddb156444b4ca14e96e2a06947b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:01.764074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2142/4306] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:16:01.785582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2165/4307] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:01 2022] DELETE /identity/v3/users/d9f7ddb156444b4ca14e96e2a06947b3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:02.074470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:02.076098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:02.101664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15444b-9fc9-44d7-92f9-69202263ab92 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:02.203845 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:02.230908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:02.231584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:02.231852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:02.232127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] PATH_INFO: `/v3/projects/05f7754e4ccb4b4da87d15a8b9b78887` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:02.234178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f7754e4ccb4b4da87d15a8b9b78887)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:02.236334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:02.321081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f7754e4ccb4b4da87d15a8b9b78887', 'request_id': 'req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:02.332906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f7754e4ccb4b4da87d15a8b9b78887', 'request_id': 'req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:02.342930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f7754e4ccb4b4da87d15a8b9b78887', 'request_id': 'req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:02.371566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] The token cache is being invalidate because project 05f7754e4ccb4b4da87d15a8b9b78887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:02.372405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:02.374372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ae9ad5da-f680-4479-ba5b-6a8fad806ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:02.378284 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2143/4308] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:02 2022] DELETE /identity/v3/projects/05f7754e4ccb4b4da87d15a8b9b78887 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:02.383876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:02.384402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:02.384567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:02.437843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:02.444558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:02.610785 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:02.654016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2166/4309] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:02.657241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:02.658024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:02.658474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:02.745280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:02.756632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:02.779980 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2144/4310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:02.784008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:02.801765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1bee4-8181-4d19-88e9-b6ed2c1e6027 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:02.817160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:02.817991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:02.819116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:02.823973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:02.824915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:02.825328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:02.827134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:02.863637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2167/4311] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:02.864974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:02.876902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba89e-2a17-4934-9dee-93531356a459 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:02.889921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:02.891016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:02.891396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:02.894505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:02.895323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:02.897489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:02.977561 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2145/4312] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:02 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:02.979636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:02.992257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f326c-1e4b-4521-a463-07d465c4e37d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:03.111434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:03.112953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.113238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.113548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.114906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:03.118756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:03.161488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2168/4313] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:02 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:03.162775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:03.187242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45921e8b-a764-48db-b7fa-15459f644b6e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:03.200865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:03.201533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.201811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.202085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.202967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:03.204330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:03.219554 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2146/4314] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:03.220803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:03.233571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f59ba-5915-4703-9727-4a41e698c5a9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:03.238863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:03.239627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.240003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.240391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.241149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:03.254994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08472cf-b651-49c6-851b-fd4c07dc937e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:03.280987 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2169/4315] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:03.285219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:03.299407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f3aa-0927-4b17-a012-c88890eaec67 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:03.304839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:03.305900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.306321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.309377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] PATH_INFO: `/v3/projects/f77abfdfb5204656a54210ed2c7a0a30/users/be2f64cb4feb4b03a269e15ea3b2e0e0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.334416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77abfdfb5204656a54210ed2c7a0a30, user_id=be2f64cb4feb4b03a269e15ea3b2e0e0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:03.340610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:03.367630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2147/4316] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:03 2022] PUT /identity/v3/projects/f77abfdfb5204656a54210ed2c7a0a30/users/be2f64cb4feb4b03a269e15ea3b2e0e0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:03.377826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.378828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.379201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.445352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] MFA Rules not processed for user `be2f64cb4feb4b03a269e15ea3b2e0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:03.447177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:03.607928 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2170/4317] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:03.620013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:03.623437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:03.747094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cc1d6-ad42-404f-b8cd-04fc100451e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:03.756673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:03.757696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:03.757828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:03.758037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:03.777531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:03.779194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a66c-4639-43bc-af97-a10febedb999 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:03.793556 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2148/4318] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:04.068436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:04.069971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:04.208258 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:04.220349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3e52a-82f1-497a-82c3-a8dfda0b11aa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:04.240855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:04.241597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:04.242040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:04.242324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] PATH_INFO: `/v3/projects/ec16fc5122c24614bfa84a768dd5835e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:04.246435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec16fc5122c24614bfa84a768dd5835e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:04.252138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:04.363928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec16fc5122c24614bfa84a768dd5835e', 'request_id': 'req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:04.374075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec16fc5122c24614bfa84a768dd5835e', 'request_id': 'req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:04.380385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec16fc5122c24614bfa84a768dd5835e', 'request_id': 'req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:04.405990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] The token cache is being invalidate because project ec16fc5122c24614bfa84a768dd5835e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:04.406297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:04.407028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d3742c9c-d698-47e0-bc1e-8ff8eb3da38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:04.414055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2171/4319] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:04 2022] DELETE /identity/v3/projects/ec16fc5122c24614bfa84a768dd5835e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:04.415723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:04.416638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:04.417183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:04.460502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:04.462449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:04.512317 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:04.609614 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2149/4320] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:04.618988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:04.620017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:04.620302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:04.677874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:04.680303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:04.692978 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2172/4321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:04.697240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:04.726934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a438e3-b819-46b4-9945-3efa41833986 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:04.758495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:04.759141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:04.759607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:04.760132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:04.760857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:04.761235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:04.766284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:04.805632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2150/4322] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:04.806879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:04.825548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e468b3-1ad3-4bcc-b9a9-6c928aa674c0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:04.832604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:04.833242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:04.833550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:04.833824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:04.834484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:04.836427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:04.892060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2173/4323] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:04 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:04.896065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:04.910898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51e12-b3e8-4c0c-9211-602fb7dd70bf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.069985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.072160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:05.089545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.090176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.090460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.090746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.091384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.098044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.144654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2151/4324] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:04 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:05.149147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.170464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159b08-339e-47c4-b927-5c0ed9b11678 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.177607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.178626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.179218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.180517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.182393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.184703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.193777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef2dc-dd52-442e-8627-9b2e63bc8261 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.210024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2152/4325] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:16:05.210616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.211298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.211585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.211863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] PATH_INFO: `/v3/users/907d7867b6484e6c9470ffc137e98a91` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.212401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.222317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907d7867b6484e6c9470ffc137e98a91)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.224297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.228259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70a0c-dbe1-4930-900d-93ea9ad95cf6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.241034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.243061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.243758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.245825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.246925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.250157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.266781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2153/4326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:05.271929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.299880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485222-a367-4133-b1b9-9d34552c753f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.307211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.308264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.308816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.309345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] PATH_INFO: `/v3/projects/8ace48e883c14c9090c1fa62f85ccaf8/users/e172546e199b4048b5761f783a1e5752/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.321187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907d7867b6484e6c9470ffc137e98a91'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:05.337031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907d7867b6484e6c9470ffc137e98a91'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:05.342346 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:05.344393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ace48e883c14c9090c1fa62f85ccaf8, user_id=e172546e199b4048b5761f783a1e5752, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.354946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c94f3-8d4b-4a69-b904-93d81792b25e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.373217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907d7867b6484e6c9470ffc137e98a91'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:05.379422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907d7867b6484e6c9470ffc137e98a91'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:05.380884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-57b11407-5248-47b3-9737-a4a144af6142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907d7867b6484e6c9470ffc137e98a91'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:05.383683 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2154/4327] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:05 2022] PUT /identity/v3/projects/8ace48e883c14c9090c1fa62f85ccaf8/users/e172546e199b4048b5761f783a1e5752/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:05.396594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.397104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.397811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.410173 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2174/4328] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:05 2022] DELETE /identity/v3/users/907d7867b6484e6c9470ffc137e98a91 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:05.414367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.414367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.414367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.460546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:05.461853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] MFA Rules not processed for user `e172546e199b4048b5761f783a1e5752`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:05.463518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:05.466874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:05.605963 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:05.631781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2175/4329] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:05.644916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.646610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:05.659107 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2155/4330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:05.664905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.669513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:05.718686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794373-1c3d-4566-a341-26949aa112d5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.726894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.727961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.728408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.730441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.732614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.737206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.772055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349c32-177b-4fe9-9d85-94efbbe0ceef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.777574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.778457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.779040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.779466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.782563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2156/4331] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:05 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:05.789053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:05.796223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.797959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:05.809544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2176/4332] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:16:05.959418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292b403-bd45-42d5-93d2-85a323e91e0d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:05.968228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:05.969537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:05.969537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:05.969880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:05.970872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:05.973607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.012172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.022972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2157/4333] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:05 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:06.026307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eef55c-ef75-499e-827c-30834d8c087b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.033283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.034211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.034601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.034978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.035925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.038554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.062005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.069304 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2177/4334] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:06.073773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29946a-a549-4788-92c9-76ef7ec4c1aa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.081705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.082440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.082801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.083050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] PATH_INFO: `/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328/users/1481c29ca88841c5a6c459c8636a9862/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.107748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8c4b9d7d1c45cea4dba21cfaf55328, user_id=1481c29ca88841c5a6c459c8636a9862, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.111769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.131766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2158/4335] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:06 2022] PUT /identity/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328/users/1481c29ca88841c5a6c459c8636a9862/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:06.136893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.158219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33ff7-3b88-4c21-b803-543510db5655 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.227837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.230170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:06.264667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.265737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.266263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.266692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.267406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.269557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.286424 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2178/4336] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:06.287443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.294337 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:06.299404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16a8ee-60c3-44b4-a3d0-85bbf7563201 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.306151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.307237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.307713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.308154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] PATH_INFO: `/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328/users/1481c29ca88841c5a6c459c8636a9862/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.310650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8c4b9d7d1c45cea4dba21cfaf55328, user_id=1481c29ca88841c5a6c459c8636a9862, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.313522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205843a-6fd4-4f07-bd09-7430b5354a41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.337464 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2179/4337] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:06 2022] PUT /identity/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328/users/1481c29ca88841c5a6c459c8636a9862/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:06.340551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.341042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.341631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.360052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3188a0-5776-4490-acae-f991fc0def32 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.382295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] MFA Rules not processed for user `1481c29ca88841c5a6c459c8636a9862`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:06.384032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:06.439953 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:06.497573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.500365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.501607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.503254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] PATH_INFO: `/v3/projects/936e54ee92b84e5c96db824056728d1a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.506082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936e54ee92b84e5c96db824056728d1a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.513621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.558057 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2180/4338] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:06.561458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.576480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c263a-8882-48ff-9244-b17ebd760b8b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.582002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.582622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.582907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.583609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.586075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.589147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.642271 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2181/4339] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/projects => generated 334 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:06.644249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.667509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936e54ee92b84e5c96db824056728d1a', 'request_id': 'req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:06.684781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936e54ee92b84e5c96db824056728d1a', 'request_id': 'req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:06.693447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936e54ee92b84e5c96db824056728d1a', 'request_id': 'req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:06.720753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] The token cache is being invalidate because project 936e54ee92b84e5c96db824056728d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:06.721075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:06.721810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb9f33fd-4dec-42c1-8037-c1c405fcb0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:06.727518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2159/4340] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:06 2022] DELETE /identity/v3/projects/936e54ee92b84e5c96db824056728d1a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:06.729103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449c62-a770-4495-88eb-a0fb44b0c28f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.729505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449c62-a770-4495-88eb-a0fb44b0c28f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.729844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449c62-a770-4495-88eb-a0fb44b0c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.751282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b715e-41b8-41b6-b52c-0820021bb70c tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.756249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e7449c62-a770-4495-88eb-a0fb44b0c28f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:06.757480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.758089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7449c62-a770-4495-88eb-a0fb44b0c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:06.758951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.759502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.760637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.761489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:06.763916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:06.820093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2182/4341] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/projects => generated 332 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:06.821963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:06.831570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:06.890334 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2160/4342] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:06.892119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.892690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.892971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.920744 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:06.934913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:06.935709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:06.975759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee5a62-5f56-49fc-9c13-572927b293d4 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:06.990432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:06.991135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:06.991428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:06.991704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:06.995572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.009475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.023413 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2161/4343] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:07.028170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.043881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b4a6-2628-4477-b6a0-958a2d46819e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.050357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.051511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.051800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.052080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.052752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:07.054640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.056460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.059079 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:07.077705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2162/4344] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:07.078887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.091997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb166-1c9d-475a-b5e3-0a38a65b1df8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.097350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.098124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.098406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.098680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.099313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.101180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2183/4345] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:06 2022] POST /identity/v3/projects => generated 357 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:07.101318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.118289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.145252 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2163/4346] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:07 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:07.148329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.222898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9b31-f77c-421c-a9ef-990fec89030e tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.298260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921b1f-e536-4eef-95cb-ab5eb1e22bfa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.304656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.305422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.305785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.306139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.307155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.310110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.311856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.312830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.313194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.313582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.314319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.317252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.342960 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2164/4347] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:07 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:07.347893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.348267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2184/4348] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/projects => generated 7208 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:07.352787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.361769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f138-555f-403d-b352-90649de4b697 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.368369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.369304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.369676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.370022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.370877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.372585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.373534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77dcd-a0de-465f-8a2f-278f91a4f29a tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.396149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.399266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2165/4349] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:07.399684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.399985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.400268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.401562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:07.401878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.403778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.403926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.424462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311ae6-85cc-40cf-8add-c1627b19cc51 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.438276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.438625 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2185/4350] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:07.439865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.441803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.442193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.443413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.444774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.449528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.468464 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2166/4351] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:16:07.472218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7806fc-2f30-43fc-8456-509495799cd5 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.474936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.483097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.483731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.484054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.484293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.484982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Adding query filter params (parent_id=0b78ab52181446b0bee47933e128e0c7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:07.485292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.487213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.489584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8feefe-a790-43e8-90bd-b32980ceac80 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.496594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.497528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.498167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.498755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] PATH_INFO: `/v3/projects/512a9166d806477ab93d8eed468bab93/users/996dbc72936a46fda11429f9f8438100/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.521852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512a9166d806477ab93d8eed468bab93, user_id=996dbc72936a46fda11429f9f8438100, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.526803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fecda-af7e-44c1-9508-4f3720a61904 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.534465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2186/4352] 10.222.0.16 () {58 vars in 1216 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/projects?parent_id=0b78ab52181446b0bee47933e128e0c7 => generated 497 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:07.537357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.547736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2167/4353] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:07 2022] PUT /identity/v3/projects/512a9166d806477ab93d8eed468bab93/users/996dbc72936a46fda11429f9f8438100/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:07.552938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.553215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.553528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.561993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d68f-1f66-4063-9ec8-e6e5d261c5ff tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:07.575992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:07.577209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:07.632656 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:07.723738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:07.724511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:07.724718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:07.724969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects/2679cbf4299341c49d07710edd0f9228` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:07.727224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2679cbf4299341c49d07710edd0f9228)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:07.731145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:07.787122 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2168/4354] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:07.829555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.831322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:07.871932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2679cbf4299341c49d07710edd0f9228', 'request_id': 'req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:07.875693 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:07.892359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2679cbf4299341c49d07710edd0f9228', 'request_id': 'req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:07.911123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2679cbf4299341c49d07710edd0f9228', 'request_id': 'req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:07.927775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] The token cache is being invalidate because project 2679cbf4299341c49d07710edd0f9228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:07.928116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:07.930183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:07.931472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2187/4355] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:07 2022] DELETE /identity/v3/projects/2679cbf4299341c49d07710edd0f9228 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:07.935441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:07.937218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:07.984830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53f42-8c60-433b-ae88-596c149b1323 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:08.034320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8c10-3dd0-48c1-bdfc-fdf78bb9cc37 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:08.045368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:08.046362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:08.047007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:08.047379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects/0b78ab52181446b0bee47933e128e0c7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:08.049669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b78ab52181446b0bee47933e128e0c7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:08.052460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:08.110410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:08.111724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:08.112464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:08.113040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:08.115846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:08.151899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b78ab52181446b0bee47933e128e0c7', 'request_id': 'req-82890bcd-d787-4e2b-903b-5acdb4908e78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.174369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b78ab52181446b0bee47933e128e0c7', 'request_id': 'req-82890bcd-d787-4e2b-903b-5acdb4908e78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.195017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b78ab52181446b0bee47933e128e0c7', 'request_id': 'req-82890bcd-d787-4e2b-903b-5acdb4908e78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.202519 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:08.227397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] The token cache is being invalidate because project 0b78ab52181446b0bee47933e128e0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:08.227696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.230839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.237600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2188/4356] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:07 2022] DELETE /identity/v3/projects/0b78ab52181446b0bee47933e128e0c7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:08.241261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:08.243068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:08.290458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:08.292243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:08.317886 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2169/4357] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:08.440302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82890bcd-d787-4e2b-903b-5acdb4908e78 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:08.464357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1481c29ca88841c5a6c459c8636a9862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:08.465209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:08.465535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:08.465821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] PATH_INFO: `/v3/projects/2ed9d5fe6c2f4aadbd9bb2f389c022fb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:08.468698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ed9d5fe6c2f4aadbd9bb2f389c022fb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:08.470719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:08.609218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed9d5fe6c2f4aadbd9bb2f389c022fb', 'request_id': 'req-a72668ae-41a9-4d1f-a15e-553de8ecb656'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.652745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed9d5fe6c2f4aadbd9bb2f389c022fb', 'request_id': 'req-a72668ae-41a9-4d1f-a15e-553de8ecb656'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.667977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed9d5fe6c2f4aadbd9bb2f389c022fb', 'request_id': 'req-a72668ae-41a9-4d1f-a15e-553de8ecb656'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.707503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] The token cache is being invalidate because project 2ed9d5fe6c2f4aadbd9bb2f389c022fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:08.707639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.724614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a72668ae-41a9-4d1f-a15e-553de8ecb656 tempest-ListProjectsTestJSON-1256092333 tempest-ListProjectsTestJSON-1256092333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:08.727702 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2189/4358] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:08 2022] DELETE /identity/v3/projects/2ed9d5fe6c2f4aadbd9bb2f389c022fb => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:08.732261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:08.734659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:08.754945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60f4d-9aaf-4c5e-9354-8780b3a03521 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:08.890897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:08.890897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:08.891231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:08.891593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] PATH_INFO: `/v3/users/e172546e199b4048b5761f783a1e5752` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:08.894313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e172546e199b4048b5761f783a1e5752)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:08.896402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:08.952697 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:09.009012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e172546e199b4048b5761f783a1e5752'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:09.010913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e172546e199b4048b5761f783a1e5752'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:09.029675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e172546e199b4048b5761f783a1e5752'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:09.066921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e172546e199b4048b5761f783a1e5752'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:09.068533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e172546e199b4048b5761f783a1e5752'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:09.107431 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2170/4359] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:08 2022] DELETE /identity/v3/users/e172546e199b4048b5761f783a1e5752 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:09.112092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:09.112924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:09.112924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:09.146596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:09.148876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:09.283345 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2190/4360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:09.406522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:09.408341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:09.645437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91812-fa33-44a8-b855-0ada09d24bf8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:09.659352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:09.660073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:09.660274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:09.660550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:09.686984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:09.688576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:09.732059 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2171/4361] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:09.886138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:09.888759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:09.908369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8239f-b188-40c9-963e-dfb0713418b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:09.922564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:09.925059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:09.925715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:09.926212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:09.929655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:09.964410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:09.971529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:09.986691 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2191/4362] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:11.297024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:11.299225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:11.326694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952db93-4812-422e-85af-79bb42aeca85 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:11.333894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:11.334599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:11.335050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:11.335306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] PATH_INFO: `/v3/projects/8ace48e883c14c9090c1fa62f85ccaf8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:11.343037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ace48e883c14c9090c1fa62f85ccaf8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:11.346385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:11.456202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ace48e883c14c9090c1fa62f85ccaf8', 'request_id': 'req-e881de5d-7863-4f89-8a9d-470260a9efd9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.478158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ace48e883c14c9090c1fa62f85ccaf8', 'request_id': 'req-e881de5d-7863-4f89-8a9d-470260a9efd9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.485760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ace48e883c14c9090c1fa62f85ccaf8', 'request_id': 'req-e881de5d-7863-4f89-8a9d-470260a9efd9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.509593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] The token cache is being invalidate because project 8ace48e883c14c9090c1fa62f85ccaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:11.510506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.521957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.523721 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2172/4363] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:11 2022] DELETE /identity/v3/projects/8ace48e883c14c9090c1fa62f85ccaf8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:11.528546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:11.546034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca407-3e85-4456-aa5e-1a84af3d197d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:11.566721 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:11.640258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:11.641461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:11.642138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:11.642652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] PATH_INFO: `/v3/users/1481c29ca88841c5a6c459c8636a9862` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:11.644930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1481c29ca88841c5a6c459c8636a9862)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:11.648995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:11.724088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1481c29ca88841c5a6c459c8636a9862'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.738310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1481c29ca88841c5a6c459c8636a9862'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.774431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1481c29ca88841c5a6c459c8636a9862'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.776175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1481c29ca88841c5a6c459c8636a9862'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.777076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13dc061-c60a-49c3-9b11-8b30eda8e45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1481c29ca88841c5a6c459c8636a9862'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:11.811165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2192/4364] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:11 2022] DELETE /identity/v3/users/1481c29ca88841c5a6c459c8636a9862 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:13.646916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:13.649193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:13.668127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881de5d-7863-4f89-8a9d-470260a9efd9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:13.754460 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:13.858003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:13.859790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:13.860343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:13.860842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] PATH_INFO: `/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:13.864254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8c4b9d7d1c45cea4dba21cfaf55328)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:13.868652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.039190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'request_id': 'req-52ae8437-36b8-42f5-a319-81444ef96f1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:14.066456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'request_id': 'req-52ae8437-36b8-42f5-a319-81444ef96f1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:14.093210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8c4b9d7d1c45cea4dba21cfaf55328', 'request_id': 'req-52ae8437-36b8-42f5-a319-81444ef96f1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:14.118443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] The token cache is being invalidate because project 4a8c4b9d7d1c45cea4dba21cfaf55328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:14.119116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:14.121775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-52ae8437-36b8-42f5-a319-81444ef96f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:14.129578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.130062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2173/4365] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:13 2022] DELETE /identity/v3/projects/4a8c4b9d7d1c45cea4dba21cfaf55328 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:14.130527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.130961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.187942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:14.189191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:14.299935 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2193/4366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:14.307426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.307757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.308036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.344920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:14.346393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:14.357261 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2174/4367] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:14.362416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.374318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33b9a-0ac8-4988-8379-bb8c51ea8777 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.381553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.382360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.382766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.383152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.388230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:14.388230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.388230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.403929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2194/4368] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:14.408253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.433619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213d201-3e30-43d1-a8c0-0c74a59e5e6c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.440685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.441576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.441973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.442358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.443124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.445239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.487184 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2175/4369] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:14 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:14.490962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.505087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa64a7-1588-41a3-8f0f-a21b7502f1b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.524591 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:14.605354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.608594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.608892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.609171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.610251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.612228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.659487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2195/4370] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:14 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:14.664360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.678447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05de1a-fb75-4278-9565-c2dd9ea3ab6c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.686175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.687257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.688042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.688466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.692100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.694378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.713570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2176/4371] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:14.720728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.748288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532dae-5aec-47de-9ae0-c2976a5d4b42 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.764606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.767439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.767884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.768581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.771694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.775355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36e44-2bce-43cb-9a93-362aa9d2a1d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.804329 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2196/4372] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:14.808303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:14.837595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8fd6e-b9ed-4373-b69b-47051e585eec admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:14.852263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:14.853846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.855707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.856304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] PATH_INFO: `/v3/projects/556499ebf79542ef8a1f71ca96c88418/users/f3de0b8b0174488a86b5db8cf0def2a4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:14.909861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556499ebf79542ef8a1f71ca96c88418, user_id=f3de0b8b0174488a86b5db8cf0def2a4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:14.915089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:14.975829 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2177/4373] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:14 2022] PUT /identity/v3/projects/556499ebf79542ef8a1f71ca96c88418/users/f3de0b8b0174488a86b5db8cf0def2a4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:14.986483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:14.987008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:14.987962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:15.066095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] MFA Rules not processed for user `f3de0b8b0174488a86b5db8cf0def2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:15.067409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:15.282480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2197/4374] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:15.284365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:15.502010 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:15.536658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f743-d4dc-47af-9a6e-84a3b6821445 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:15.549928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:15.550573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:15.550855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:15.551125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:15.554137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:15.560517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:15.626856 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2178/4375] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:15 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:15.630018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:15.651253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3f879-c824-4bce-8857-195fd566a28f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:15.818497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:15.820207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:15.820799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:15.821248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:15.822272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:15.826522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:15.891699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2198/4376] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:15 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:15.895294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:15.928471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ece5-ffeb-4125-a214-32e071a4f413 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:15.937531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:15.938562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:15.939068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:15.939724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:15.940535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:15.942947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:15.970557 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2179/4377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:15.974497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.001113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b18f-b78b-4fa2-a287-0d5737061a9d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.020470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.021495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.022445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.022847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] PATH_INFO: `/v3/projects/ae867f75098342e088a2b22f42b12914/users/9590c371f22c4adeaade2ff7483705f8/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.057982 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:16.065313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae867f75098342e088a2b22f42b12914, user_id=9590c371f22c4adeaade2ff7483705f8, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.070552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.110344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2199/4378] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:15 2022] PUT /identity/v3/projects/ae867f75098342e088a2b22f42b12914/users/9590c371f22c4adeaade2ff7483705f8/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:16.114081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.131337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fdc0-0dfb-463b-99fd-6ff83ab24041 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.279859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.283102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.283395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.283744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.284413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.288648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93cb64-1ffe-4ad9-bd81-f9f661f2b1da admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.312257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2180/4379] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:16.316223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.338627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07fb6-f8b0-4442-9e6b-efa8351ccd15 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.362516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.363526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.364936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.365925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] PATH_INFO: `/v3/projects/ae867f75098342e088a2b22f42b12914/users/9590c371f22c4adeaade2ff7483705f8/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.374602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae867f75098342e088a2b22f42b12914, user_id=9590c371f22c4adeaade2ff7483705f8, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.379343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.452252 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2200/4380] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:16 2022] PUT /identity/v3/projects/ae867f75098342e088a2b22f42b12914/users/9590c371f22c4adeaade2ff7483705f8/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:16.453974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.454264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.454542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.506561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] MFA Rules not processed for user `9590c371f22c4adeaade2ff7483705f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:16.507937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:16.682208 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2181/4381] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:16.688587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.703893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d08b-7260-43ad-a8d8-a0f559ce0da0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.709137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.710089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.710957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.718010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.719624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.721012 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:16.721012 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:16.721012 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:16.722343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.760301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.764765 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2201/4382] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 25 01:16:16 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:16.789289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9bbe-d4ab-4766-9eaf-0a98fb1e98ba None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.808356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.809892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.810706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.812506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1515aa0fdf5b4918ae8acb18404dd053` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.813309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1515aa0fdf5b4918ae8acb18404dd053)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.816993 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:16.816993 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:16.816993 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:16.818242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.841358 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2182/4383] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:16 2022] GET /identity/v3/OS-OAUTH1/consumers/1515aa0fdf5b4918ae8acb18404dd053 => generated 221 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:16.843435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.854925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c28df4-81e1-4d76-98a2-3ba4584e27c6 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.861231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.862249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.862696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.863148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1515aa0fdf5b4918ae8acb18404dd053` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.863901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1515aa0fdf5b4918ae8acb18404dd053)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.865082 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:16.865082 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:16.865082 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:16.866439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:16.866901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer 1515aa0fdf5b4918ae8acb18404dd053 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:16.867340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:16.868243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:16.894782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1515aa0fdf5b4918ae8acb18404dd053', 'request_id': 'req-f9ebf33e-6f9b-4981-9076-a82217198a06'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:16.922310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2202/4384] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:16 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1515aa0fdf5b4918ae8acb18404dd053 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:16.923686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:16.926636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:16.955530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7457e2f-9de0-4d1c-9017-38cf9c7383fd tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:16.973105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:16.974100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:16.974528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:16.975063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:16.975873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:16.977035 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:16.977035 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:16.977035 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:16.978934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.009006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2183/4385] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 25 01:16:16 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:17.011668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.025630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf33e-6f9b-4981-9076-a82217198a06 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.047032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.048145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.048439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.049183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.050005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e44f9ca1d087446caf9609e964de1026)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.051048 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:17.051048 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:17.051048 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:17.051964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.074543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2203/4386] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:17 2022] GET /identity/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026 => generated 221 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:17.075303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.096803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe25b-7c48-456a-930b-a5b94bbc717f tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.112808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.113497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.113788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.114069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.114851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e44f9ca1d087446caf9609e964de1026)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.115950 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:17.115950 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:17.115950 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:17.118717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.119082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer e44f9ca1d087446caf9609e964de1026 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:17.119380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:17.122726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:17.207991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e44f9ca1d087446caf9609e964de1026', 'request_id': 'req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:17.227080 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:17.243905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2184/4387] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:17.245591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.247659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:17.281852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe81cc0-74fa-4742-b23a-a5542646db8a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.302977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.306014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.306902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.310385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.311519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e44f9ca1d087446caf9609e964de1026)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.320154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Sep 25 01:16:17.365522 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 25 01:16:17.366645 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:17.373775 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2204/4388] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:17 2022] GET /identity/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026 => generated 74 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:16:17.374334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.390419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f0789-b672-4cf1-bef2-c5aaf6051c6b tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.414293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.414741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.415042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.423065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.427034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e44f9ca1d087446caf9609e964de1026)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.431402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.431724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer e44f9ca1d087446caf9609e964de1026 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:17.431976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:17.444406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Sep 25 01:16:17.512462 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 25 01:16:17.513701 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:17.519156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.521096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2185/4389] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e44f9ca1d087446caf9609e964de1026 => generated 74 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:16:17.522354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:17.574626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e4ab-f1dd-4875-9693-2643badafe75 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.599918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.600559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.600847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.601132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.601824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.609502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.666955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.683099 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2205/4390] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 25 01:16:17 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:17.694565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d177c-7e3b-4449-961f-344270895cbc tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.713704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.719072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.719072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.719072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.722613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.724538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.802260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.817089 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2186/4391] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 25 01:16:17 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:17.845954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76385-2c5d-49c3-802e-2bc324a53bf7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:17.875925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:17.877749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:17.878234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:17.882903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:17.889631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:17.891551 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:17.891551 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:17.891551 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:17.904980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:17.945795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:17.965337 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2206/4392] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 25 01:16:17 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:17.985547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ae97-d7f0-4be0-b850-ee6d17c4783d tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.009885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.011406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.014031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.015513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/09242665c4ef4d4ca7eaedca701dddbf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.024842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=09242665c4ef4d4ca7eaedca701dddbf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.032677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.041526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer 09242665c4ef4d4ca7eaedca701dddbf has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:18.051449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.070218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.142869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '09242665c4ef4d4ca7eaedca701dddbf', 'request_id': 'req-94015c51-eddb-44a9-9280-c624315201d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.208200 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2187/4393] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:17 2022] DELETE /identity/v3/OS-OAUTH1/consumers/09242665c4ef4d4ca7eaedca701dddbf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:18.214855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.216658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:18.236140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3be3e-391c-44a0-9391-f91a2ef45d04 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.254226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.254888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.255167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.255450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f3932b33cd2d4d73bdfc5bb8c465f798` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.256051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f3932b33cd2d4d73bdfc5bb8c465f798)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.257858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.258145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer f3932b33cd2d4d73bdfc5bb8c465f798 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:18.258441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.260558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.285963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f3932b33cd2d4d73bdfc5bb8c465f798', 'request_id': 'req-4ffbde34-1515-4794-98fb-c33816209030'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.316045 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2207/4394] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:18 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f3932b33cd2d4d73bdfc5bb8c465f798 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:18.318502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.351374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015c51-eddb-44a9-9280-c624315201d7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.377600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.379174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.380093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.380867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.382371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.386138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.438063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.441433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:18.448396 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2188/4395] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 25 01:16:18 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:18.484132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbde34-1515-4794-98fb-c33816209030 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.505040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.506612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.507419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.508185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.511215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=a8d32c85918f483da174447377011660)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.512291 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:18.512291 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:18.512291 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:18.513215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.552161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2208/4396] 10.222.0.16 () {60 vars in 1285 bytes} [Sun Sep 25 01:16:18 2022] PATCH /identity/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660 => generated 220 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:18.559072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.593971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dcff-bb25-4064-b678-bcfb0ddc8f3a tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.608555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.609225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.609537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.609808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.610408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a8d32c85918f483da174447377011660)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.612032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.629507 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2189/4397] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:18 2022] GET /identity/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660 => generated 220 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:18.630729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.645687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec55-753b-43c1-b1b9-cd4eb13ae81c tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.668160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9590c371f22c4adeaade2ff7483705f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae867f75098342e088a2b22f42b12914', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.669790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.670574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.671497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.673084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a8d32c85918f483da174447377011660)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.685262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:18.685861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invalidating token cache because consumer a8d32c85918f483da174447377011660 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:18.687931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.690429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.731165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3c3e219d-ead6-4fd4-90be-0dec26668c34 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a8d32c85918f483da174447377011660', 'request_id': 'req-3c3e219d-ead6-4fd4-90be-0dec26668c34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:18.776699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2209/4398] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:18 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a8d32c85918f483da174447377011660 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:18.783632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:18.785594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:18.947412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cdb1-7b0e-469e-becd-81827136a3a7 tempest-OAUTHConsumersV3Test-1435978897 tempest-OAUTHConsumersV3Test-1435978897-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:18.952803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:18.953474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:18.953761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:18.954035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] PATH_INFO: `/v3/users/f3de0b8b0174488a86b5db8cf0def2a4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:18.963670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3de0b8b0174488a86b5db8cf0def2a4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:18.965997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:19.081876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3de0b8b0174488a86b5db8cf0def2a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:19.083021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3de0b8b0174488a86b5db8cf0def2a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:19.095205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3de0b8b0174488a86b5db8cf0def2a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:19.112366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3de0b8b0174488a86b5db8cf0def2a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:19.113365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3de0b8b0174488a86b5db8cf0def2a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:19.135807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2190/4399] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:18 2022] DELETE /identity/v3/users/f3de0b8b0174488a86b5db8cf0def2a4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:19.141752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:19.142628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:19.143158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:19.206092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:19.210506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:19.351071 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:19.382835 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2210/4400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:19.474382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:19.476833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:19.485332 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:19.627415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480363-0ca2-4b44-995d-0744e2f8d7fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:19.631622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:19.632601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:19.633548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:19.634046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:19.648658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:19.654938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:19.674161 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2191/4401] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:22.459602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:22.462206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:22.482927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82732c-549f-4253-a311-0d6021a9bb12 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:22.498256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:22.498833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:22.499117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:22.499461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] PATH_INFO: `/v3/projects/556499ebf79542ef8a1f71ca96c88418` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:22.500983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=556499ebf79542ef8a1f71ca96c88418)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:22.503838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:22.666193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556499ebf79542ef8a1f71ca96c88418', 'request_id': 'req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:22.683456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556499ebf79542ef8a1f71ca96c88418', 'request_id': 'req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:22.701988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556499ebf79542ef8a1f71ca96c88418', 'request_id': 'req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:22.757250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] The token cache is being invalidate because project 556499ebf79542ef8a1f71ca96c88418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:22.757644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:22.759746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:22.764371 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2211/4402] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:22 2022] DELETE /identity/v3/projects/556499ebf79542ef8a1f71ca96c88418 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:22.768461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:22.785318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d407843-8646-4ccd-9f9b-75b4f2b274f4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:22.930327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:22.931181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:22.933115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:22.934073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] PATH_INFO: `/v3/users/9590c371f22c4adeaade2ff7483705f8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:22.938449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9590c371f22c4adeaade2ff7483705f8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:22.940761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:23.052174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9590c371f22c4adeaade2ff7483705f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:23.055045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9590c371f22c4adeaade2ff7483705f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:23.075926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9590c371f22c4adeaade2ff7483705f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:23.105921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9590c371f22c4adeaade2ff7483705f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:23.107822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-665a499c-6c06-43bc-9a0c-f804c9c98f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9590c371f22c4adeaade2ff7483705f8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:23.130987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2192/4403] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:22 2022] DELETE /identity/v3/users/9590c371f22c4adeaade2ff7483705f8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:23.964933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:23.967163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:24.201525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb005-fcc3-45ab-9c7d-0e549d042cbf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:24.354540 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:24.381039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:24.381704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:24.381983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:24.382257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:24.384200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:24.443266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:24.445842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:24.480049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2212/4404] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:25.977851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e825b9-f499-4ef3-9820-ac609db852b3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:25.979341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e825b9-f499-4ef3-9820-ac609db852b3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:25.979786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e825b9-f499-4ef3-9820-ac609db852b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:26.059639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a3e825b9-f499-4ef3-9820-ac609db852b3 None None] MFA Rules not processed for user `996dbc72936a46fda11429f9f8438100`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:26.061111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a3e825b9-f499-4ef3-9820-ac609db852b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:26.128200 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:26.274553 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2193/4405] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:26.575415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:26.578215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:26.720188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056af6-89df-4b15-8a08-e2f8968beda4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:26.731280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:26.731958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:26.732244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:26.732520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] PATH_INFO: `/v3/projects/ae867f75098342e088a2b22f42b12914` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:26.737483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae867f75098342e088a2b22f42b12914)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:26.743106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:26.896084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae867f75098342e088a2b22f42b12914', 'request_id': 'req-cc3e3fc5-2fce-4129-818f-1c4d165964f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:26.913848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae867f75098342e088a2b22f42b12914', 'request_id': 'req-cc3e3fc5-2fce-4129-818f-1c4d165964f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:26.921519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae867f75098342e088a2b22f42b12914', 'request_id': 'req-cc3e3fc5-2fce-4129-818f-1c4d165964f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:26.944989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] The token cache is being invalidate because project ae867f75098342e088a2b22f42b12914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:26.945286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:26.945990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:26.951236 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2213/4406] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:26 2022] DELETE /identity/v3/projects/ae867f75098342e088a2b22f42b12914 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:26.952720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a50b5-a288-4340-a22d-6fb0e5ddc23e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:26.953016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a50b5-a288-4340-a22d-6fb0e5ddc23e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:26.953299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a50b5-a288-4340-a22d-6fb0e5ddc23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.012962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9d2a50b5-a288-4340-a22d-6fb0e5ddc23e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:27.014250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d2a50b5-a288-4340-a22d-6fb0e5ddc23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:27.164044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.167651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:27.190575 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2194/4407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:27.194738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.195072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.195438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.286581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:27.289944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:27.323222 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2195/4408] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:27.324701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.343264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f866-cf9d-466a-9f8f-07cc63df2bbd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.363914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.364823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.365349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.365783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.366744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:27.367044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.369546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:27.407158 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2196/4409] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:27.414605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.426645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3fc5-2fce-4129-818f-1c4d165964f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.437785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.438430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.438719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.439171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.442125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:27.444037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19eba-1d56-4f52-8a2e-408f59cdc5db admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.477673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.479048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.480439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.480838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.481703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.487297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:27.524408 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:27.583257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2197/4410] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:27 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:27.585863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.717292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.719503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:27.744979 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2214/4411] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:27.787183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a91c4-e5a9-4ca6-88e7-e4aec5a3b2bc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.803289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.804010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.804209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.804490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.805434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.807610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:27.851774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2198/4412] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:27 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:27.856431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.884657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3e0e-24ec-4cd9-821c-9e1f61660b2a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.900329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.901326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.901597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.901872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.902518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.904412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:27.933712 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2215/4413] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:27.937379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:27.958414 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:27.963113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bf0e-65fd-4bb4-9ccd-eeb7e5e01e08 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:27.984862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:27.985530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:27.985818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:27.986091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:27.987216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:27.988868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30889fc2-35e4-448d-8f6f-3408ef281820 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:28.013202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:28.019313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2199/4414] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:28.037060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad7e6f-7fdc-469c-9c48-90d66b1d71ca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:28.045675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:28.046435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:28.046744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:28.047030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] PATH_INFO: `/v3/projects/18ebacf8bdeb4aad946de92fcf78753a/users/a1fec8f1856047f28df1f45b54dbe76c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:28.084121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ebacf8bdeb4aad946de92fcf78753a, user_id=a1fec8f1856047f28df1f45b54dbe76c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:28.086425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:28.114124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2216/4415] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:28 2022] PUT /identity/v3/projects/18ebacf8bdeb4aad946de92fcf78753a/users/a1fec8f1856047f28df1f45b54dbe76c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:28.128100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:28.128359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:28.128636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:28.231283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] MFA Rules not processed for user `a1fec8f1856047f28df1f45b54dbe76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:28.232523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:28.438739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2200/4416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:28.439964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:28.570699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cce11-55e9-45f8-a821-1058be00880e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:28.577514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:28.578483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:28.578878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:28.579287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:28.580482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:28.582659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:28.675067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2217/4417] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:28 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:28.676609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:28.692946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feaf85-8ebf-4c70-983f-248b67ad7404 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:28.860991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:28.861656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:28.861989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:28.862384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:28.862909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:28.865133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:28.941533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:28.942023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2201/4418] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:28 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:28.961183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2f3d-3de4-4434-82d8-151c886bc927 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:28.980103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:28.980561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:28.980840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:28.981297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:28.981994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:28.983647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:29.020366 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2218/4419] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:29.021687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:29.042932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e7de-654c-4b0e-98c9-5c9f18645134 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:29.061857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:29.062548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.062834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.063110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] PATH_INFO: `/v3/projects/a50087b3f2d14a6abf2886933e36bf87/users/d4eab29f87e040fab7493b35f0c66334/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.106751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50087b3f2d14a6abf2886933e36bf87, user_id=d4eab29f87e040fab7493b35f0c66334, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:29.110047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3879-e191-4060-8f17-9524b3cb2297 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:29.137695 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2202/4420] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:29 2022] PUT /identity/v3/projects/a50087b3f2d14a6abf2886933e36bf87/users/d4eab29f87e040fab7493b35f0c66334/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:29.141684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:29.169257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc5b10-a1de-4123-bfc9-0ea51193cd86 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:29.313936 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:29.324949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:29.335245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.336704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.336996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.343153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:29.346855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:29.374948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.375232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.375504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.383149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2219/4421] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:29.390361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:29.410868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] MFA Rules not processed for user `996dbc72936a46fda11429f9f8438100`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:29.412501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:29.429414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e6ac-058e-47f6-b3a8-3fda34ddfbb5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:29.437577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:29.438359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.438359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.438775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] PATH_INFO: `/v3/projects/a50087b3f2d14a6abf2886933e36bf87/users/d4eab29f87e040fab7493b35f0c66334/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.440934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50087b3f2d14a6abf2886933e36bf87, user_id=d4eab29f87e040fab7493b35f0c66334, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:29.444330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddafd75-6fa0-483e-b100-5c271a4b0689 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:29.461101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2220/4422] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:29 2022] PUT /identity/v3/projects/a50087b3f2d14a6abf2886933e36bf87/users/d4eab29f87e040fab7493b35f0c66334/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:29.472350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.472570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.472916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.514272 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:29.529290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] MFA Rules not processed for user `d4eab29f87e040fab7493b35f0c66334`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:29.530474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:29.542918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2203/4423] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:29.699047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:29.702293 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2221/4424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:29.868541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0efa-e04f-4156-ae06-ce7a07c937ff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:29.876853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4eab29f87e040fab7493b35f0c66334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50087b3f2d14a6abf2886933e36bf87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:29.877791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:29.878415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:29.878841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:29.879664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:29.882070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c7847-88c9-40c4-a4a9-608d7077a68f tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:29.937917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:29.960705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2204/4425] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:29 2022] POST /identity/v3/projects => generated 358 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:30.100984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046cae-71db-40f9-a827-24b3ac8b02ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:30.147575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:30.148162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:30.148162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:30.206827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:30.208417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:30.279138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1fec8f1856047f28df1f45b54dbe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ebacf8bdeb4aad946de92fcf78753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:30.279799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:30.280080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:30.280352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] PATH_INFO: `/v3/projects/894007bdf319413ba3dbf8184852b32e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:30.281692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] RBAC: Authorizing `identity:delete_project(project_id=894007bdf319413ba3dbf8184852b32e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Sep 25 01:16:30.288455 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:30.289909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2222/4426] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:29 2022] DELETE /identity/v3/projects/894007bdf319413ba3dbf8184852b32e => generated 136 bytes in 353 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:30.296277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:30.330769 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:30.361731 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2205/4427] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:30.442236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd06dff-90b7-49ff-94e4-1a9678fc79a4 tempest-ProjectsNegativeTestJSON-706197110 tempest-ProjectsNegativeTestJSON-706197110-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:30.448558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4eab29f87e040fab7493b35f0c66334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50087b3f2d14a6abf2886933e36bf87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:30.449759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:30.450045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:30.450316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] PATH_INFO: `/v3/projects/894007bdf319413ba3dbf8184852b32e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:30.451678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: Authorizing `identity:delete_project(project_id=894007bdf319413ba3dbf8184852b32e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:30.454754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:30.571420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894007bdf319413ba3dbf8184852b32e', 'request_id': 'req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.581882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894007bdf319413ba3dbf8184852b32e', 'request_id': 'req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.590095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894007bdf319413ba3dbf8184852b32e', 'request_id': 'req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.610859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] The token cache is being invalidate because project 894007bdf319413ba3dbf8184852b32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:30.611206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.611956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f7c7e1b-9e24-45fd-b619-eedfa2f756f7 tempest-ProjectsNegativeTestJSON-1779450389 tempest-ProjectsNegativeTestJSON-1779450389-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.613971 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2223/4428] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:30 2022] DELETE /identity/v3/projects/894007bdf319413ba3dbf8184852b32e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:30.620075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:30.724813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0400-e78c-45e3-a8db-8f39c2a23c38 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:30.753313 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:30.838603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:30.839744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:30.840406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:30.840928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] PATH_INFO: `/v3/users/a1fec8f1856047f28df1f45b54dbe76c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:30.846597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fec8f1856047f28df1f45b54dbe76c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:30.850053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:30.957783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fec8f1856047f28df1f45b54dbe76c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.959034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fec8f1856047f28df1f45b54dbe76c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:30.979618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fec8f1856047f28df1f45b54dbe76c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:31.020105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fec8f1856047f28df1f45b54dbe76c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:31.021384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fec8f1856047f28df1f45b54dbe76c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:31.060218 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2206/4429] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:30 2022] DELETE /identity/v3/users/a1fec8f1856047f28df1f45b54dbe76c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:31.062360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:31.062959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:31.063409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:31.103111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:31.111432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:31.261338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2224/4430] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:31.354353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:31.356064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:31.540119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4d72a-c81d-4b4c-a989-43ea232c59bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:31.561957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:31.562580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:31.562996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:31.563124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:31.626065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:31.627702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:31.671558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2207/4431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:34.296354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:34.300106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:34.321098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14c59-a63a-455b-ace2-ac67b90089a4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:34.339163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:34.339825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:34.340104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:34.340379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] PATH_INFO: `/v3/projects/18ebacf8bdeb4aad946de92fcf78753a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:34.341803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ebacf8bdeb4aad946de92fcf78753a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:34.344537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:34.488436 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:34.495629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ebacf8bdeb4aad946de92fcf78753a', 'request_id': 'req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.516014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ebacf8bdeb4aad946de92fcf78753a', 'request_id': 'req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.523474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ebacf8bdeb4aad946de92fcf78753a', 'request_id': 'req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.550582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] The token cache is being invalidate because project 18ebacf8bdeb4aad946de92fcf78753a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:34.551466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.553297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.564973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:34.567210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2225/4432] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:34 2022] DELETE /identity/v3/projects/18ebacf8bdeb4aad946de92fcf78753a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:34.582485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012576-2d87-446c-a5ec-2231b902e609 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:34.679472 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:34.702242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:34.703456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:34.704958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:34.705997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] PATH_INFO: `/v3/users/d4eab29f87e040fab7493b35f0c66334` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:34.710200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eab29f87e040fab7493b35f0c66334)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:34.715192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:34.823640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eab29f87e040fab7493b35f0c66334'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.824670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eab29f87e040fab7493b35f0c66334'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.848976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eab29f87e040fab7493b35f0c66334'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.866206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eab29f87e040fab7493b35f0c66334'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.867516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eab29f87e040fab7493b35f0c66334'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:34.894143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2208/4433] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:34 2022] DELETE /identity/v3/users/d4eab29f87e040fab7493b35f0c66334 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:35.052046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:35.054071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:35.074752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad9f26-d8c5-40ee-b63a-5254bf4d3f5f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:35.202972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:35.204418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:35.204965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:35.205386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] PATH_INFO: `/v3/users/88a8086a0ed34e4898db9e4d4a632a97` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:35.206835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a8086a0ed34e4898db9e4d4a632a97)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:35.209771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:35.282138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:35.285064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:35.352737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a8086a0ed34e4898db9e4d4a632a97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:35.370131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a8086a0ed34e4898db9e4d4a632a97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:35.408485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a8086a0ed34e4898db9e4d4a632a97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:35.411029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a8086a0ed34e4898db9e4d4a632a97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:35.411842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550b4633-15ca-434c-9887-0d3fb49e3b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a8086a0ed34e4898db9e4d4a632a97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:35.447826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2226/4434] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:35 2022] DELETE /identity/v3/users/88a8086a0ed34e4898db9e4d4a632a97 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:35.538312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64a6a-c4c9-4108-b3fa-9efd7dd3bd2b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:35.633006 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:35.663282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:35.664155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:35.664539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:35.664972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:35.667616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:35.694347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:35.696274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:35.718011 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2209/4435] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:35.883071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d220-a41a-4323-a226-f0c7d8940016 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:35.883357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d220-a41a-4323-a226-f0c7d8940016 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:35.883883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d220-a41a-4323-a226-f0c7d8940016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:35.929040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-77c8d220-a41a-4323-a226-f0c7d8940016 None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:35.930690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-77c8d220-a41a-4323-a226-f0c7d8940016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:35.957145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:35.958838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:36.077330 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:36.095901 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2227/4436] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:36.112808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8c9b-86fb-48a7-a908-747fa3a1f22a service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.118312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.119710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.120160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.120613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] PATH_INFO: `/v3/projects/a50087b3f2d14a6abf2886933e36bf87` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.137270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50087b3f2d14a6abf2886933e36bf87)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.143077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.243433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50087b3f2d14a6abf2886933e36bf87', 'request_id': 'req-e3cf683d-6282-4e40-b67d-fac2d04013d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:36.252263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50087b3f2d14a6abf2886933e36bf87', 'request_id': 'req-e3cf683d-6282-4e40-b67d-fac2d04013d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:36.261849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50087b3f2d14a6abf2886933e36bf87', 'request_id': 'req-e3cf683d-6282-4e40-b67d-fac2d04013d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:36.284470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] The token cache is being invalidate because project a50087b3f2d14a6abf2886933e36bf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:36.285351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:36.286324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3cf683d-6282-4e40-b67d-fac2d04013d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:36.288154 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2210/4437] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:35 2022] DELETE /identity/v3/projects/a50087b3f2d14a6abf2886933e36bf87 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:36.293782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.293782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.294091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.320654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:36.324599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:36.464278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2228/4438] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:36.472591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.472952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.473472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.508744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:36.510251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:36.525805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.526098 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2211/4439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:36.543004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3c3c-5261-4092-8783-a58304794148 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.556108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.556790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.556790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.557197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.559640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:36.559640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.559888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.596469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2229/4440] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:36.596723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.609823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b5418-794c-4e6c-b82f-02068ae9d1b9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.616133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.616822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.617106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.617467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.618880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.621709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.664190 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2212/4441] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:36 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:36.670707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.682912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c499e-a39e-458e-a521-1fdddd44a23d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.759400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.760088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.760373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.760812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.761975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.763948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.800620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.802439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2230/4442] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:36 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:36.803538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:36.807069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.819641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b04430-f701-4a26-afe3-ab5bc50166e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.825807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.827926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.828215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.828633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.829310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.831179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.831919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f47b8-c70d-478d-b62e-684eddb75201 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.848663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.849469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.849762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.850084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] PATH_INFO: `/v3/projects/b730f5960b50450b9f6e724945ae8613` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.852437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b730f5960b50450b9f6e724945ae8613)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.855577 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2231/4443] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:36.856545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.856680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.877994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffc816-c5de-452a-9a79-98481f2bde88 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.884749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.885448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.885743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.886071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.887014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.890428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:36.906024 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2232/4444] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:36.912028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:36.926314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36653-0b0a-4248-b420-9ef9767a6b24 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:36.933294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:36.934019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:36.934305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:36.934584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] PATH_INFO: `/v3/projects/cb5652d0e7db4b1f891a36dae7d01a58/users/205baf9d5fe84ca3aa4475f3767dbc8f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:36.991169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5652d0e7db4b1f891a36dae7d01a58, user_id=205baf9d5fe84ca3aa4475f3767dbc8f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:36.999141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0909a-697e-4043-ba90-bed6ecd0b27d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.003684 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:37.012463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b730f5960b50450b9f6e724945ae8613', 'request_id': 'req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:37.034837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2233/4445] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:36 2022] PUT /identity/v3/projects/cb5652d0e7db4b1f891a36dae7d01a58/users/205baf9d5fe84ca3aa4475f3767dbc8f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:37.047072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.047360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.047638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.049148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b730f5960b50450b9f6e724945ae8613', 'request_id': 'req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:37.064017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b730f5960b50450b9f6e724945ae8613', 'request_id': 'req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:37.082845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] The token cache is being invalidate because project b730f5960b50450b9f6e724945ae8613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:37.083144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:37.084005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9f1e5df-9f90-46bc-a712-9cbb4b7fbd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:37.089950 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2213/4446] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:36 2022] DELETE /identity/v3/projects/b730f5960b50450b9f6e724945ae8613 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:37.092655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72afd8-9289-45d3-9361-728be2ca531b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.093063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72afd8-9289-45d3-9361-728be2ca531b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.093344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72afd8-9289-45d3-9361-728be2ca531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.110806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] MFA Rules not processed for user `205baf9d5fe84ca3aa4475f3767dbc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:37.112057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:37.142454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-df72afd8-9289-45d3-9361-728be2ca531b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:37.143699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df72afd8-9289-45d3-9361-728be2ca531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:37.171341 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:37.281049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2234/4447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:37.287307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.290600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:37.298954 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2214/4448] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:37.307116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.307385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.307494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.319684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5c4c-c9f5-4327-a20e-7dab95cbc744 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.335353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.335996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.336280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.336553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.337243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.341509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.348819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:37.351035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:37.373249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2215/4449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:37.377215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.398219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcfd90-9fe0-4126-818c-c490df52e0ff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.405733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.406509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.406895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.407281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.408047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:37.409612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.411423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.417493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2235/4450] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:37.428760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.454921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2216/4451] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:37.459378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.472100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77adee4-fcc6-40c7-9c25-b6d499fcd7af admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.578106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.580043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.580969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.581538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.582486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.592261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.612095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2245f-5cb8-430f-aee0-527c28aa3e75 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.625068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.625816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.625998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.626260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.627504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.628953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.656499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2217/4452] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:37.660328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.664625 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2236/4453] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:37.669385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.689214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55499b-2908-4662-b22b-45cb88228820 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.768075 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:37.808157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241a31-92ff-4a11-9598-5e6e593fb9bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.811937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.812874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.813167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.813604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.814251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.816326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.824788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.826563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.827216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.829433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.831059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.834525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.849662 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2237/4454] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:37.851153 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2218/4455] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:37 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:37.855241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.856329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.872313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312779-60a6-4177-bacd-4ae4a865327c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.876225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fba69-f4da-46c8-929f-b7a3f19796ad admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.878414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.878755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.879139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.879562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] PATH_INFO: `/v3/projects/476a314e66a244e9afe4db07b2b048fd/users/334d287fc34642549fab4a7a19b50050/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.885558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:37.887171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:37.887630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:37.888105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:37.888996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.892064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.903266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a314e66a244e9afe4db07b2b048fd, user_id=334d287fc34642549fab4a7a19b50050, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:37.906690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:37.909094 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2219/4456] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:37.912844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:37.920925 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:37.928795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de335-7203-417a-ad4f-b82879b50cf8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:37.931540 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2238/4457] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:37 2022] PUT /identity/v3/projects/476a314e66a244e9afe4db07b2b048fd/users/334d287fc34642549fab4a7a19b50050/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:37.935415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.079230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.079862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.080146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.080423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.081158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.082813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.127869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2220/4458] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:16:38.132698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.145950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6f97-007d-436c-b3c3-1d947ba795d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.162150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.162782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.167651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.168001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.168668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.168799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cc5f-7a6d-40b9-a8e9-5aa1cbb579e1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.170329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.180494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.181753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.182041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.182475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] PATH_INFO: `/v3/projects/31a0aa9bcbe5414eb0e4e412069cca3b/users/b83c3369cd634d3aa48681fd18492a0a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.201380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2239/4459] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:38.204958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.222790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a0aa9bcbe5414eb0e4e412069cca3b, user_id=b83c3369cd634d3aa48681fd18492a0a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.225505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307a7a9-64c7-4018-b51f-c54f4c7d765e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.238486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1da1-1408-40e9-bd48-2a645c0a3f3f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.261499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2221/4460] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:38 2022] PUT /identity/v3/projects/31a0aa9bcbe5414eb0e4e412069cca3b/users/b83c3369cd634d3aa48681fd18492a0a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:38.263212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.263388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.263638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.330687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:38.332452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:38.415798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.416943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.417389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.417852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] PATH_INFO: `/v3/projects/476a314e66a244e9afe4db07b2b048fd/users/334d287fc34642549fab4a7a19b50050/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.426688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a314e66a244e9afe4db07b2b048fd, user_id=334d287fc34642549fab4a7a19b50050, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.433385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df91f-0269-4ce4-9c16-50c234a1f6f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.451946 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2240/4461] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:38 2022] PUT /identity/v3/projects/476a314e66a244e9afe4db07b2b048fd/users/334d287fc34642549fab4a7a19b50050/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:38.464196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.464859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.465125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.513050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2222/4462] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:38.517918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] MFA Rules not processed for user `334d287fc34642549fab4a7a19b50050`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:38.519798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:38.643138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.648379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2241/4463] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:38.648933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:38.649049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.661644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f96d06-70c5-4abd-b080-2e9d62d09e48 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.672253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.672885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.673205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.673449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.674139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.675171 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:38.675171 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:38.675171 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:38.676383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.695642 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:38.703286 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2242/4464] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/roles => generated 235 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:38.706773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.712883 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:38.719209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77224-1875-426a-9a39-410f43ddd631 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.724802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.725570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.725927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.726308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.727060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.729189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.755483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2243/4465] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/roles => generated 234 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:38.756488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.765304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb76147-04b0-4f85-9426-c6b7d7ab7317 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.772426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef73c5-8d35-4cb0-867c-34618102a8cf tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.780080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.780867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.781575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.781909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.782731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.784606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.830650 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2244/4466] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/roles => generated 234 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:38.831650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:38.848232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568de1d-10fb-4408-81cf-c58ef651286d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:38.855865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.856570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.857725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.858022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.858832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:38.860981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:38.903372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:38.904028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:38.904278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:38.904554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:38.909351 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2245/4467] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/domains => generated 277 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:38.913215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.045977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9b8-b41d-4990-98f7-4bf5ac5a94ab tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.068132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.070012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.070292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.073894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.075507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.078247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.111062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.117652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.143573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2246/4468] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:38 2022] POST /identity/v3/projects => generated 400 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:39.145883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.164275 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2223/4469] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:16:39.239666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955ec9-718f-4da4-9c47-433beedbc556 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.246950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.247629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.248017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.248382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.249171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.251337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.277841 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2247/4470] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:39 2022] POST /identity/v3/groups => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:39.281277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.299144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc29d-6961-4f3b-bf47-cef492867596 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.311108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.312026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.313018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.313970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.314851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.316206 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:39.316206 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:39.316206 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:39.317636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.328264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.330032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:39.355944 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2224/4471] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:39 2022] POST /identity/v3/roles => generated 234 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:39.360283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.377617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab9a7-463d-41f4-bc01-6465449c3962 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.397503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.398198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.398694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.398874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.399602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.402704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.433475 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:39.463826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2225/4472] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:39 2022] POST /identity/v3/users => generated 439 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:39.468442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.502344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535214-d241-49fb-ad65-9e0064357970 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.503827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa3ce-7033-404d-9438-24436b15f5e4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.507666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.510438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.510683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.511181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] PATH_INFO: `/v3/users/95b7650e677d47ab9576bc3cb6ea07e7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.513244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b7650e677d47ab9576bc3cb6ea07e7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.515420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.530925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.531600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.531892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.532176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.534933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.535745 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:39.535745 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:39.535745 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:39.536661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.580116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2226/4473] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:39 2022] POST /identity/v3/roles => generated 270 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:39.581735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.594487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c643c70-af80-419a-87e3-bcd380b962c3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.604788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.605589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.605861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b7650e677d47ab9576bc3cb6ea07e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:39.606000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.606154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/20547a0917984a82a2db165bd871784e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.624318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b7650e677d47ab9576bc3cb6ea07e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:39.630200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=20547a0917984a82a2db165bd871784e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.634858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.652903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b7650e677d47ab9576bc3cb6ea07e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:39.654174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b7650e677d47ab9576bc3cb6ea07e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:39.654969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b7650e677d47ab9576bc3cb6ea07e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:39.660533 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2227/4474] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:39 2022] PUT /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/20547a0917984a82a2db165bd871784e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:39.661985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.664218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:39.682164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2248/4475] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:39 2022] DELETE /identity/v3/users/95b7650e677d47ab9576bc3cb6ea07e7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:39.706837 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:39.762846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e2840-91c2-400c-9c2c-ee4dbc43846a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.865277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.865948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.866235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.866506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.867556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Adding query filter params (scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5, user.id=ea91b38daea04c388499146f6fbca1fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:39.867874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.870010 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:39.870010 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:39.870010 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:39.870989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:39.954006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2228/4476] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:16:39 2022] GET /identity/v3/role_assignments?scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5&user.id=ea91b38daea04c388499146f6fbca1fc&effective => generated 228 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:39.959010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:39.974310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5072d26-16bb-4035-b6b6-e7c74946e9e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:39.982556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:39.983661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:39.984142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:39.984529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/20547a0917984a82a2db165bd871784e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:39.987320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=20547a0917984a82a2db165bd871784e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:39.988963 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:39.988963 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:39.988963 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:39.991933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.002878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 20547a0917984a82a2db165bd871784e was removed from user ea91b38daea04c388499146f6fbca1fc on project 0b2eace077d74a3d94ddf84b4c42d7e5. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:40.003121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.004038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.031407 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2249/4477] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:16:39 2022] DELETE /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/20547a0917984a82a2db165bd871784e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:40.035289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.037054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.060094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adf757-a1c9-4401-84eb-b26e89b4d866 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:40.157030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:40.157911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.158981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.159366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/20547a0917984a82a2db165bd871784e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.160758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=20547a0917984a82a2db165bd871784e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:40.161941 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:40.161941 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:40.161941 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:40.163098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.238771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 20547a0917984a82a2db165bd871784e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:40.239526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.240317 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:40.241049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.243845 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2229/4478] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:40 2022] DELETE /identity/v3/roles/20547a0917984a82a2db165bd871784e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:40.251225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.272989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde9d4-42ce-429b-b1dd-079a6efe389f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:40.292021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.296632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.388268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:40.388953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.389475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.390177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/625d34acf9c64f71b8903c25dc84f325` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.397598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=625d34acf9c64f71b8903c25dc84f325)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:40.401115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.443623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2250/4479] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:40 2022] PUT /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/625d34acf9c64f71b8903c25dc84f325 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:40.449850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919df19-bf9b-4b77-b4a7-48c6cbc2229e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:40.450286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.452217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.520814 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:40.574366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:40.575393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.575833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.576338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] PATH_INFO: `/v3/projects/744c3c67433f4d268891a810016366cc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.578179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744c3c67433f4d268891a810016366cc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:40.581115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.590641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2132a48-7d90-4364-ba7a-5c12311acf26 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:40.598836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:40.602025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.602423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.602898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.606320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:40.607602 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:40.607602 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:40.607602 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:40.609067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01fa72-b5c8-436d-9486-caecf40e6c5d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.664935 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2251/4480] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:40 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 520 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:40.664935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679de0-8789-4613-9dc7-e5d1a1b8377d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.664935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679de0-8789-4613-9dc7-e5d1a1b8377d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.667093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679de0-8789-4613-9dc7-e5d1a1b8377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.695456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744c3c67433f4d268891a810016366cc', 'request_id': 'req-b44ab70e-5340-4a91-bdc2-115a9ccfe777'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.703632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744c3c67433f4d268891a810016366cc', 'request_id': 'req-b44ab70e-5340-4a91-bdc2-115a9ccfe777'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.711547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744c3c67433f4d268891a810016366cc', 'request_id': 'req-b44ab70e-5340-4a91-bdc2-115a9ccfe777'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.718263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1c679de0-8789-4613-9dc7-e5d1a1b8377d None None] MFA Rules not processed for user `b83c3369cd634d3aa48681fd18492a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:40.719934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c679de0-8789-4613-9dc7-e5d1a1b8377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.728230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] The token cache is being invalidate because project 744c3c67433f4d268891a810016366cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:40.729203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.729782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:40.731558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2230/4481] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:40 2022] DELETE /identity/v3/projects/744c3c67433f4d268891a810016366cc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:40.736461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.737959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.788765 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:40.820858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2252/4482] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:40.822132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.822422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.822696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.834593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab70e-5340-4a91-bdc2-115a9ccfe777 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:40.842174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:40.842660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.843681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.844133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.845518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Adding query filter params (scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5, user.id=ea91b38daea04c388499146f6fbca1fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:40.846054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:40.849129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616564c0-44b2-4902-8c4d-b33763557a4e tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:40.870883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:40.872931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:40.933061 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2231/4483] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:16:40 2022] GET /identity/v3/role_assignments?scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5&user.id=ea91b38daea04c388499146f6fbca1fc&effective => generated 1061 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:40.933061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991f28-579d-457c-ade6-f201bd84ab07 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:40.933061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991f28-579d-457c-ade6-f201bd84ab07 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:40.933061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991f28-579d-457c-ade6-f201bd84ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:40.978924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-22991f28-579d-457c-ade6-f201bd84ab07 None None] MFA Rules not processed for user `b83c3369cd634d3aa48681fd18492a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:40.980254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2253/4484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:40.981228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:40.982211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-22991f28-579d-457c-ade6-f201bd84ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.002938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2232/4485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:41.002938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.002938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.002938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.009483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756a3b6-c467-49f2-abe9-f05562c27a83 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.016207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.017157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.017645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.018082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.020196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.021430 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:41.021430 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:41.021430 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:41.022657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93832b7-f47a-40f3-a16e-8952d34fcbb7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.025453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:41.027740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.043881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2254/4486] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:40 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:41.045381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.045793 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2233/4487] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:41.045929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.046087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.046858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.064758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82003b92-4f46-4cde-994a-af9a06afc065 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.071034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] MFA Rules not processed for user `b83c3369cd634d3aa48681fd18492a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:41.072517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.106435 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:41.146747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.148013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.148452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.148861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.150182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Adding query filter params (scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5, user.id=ea91b38daea04c388499146f6fbca1fc) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:41.150506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.152410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.170340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2255/4488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:41.171479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.255788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2234/4489] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/role_assignments?scope.project.id=0b2eace077d74a3d94ddf84b4c42d7e5&user.id=ea91b38daea04c388499146f6fbca1fc&effective => generated 577 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:41.256698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.267176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.270697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed60b8-1b97-4f66-9dce-0ec6b2f6a9de None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.277511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.278155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.278440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.279329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.280549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:41.280892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.283549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.300450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2256/4490] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:41.301931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.316815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23360-30f3-4de8-93f0-15308b2b782d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.326105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.326798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.327092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.327367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.329070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.330917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b.: keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = query.one() Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._iter().one() Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._only_one_row( Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:41.356059 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:41.357680 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 25 01:16:41.359036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 25 01:16:41.359036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 25 01:16:41.359036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 25 01:16:41.359036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:41.359036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:41.361502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2257/4491] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:41 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 137 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:41.362691 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:41.364056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.393695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b98f-f576-47c5-aac6-6bf83f12d147 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.403547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.405237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.405367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.405741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.406451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.409292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.441571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a527-7d21-4ef3-ba3d-9a0d094559b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.454848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2258/4492] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:16:41 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:41.455945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.461341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.462560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.462862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.463135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.473109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.474773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.498034 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2235/4493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:41.498894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.521444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57d6e-645d-4ccd-9cda-46166e6c3a1d service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.613572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c3ce-1b3d-455f-9140-054cfcda9ebd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.623633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.624575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.625674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.627055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/625d34acf9c64f71b8903c25dc84f325` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.658615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=625d34acf9c64f71b8903c25dc84f325)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.662373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.672035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 625d34acf9c64f71b8903c25dc84f325 was removed from user ea91b38daea04c388499146f6fbca1fc on project 0b2eace077d74a3d94ddf84b4c42d7e5. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:41.673152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:41.674169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:41.683593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.685681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.687056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.688081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.689164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.695452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.704726 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2259/4494] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:16:41 2022] DELETE /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/625d34acf9c64f71b8903c25dc84f325 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:41.715312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.717393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.749824 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2236/4495] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:41 2022] POST /identity/v3/users => generated 282 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:41.751369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.758034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:41.786048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83cba-0867-40ca-af63-39cc41247399 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.796544 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:41.854019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18af4d-a30a-4b44-a9a6-86974f5be927 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.860671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.862830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.863694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.864321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.865617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.866951 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:41.866951 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:41.866951 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:41.868771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.893475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2260/4496] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:16:41 2022] POST /identity/v3/roles => generated 271 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:41.897770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.913046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae2d8-00eb-4996-8d4a-fa2ca712ffb9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:41.919969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.920912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.921462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.921828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.922746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Adding query filter params (domain_id=78d3b45199c64549ac43ab2e5da084db) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:41.923297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.926185 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:41.926185 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:41.926185 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:41.929504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:41.932829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.933709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:41.933709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:41.933709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:41.933709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:41.934058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:41.964735 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2237/4497] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/roles => generated 2321 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:41.972332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:41.979566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2261/4498] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/roles?domain_id=78d3b45199c64549ac43ab2e5da084db => generated 408 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:41.980696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.007901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e91131-e21b-4299-b57c-aac1fbd70ca7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.012900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632a85d-60e3-433d-ab88-18fe87d449bb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.022728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.024280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.024280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.024551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.026947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.027980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.028619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.028945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.029230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/d0822ff4604f40b29016325977cabdf5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.031774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.033626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d0822ff4604f40b29016325977cabdf5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.034668 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:42.034668 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:42.034668 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:42.035575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.065958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2238/4499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:41 2022] GET /identity/v3/roles => generated 2321 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:16:42.072497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.105328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ff86-aeb6-4461-9da9-9bb98db79fb2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.122008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.123221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.123507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.125125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] PATH_INFO: `/v3/projects/c9172549e19145c5b2201cfa5ef4eddd/users/ab3394e2971741d7aa5956de0d4afba8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.132030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role d0822ff4604f40b29016325977cabdf5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:42.132445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:42.133389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:42.136601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2262/4500] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:41 2022] DELETE /identity/v3/roles/d0822ff4604f40b29016325977cabdf5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:42.146954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.154469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:42.202282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9172549e19145c5b2201cfa5ef4eddd, user_id=ab3394e2971741d7aa5956de0d4afba8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.207338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8816e-4bc1-4190-853e-6c970be692a0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.245846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2239/4501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:42 2022] PUT /identity/v3/projects/c9172549e19145c5b2201cfa5ef4eddd/users/ab3394e2971741d7aa5956de0d4afba8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:42.247455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.247743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.248017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.294127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:42.295427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:42.310147 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:42.325728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c531-340a-4c89-a047-a9cf40bd2798 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.468958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2240/4502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:42.474289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.474935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.475220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.475495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.478320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Adding query filter params (domain_id=78d3b45199c64549ac43ab2e5da084db) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:16:42.478738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.481342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.499426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2263/4503] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 25 01:16:42 2022] GET /identity/v3/roles?domain_id=78d3b45199c64549ac43ab2e5da084db => generated 148 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:42.503817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.511328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.513267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:42.520412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e512-f006-4bc4-a5d0-d3a86f2b8162 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.527580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.528633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.529141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.529723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/d0822ff4604f40b29016325977cabdf5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.542199 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:42.546536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Could not find role: d0822ff4604f40b29016325977cabdf5.: keystone.exception.RoleNotFound: Could not find role: d0822ff4604f40b29016325977cabdf5. Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Sep 25 01:16:42.554326 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:16:42.556166 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d0822ff4604f40b29016325977cabdf5. Sep 25 01:16:42.557468 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:42.561082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2241/4504] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:42 2022] DELETE /identity/v3/roles/d0822ff4604f40b29016325977cabdf5 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:42.566139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.604752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870851-d335-46b9-a456-a3b5f91b55b3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.615405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.616101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.623085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.623960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.643234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.652168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.665839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3af2-e9c0-417b-928b-cbb19665bee5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.678384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.679725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.680474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.684140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.685590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2242/4505] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:42 2022] PUT /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:42.689676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.720044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.723297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.737254 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2264/4506] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:16:42.819298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7175-a03e-48c2-ad5c-938a8b5ce6db tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.827396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.828989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.829560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.830038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.832366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=78d3b45199c64549ac43ab2e5da084db, group_id=8212eb68d588442faedfd0648ef0d5b7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.833727 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:42.833727 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:42.833727 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:42.836189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.855831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2243/4507] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 25 01:16:42 2022] GET /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles => generated 409 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:42.859869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.875374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f468-71f5-4686-8018-c25ddf2ab1db service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.881649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.882484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.882876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.883245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.887331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.889144 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:42.889144 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:42.889144 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:42.891921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.903733 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2265/4508] 10.222.0.16 () {58 vars in 1465 bytes} [Sun Sep 25 01:16:42 2022] HEAD /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:42.905345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.919952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c70b-86d0-4119-8c38-71b5b155ff93 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:42.926303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:42.927273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:42.927861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:42.928310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:42.931874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:42.933217 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:42.933217 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:42.933217 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:42.937308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:42.948060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role ee322f5cef5845b7b0f72002f294d9f2 was removed from group 8212eb68d588442faedfd0648ef0d5b7 on domain 78d3b45199c64549ac43ab2e5da084db. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:42.948701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:42.949735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1db3cd7d-9130-44ce-89a1-2162fc2b5fed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:42.975356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2244/4509] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:16:42 2022] DELETE /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:42.979554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:42.981205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:42.999507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.000675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.001546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.019845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048dd4-ee84-4a99-be2f-b8f19ffb7ea5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:43.029606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] MFA Rules not processed for user `bb85bd8db516469abb729c1fdc0a1ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:43.031469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:43.157193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:43.159195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.159552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.160827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.167508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:43.175214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:43.183798 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:43.223217 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2266/4510] 10.222.0.16 () {60 vars in 1486 bytes} [Sun Sep 25 01:16:42 2022] PUT /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:43.226583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:43.253170 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2245/4511] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:43.377978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b84f3-0db7-4106-bb58-5c854e47dd9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:43.407407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:43.409166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.411060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.411635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.419741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, group_id=8212eb68d588442faedfd0648ef0d5b7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:43.424027 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:43.424027 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:43.424027 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:43.427388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c84749-37df-4640-8980-d4a6ec8ac0ec tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:43.473182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2267/4512] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:16:43 2022] GET /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles => generated 410 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:43.475989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:43.491614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8f53-47f3-4787-944e-7639b28c3d09 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:43.507980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:43.508732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.509078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.509776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/groups/8212eb68d588442faedfd0648ef0d5b7/users/ea91b38daea04c388499146f6fbca1fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.511174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8212eb68d588442faedfd0648ef0d5b7, user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:43.512238 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:43.512238 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:43.512238 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:43.513593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:43.576575 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2246/4513] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:16:43 2022] PUT /identity/v3/groups/8212eb68d588442faedfd0648ef0d5b7/users/ea91b38daea04c388499146f6fbca1fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:43.582300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.584946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.585468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.672042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] MFA Rules not processed for user `ea91b38daea04c388499146f6fbca1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:43.673553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:43.693190 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:43.826084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2268/4514] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:43.830218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:43.966006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c25f-d724-4bd8-81bb-e3f71bdfc3fa tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:43.977613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:43.979483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:43.980070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:43.980453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:43.984731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:43.986307 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:43.986307 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:43.986307 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:43.989612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.005179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2247/4515] 10.222.0.16 () {58 vars in 1468 bytes} [Sun Sep 25 01:16:43 2022] HEAD /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.008562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.036098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261048-7869-492f-bf97-13ae0027d962 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.047938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.052957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.052957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.052957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.056222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.060827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.070107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role ee322f5cef5845b7b0f72002f294d9f2 was removed from group 8212eb68d588442faedfd0648ef0d5b7 on project 0b2eace077d74a3d94ddf84b4c42d7e5. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:44.070587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:44.073187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77e9abce-c0bf-4dc5-897d-ca2b1910c6f2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:44.101749 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2269/4516] 10.222.0.16 () {58 vars in 1470 bytes} [Sun Sep 25 01:16:44 2022] DELETE /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.107480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.110144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:44.130191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6b35-bcca-41f8-a005-eeae43f52371 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.257546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.259353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.260065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.260630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/groups/8212eb68d588442faedfd0648ef0d5b7/users/ea91b38daea04c388499146f6fbca1fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.262891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8212eb68d588442faedfd0648ef0d5b7, user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.265562 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:44.265562 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:44.265562 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:44.268308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.287080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:44.320881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.322120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.322975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.350894 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2248/4517] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:16:44 2022] DELETE /identity/v3/groups/8212eb68d588442faedfd0648ef0d5b7/users/ea91b38daea04c388499146f6fbca1fc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.356638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.411622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] MFA Rules not processed for user `b83c3369cd634d3aa48681fd18492a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:44.413675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:44.436875 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:44.455559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c2af-615d-4e37-b455-6d660e6f5845 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.463534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.464006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.464358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.464727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.468682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.469866 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:44.469866 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:44.469866 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:44.471361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.489499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2249/4518] 10.222.0.16 () {60 vars in 1381 bytes} [Sun Sep 25 01:16:44 2022] PUT /identity/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.490923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.503111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2336-0cbe-4c9b-b3aa-c4d943a54171 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.508169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.509769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.510057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.510332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.512384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=8212eb68d588442faedfd0648ef0d5b7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.514227 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:44.514227 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:44.514227 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:44.515151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.542858 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2250/4519] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:44 2022] GET /identity/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles => generated 375 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:44.545232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.560709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b748-b1e1-4cf3-bbe8-9cbf6e395e64 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.583872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.584551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.584838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.585124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.595255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.598221 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:44.598221 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:44.598221 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:44.599242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.619652 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2270/4520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:44.625960 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2251/4521] 10.222.0.16 () {58 vars in 1363 bytes} [Sun Sep 25 01:16:44 2022] HEAD /identity/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.628357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.691776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498530f-d68c-4c5b-9771-a3fde844542a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.705581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.708274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.711412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.712096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.718544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=8212eb68d588442faedfd0648ef0d5b7, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.723365 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:44.723365 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:44.723365 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:44.728953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.752383 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2271/4522] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 25 01:16:44 2022] DELETE /identity/v3/system/groups/8212eb68d588442faedfd0648ef0d5b7/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.758072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.782746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5566ca-61e6-43ed-a18e-1414b894640b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:44.791738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:44.792517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:44.792812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:44.793086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:44.801726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:44.807580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:44.856636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2252/4523] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 25 01:16:44 2022] PUT /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:44.858669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:44.884837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aec6b-5916-416d-a322-d1fdcac8dd74 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.066316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.067303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.067988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.069926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.076657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=78d3b45199c64549ac43ab2e5da084db, user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.079601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.111530 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:45.117366 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2272/4524] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 25 01:16:44 2022] GET /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles => generated 408 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:45.124454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.155788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a40d9-d762-4ce1-a768-f36ae67e99bd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.186632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.190775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.191402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.193903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.206900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.210088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.232315 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2253/4525] 10.222.0.16 () {58 vars in 1462 bytes} [Sun Sep 25 01:16:45 2022] HEAD /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:45.241831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.266216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80085-fadf-4f27-8c8e-fe8c4c6b2d96 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.294195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.294852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.295202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.295491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.317805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=78d3b45199c64549ac43ab2e5da084db, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.328272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.349543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role ee322f5cef5845b7b0f72002f294d9f2 was removed from user ea91b38daea04c388499146f6fbca1fc on domain 78d3b45199c64549ac43ab2e5da084db. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:45.350192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:45.351386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:45.401513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.401960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2273/4526] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 25 01:16:45 2022] DELETE /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:45.404264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:45.427141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033b77-7b81-40ea-aacf-216dfb531aa7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.550259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.551849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.552349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.552860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.556433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.560455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.589347 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2254/4527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:16:45 2022] PUT /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:45.592560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.610926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355658-ea79-4c41-b2bc-25d8c4b810a1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.718912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.719753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.719865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.720135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.723068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.728262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.744472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2274/4528] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 25 01:16:45 2022] GET /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles => generated 409 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:45.748444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.760198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205b57-1bfe-4de3-b3eb-0b2c63e8f1ae tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.772472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.772909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.773196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.773525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.777017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.779718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.791623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2255/4529] 10.222.0.16 () {58 vars in 1465 bytes} [Sun Sep 25 01:16:45 2022] HEAD /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:45.792577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.809798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c5c3-b32f-4427-ac09-763f2b8f1b9b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:45.820109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:45.820940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:45.821947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:45.822332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:45.824727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0b2eace077d74a3d94ddf84b4c42d7e5, user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:45.828074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:45.834203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role ee322f5cef5845b7b0f72002f294d9f2 was removed from user ea91b38daea04c388499146f6fbca1fc on project 0b2eace077d74a3d94ddf84b4c42d7e5. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:45.834957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:45.836271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:45.862450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2275/4530] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:16:45 2022] DELETE /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:45.864992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:45.869207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:45.890898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a859-031b-4880-ae65-94f2a8301390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.033770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.034588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.034881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.035157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.036915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.038459 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:46.038459 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:46.038459 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:46.038859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.054041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2256/4531] 10.222.0.16 () {60 vars in 1378 bytes} [Sun Sep 25 01:16:45 2022] PUT /identity/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:46.055371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.075959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702655-3fe0-463d-8107-86204d7256ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.081758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.082181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.082522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.082810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.084303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.085429 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:46.085429 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:46.085429 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:46.087242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.110160 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2276/4532] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:16:46 2022] GET /identity/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles => generated 374 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:46.111512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.125317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca2fc-4277-4085-9afb-761816c16b7a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.130908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.131789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.132241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.132711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.134716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.135939 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:46.135939 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:46.135939 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:46.137206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.147620 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2257/4533] 10.222.0.16 () {58 vars in 1360 bytes} [Sun Sep 25 01:16:46 2022] HEAD /identity/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:46.148640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.168593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e01e-5a37-437c-a86e-1fbd2782bf81 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.176755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.177526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.177821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.178105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.180143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=ea91b38daea04c388499146f6fbca1fc, role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.181874 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:46.181874 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:46.181874 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:46.184973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.194760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2277/4534] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 25 01:16:46 2022] DELETE /identity/v3/system/users/ea91b38daea04c388499146f6fbca1fc/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:46.202218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.213511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac061-7aa9-4668-a533-ed8253c6f018 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.220461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.221143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.221754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.222171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.222807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.224702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.255188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.259848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2258/4535] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:46 2022] POST /identity/v3/roles => generated 270 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:46.274942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f49e3-ac95-4b97-a37c-fc2e8c370489 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.285070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.286037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.286310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.286662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.288302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.291174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.316214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2278/4536] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:46 2022] POST /identity/v3/roles => generated 270 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:46.322716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.337486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2fb9a-7863-4cd4-9e24-09351aa49d14 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.344237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.345081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.345544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.345929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/0a215c4bfe914901a4a6b359e82363e6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.347997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=0a215c4bfe914901a4a6b359e82363e6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.349232 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:46.349232 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:46.349232 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:46.353567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d298ed8-513a-46a3-aa37-733ce4cdf7f1 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.356194 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:46.397869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2259/4537] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:46 2022] PUT /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/0a215c4bfe914901a4a6b359e82363e6 => generated 531 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:46.402533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.422631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f141d-464f-4d6b-b941-b18d482ec1ed tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.580169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.587456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.587456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.587456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.587456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.594235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.612566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.612779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.613062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.649050 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2279/4538] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:16:46 2022] POST /identity/v3/domains => generated 277 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:46.651788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.687173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] MFA Rules not processed for user `5db19a97588e41d1858915c9ccc48620`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:46.688728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:46.706347 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:46.886819 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2260/4539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:46.897805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d65cb-165d-4a63-a5f8-4d9eba7ebce2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.912632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.913184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.913591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.913936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.914742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.921857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:46.952182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2280/4540] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:46 2022] POST /identity/v3/roles => generated 270 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:46.956939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:46.973378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dee2f7-4318-4238-8de0-1f337216f0b7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:46.981907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:46.982631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:46.983191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:46.983479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/cd284571ab694be6af36a13644d4048f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:46.985774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=cd284571ab694be6af36a13644d4048f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:46.988436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.025809 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2261/4541] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:46 2022] PUT /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/cd284571ab694be6af36a13644d4048f => generated 531 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:47.028915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:47.047167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963130d-bd5f-4671-9666-df586b324693 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:47.217746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:47.218612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:47.219002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:47.219281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:47.220995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:47.222641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.284937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2281/4542] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:47 2022] PUT /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 525 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:47.288788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:47.302908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c553cb-ccd9-4368-a54c-4fcc8df21e50 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:47.421425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:47.422228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:47.422585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:47.422936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/ee322f5cef5845b7b0f72002f294d9f2/implies/c9ec7311b74246ce830c73957bc44ae0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:47.427179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ee322f5cef5845b7b0f72002f294d9f2, implied_role_id=c9ec7311b74246ce830c73957bc44ae0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:47.429011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] c9ec7311b74246ce830c73957bc44ae0 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: c9ec7311b74246ce830c73957bc44ae0 cannot be an implied roles. Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Sep 25 01:16:47.464798 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: c9ec7311b74246ce830c73957bc44ae0 cannot be an implied roles. Sep 25 01:16:47.466130 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:47.467356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2262/4543] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:47 2022] PUT /identity/v3/roles/ee322f5cef5845b7b0f72002f294d9f2/implies/c9ec7311b74246ce830c73957bc44ae0 => generated 116 bytes in 178 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:47.471074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:47.490072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282d314-271f-40b0-9183-17fb667f2889 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:47.496690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:47.498866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:47.499374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:47.499837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:47.503636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:47.506170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.535364 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2282/4544] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:47 2022] DELETE /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:47.541378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:47.565487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729261-46ce-4241-9508-961fbb50b80c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:47.699978 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:47.758356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:47.759855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:47.760366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:47.760696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/cd284571ab694be6af36a13644d4048f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:47.766924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=cd284571ab694be6af36a13644d4048f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:47.768209 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:47.768209 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:47.768209 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:47.769597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.787418 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2263/4545] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:47 2022] DELETE /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/cd284571ab694be6af36a13644d4048f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:47.793079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:47.806412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23356e6-c406-4f93-963c-4664aff2c36c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:47.896546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:47.897244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:47.897569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:47.897845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/cd284571ab694be6af36a13644d4048f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:47.899033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cd284571ab694be6af36a13644d4048f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:47.901243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:47.934406 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:48.040561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role cd284571ab694be6af36a13644d4048f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:48.040749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.045032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.047874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2283/4546] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:47 2022] DELETE /identity/v3/roles/cd284571ab694be6af36a13644d4048f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:48.052784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:48.061837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:48.097201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368454c-16a6-44fe-a7e6-1e89ee57c519 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:48.283234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:48.291108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:48.291108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:48.291851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:48.321392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7d30435d3b604f568f0c7a5ab10ffbcd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:48.323434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:48.362769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.363654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.420322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.421293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.428111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:48.440281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2264/4547] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:16:48 2022] PATCH /identity/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd => generated 278 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:48.442912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e8dc9-1f1c-4efc-a244-88720198e6b4 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:48.577887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:48.578540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:48.578817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:48.579094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:48.615286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7d30435d3b604f568f0c7a5ab10ffbcd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:48.617579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:48.668164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.673131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.807148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.832310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.864621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.903355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] The token cache is being invalidate because project 7d30435d3b604f568f0c7a5ab10ffbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:48.904036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.909156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.943775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.953719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.957267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7d30435d3b604f568f0c7a5ab10ffbcd', 'request_id': 'req-047a4b13-f6e8-4fd7-a02f-50e3407164fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:48.976546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2284/4548] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:16:48 2022] DELETE /identity/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:48.981026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:48.982749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:49.013826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44316-8d34-4dba-9e55-52b814c52838 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:49.203381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:49.204223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:49.204580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:49.204862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/0a215c4bfe914901a4a6b359e82363e6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:49.208712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c9ec7311b74246ce830c73957bc44ae0, implied_role_id=0a215c4bfe914901a4a6b359e82363e6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:49.217940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f48ae-0757-484d-b32c-7de023ce257c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:49.243797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:49.245685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:49.252165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2265/4549] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:48 2022] DELETE /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0/implies/0a215c4bfe914901a4a6b359e82363e6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:49.272553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4b13-f6e8-4fd7-a02f-50e3407164fe tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:49.351340 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:49.500495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:49.501395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:49.501395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:49.501670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/0a215c4bfe914901a4a6b359e82363e6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:49.502952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0a215c4bfe914901a4a6b359e82363e6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:49.504785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:49.511048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:49.511699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:49.512119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:49.581191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] MFA Rules not processed for user `b83c3369cd634d3aa48681fd18492a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:49.583553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:49.604954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 0a215c4bfe914901a4a6b359e82363e6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:49.605236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:49.606009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:49.608986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2285/4550] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:49 2022] DELETE /identity/v3/roles/0a215c4bfe914901a4a6b359e82363e6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:49.613826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:49.615551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:49.683963 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:49.770272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2266/4551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:16:49.780373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c2a68-6a68-4816-9879-9f6fd6ce7e0b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:49.792385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:49.793279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:49.793561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:49.793841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c9ec7311b74246ce830c73957bc44ae0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:49.796188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c9ec7311b74246ce830c73957bc44ae0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:49.799519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:49.901115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role c9ec7311b74246ce830c73957bc44ae0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:49.901438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:49.903203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:49.909992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2286/4552] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:49 2022] DELETE /identity/v3/roles/c9ec7311b74246ce830c73957bc44ae0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:49.915717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:49.935367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8bf7c-5a3a-46e0-bf38-2b81a3081525 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.100209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.101010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.101302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.101673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.109026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.110752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.149817 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2267/4553] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:49 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 520 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:50.154213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.155926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:50.172258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5681297-e070-4db2-aa2d-19c45f9087cb tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.341707 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:50.372592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.374301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.376785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.378130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.385508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.387258 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:50.387258 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:50.387258 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:50.391621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.394338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.400567 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:50.400567 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:50.400567 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:50.402296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.424004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2287/4554] 10.222.0.16 () {58 vars in 1345 bytes} [Sun Sep 25 01:16:50 2022] HEAD /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:50.429985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.445178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd278791-1755-4efb-aef2-f203b4a2aaa5 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.463281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.466070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.467756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.469671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.475035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.476101 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:50.476101 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:50.476101 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:50.478242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.493566 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2268/4555] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:16:50 2022] GET /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 520 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:50.497912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.520552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f9a68-708b-4902-937a-f7f25cd88918 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.535563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.539177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.540404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.541268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.548465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.550537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.579921 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2288/4556] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:50 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:50.583510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.599450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada7a9-364e-4b8c-9ab3-849e6b8a2269 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.694825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.695495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.695829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.696976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.698836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.701363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b.: keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = query.one() Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._iter().one() Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._only_one_row( Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:50.716189 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 25 01:16:50.717440 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 25 01:16:50.718869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 25 01:16:50.718869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:50.718869 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:16:50.718869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2269/4557] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:16:50 2022] GET /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 137 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:50.722103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.749478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe348-23ec-4f41-ab73-b477441b0c0c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.756276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.756805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.757069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.757347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.759924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.761599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b.: keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = query.one() Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._iter().one() Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._only_one_row( Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:50.778757 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 25 01:16:50.779976 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 25 01:16:50.781172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 25 01:16:50.781172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 25 01:16:50.781172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 25 01:16:50.781172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 625d34acf9c64f71b8903c25dc84f325 does not imply dcc91c39caad4fe390f2ff89f5d4050b. Sep 25 01:16:50.781172 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:50.790886 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2289/4558] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:50 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 137 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:50.795941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.812595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aba89d-31d6-4b45-8b89-4b94ab31034b tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.820225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.820980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.821826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.822108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.824694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.826804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:50.864672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2270/4559] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:50 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 520 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:50.868629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:50.887012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a1a2-7539-4690-837d-6ece4766e6ba tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:50.981126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:50.982081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:50.982271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:50.982501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:50.984840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:50.986667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.034881 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2290/4560] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:50 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184 => generated 520 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:51.039229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.059533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e75c6-8b3e-4bd6-ad3c-f665840d8862 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:51.115156 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:51.246075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:51.247192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:51.247703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:51.248202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:51.252857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c8344da74d5f4ac09f30ed6788c7c184, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:51.257064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.310742 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2271/4561] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:51 2022] PUT /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 519 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:51.315003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.342062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b11fc-26e9-4a23-ac8e-993554a7df32 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:51.534782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:51.535870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:51.536165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:51.536447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:51.537040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:51.542839 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:51.542839 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:51.542839 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:51.544942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.597060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2291/4562] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:16:51 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:51.601921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.616723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911e12-3917-4cfb-96f7-67fa5c9bdab7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:51.622474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:51.623339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:51.623755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:51.624136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:51.626030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c8344da74d5f4ac09f30ed6788c7c184, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:51.627825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.641833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2272/4563] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:51 2022] DELETE /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:51.646147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.669109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266354a2-04cb-4a3b-ac13-299f06702ad2 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:51.752443 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:51.789039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:51.791650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:51.792060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:51.792445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:51.794836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:51.796833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.812811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2292/4564] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:51 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:51.818444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.834508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062af44-1c92-4624-96c0-aed8d2f5406c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:51.940494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:51.941535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:51.941835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:51.942118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:51.944420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:51.946828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:51.958204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2273/4565] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:51 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:51.965001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:51.992660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcabf-7a4a-488f-a3c8-2633298f888f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.151887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.152537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.152820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.153099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.157155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.161051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.192256 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2293/4566] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:51 2022] GET /identity/v3/roles => generated 2321 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:52.193552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.217551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb0547-23bd-4484-9c6c-d03aa097ff0d tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.242330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.246026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.247232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.248132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.249270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.251393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.329364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.330172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2274/4567] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:16:52 2022] POST /identity/v3/roles => generated 234 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:52.362700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7013f-fb92-4c07-a1be-a785ca16015c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.391092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.391770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.392062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.392429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/9f75f4ac93314affaee95147fbd276eb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.394937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:update_role(role_id=9f75f4ac93314affaee95147fbd276eb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.395924 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:52.395924 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:52.395924 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:52.397024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.467554 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2294/4568] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:16:52 2022] PATCH /identity/v3/roles/9f75f4ac93314affaee95147fbd276eb => generated 237 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:16:52.469295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.482849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e28d-bbc8-45b8-8f49-7dd0e1a76967 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.490640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.491635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.492189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.493236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/9f75f4ac93314affaee95147fbd276eb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.513572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:get_role(role_id=9f75f4ac93314affaee95147fbd276eb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.515032 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:52.515032 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:52.515032 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:52.516723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.519193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2275/4569] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:16:52 2022] GET /identity/v3/roles/9f75f4ac93314affaee95147fbd276eb => generated 237 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:52.523149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.536255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce95c7-e500-462d-9497-b568c0cf6ad3 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.548908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.549934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.550656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.551150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.552049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.576756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.596701 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2295/4570] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:16:52 2022] GET /identity/v3/roles => generated 2549 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:16:52.600281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.616909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe1518-11cf-46dd-903e-8676c7568830 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.628029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.629342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.631757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.632570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/9f75f4ac93314affaee95147fbd276eb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.636039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9f75f4ac93314affaee95147fbd276eb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.637781 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:52.637781 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:52.637781 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:52.639233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.709869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 9f75f4ac93314affaee95147fbd276eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:52.710656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:52.711916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:52.720014 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2276/4571] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:52 2022] DELETE /identity/v3/roles/9f75f4ac93314affaee95147fbd276eb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:52.728594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:52.733063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:52.786647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5a258-0126-4f60-a053-f85a9afb261f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:52.918608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:52.919703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:52.920135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:52.920713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:52.922749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:52.925172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:52.972195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2296/4572] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:52 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 520 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:52.976247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.004128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ed3a-b80f-44ae-b163-44501e6c6f67 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.022162 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:53.155161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.155652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.156043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.156448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.164695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.168072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.246549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.247311 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2277/4573] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:52 2022] PUT /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184 => generated 520 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:16:53.257972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a31a-a4b4-4350-8f61-e558d3502d1f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.317227 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:53.413731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.414350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.415205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.415570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.422056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c8344da74d5f4ac09f30ed6788c7c184, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.422056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.464253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2297/4574] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 25 01:16:53 2022] PUT /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 519 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:16:53.468062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.486794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d641d-b478-4efb-a527-4d35474e76cd tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.632968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.634738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.635223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.635512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.636758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.638739 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:53.638739 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:53.638739 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:53.639791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.674281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2278/4575] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:16:53 2022] GET /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies => generated 488 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:53.678666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.696517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae87eb-accd-4f7d-b636-9d143c13038c tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.703243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.703907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.704189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.704464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.705723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=625d34acf9c64f71b8903c25dc84f325)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.706775 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:53.706775 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:53.706775 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:53.707673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.717339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2298/4576] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:16:53 2022] GET /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies => generated 659 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:53.723665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.741962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45489bc-99bd-4913-ae2d-21de6d3083e8 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.747564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.748284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.748572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.748848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.752274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c8344da74d5f4ac09f30ed6788c7c184, implied_role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.754626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.781683 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2279/4577] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:53 2022] DELETE /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184/implies/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:53.783237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.796896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4730ac-d350-41ff-82ad-11cffb168fa9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:53.868412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:53.869280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:53.869706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:53.870032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:53.874447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:53.876116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:53.889328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2299/4578] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:53 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/c8344da74d5f4ac09f30ed6788c7c184 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:16:53.891664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:53.906074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7dc7-e6b1-4a0f-b1e0-03be7ce070c7 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:54.017569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:54.018345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:54.018711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:54.019336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:54.021297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=625d34acf9c64f71b8903c25dc84f325, implied_role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:54.023370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:54.062998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2280/4579] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 25 01:16:53 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325/implies/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:54.065060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:54.078485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea071-8106-45d9-abfc-63da5dbf4820 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:54.242490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:54.244008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:54.245102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:54.245397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:54.256252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Could not find domain: 7d30435d3b604f568f0c7a5ab10ffbcd.: keystone.exception.DomainNotFound: Could not find domain: 7d30435d3b604f568f0c7a5ab10ffbcd. Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d30435d3b604f568f0c7a5ab10ffbcd. Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:16:54.264566 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:16:54.267777 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7d30435d3b604f568f0c7a5ab10ffbcd. Sep 25 01:16:54.268923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:16:54.270584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2300/4580] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:16:54 2022] PATCH /identity/v3/domains/7d30435d3b604f568f0c7a5ab10ffbcd => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:16:54.271588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:54.285211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8c1f-781c-4cf0-9e3c-8cfe404a1aff tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:54.304261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:54.360905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:54.362158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:54.362942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/users/ea91b38daea04c388499146f6fbca1fc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:54.372878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ea91b38daea04c388499146f6fbca1fc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:54.382633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:54.484743 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:54.605267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:54.609153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:54.645442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:54.667511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:54.668699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea91b38daea04c388499146f6fbca1fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:54.690265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2281/4581] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:54 2022] DELETE /identity/v3/users/ea91b38daea04c388499146f6fbca1fc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:54.695084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:54.698415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:54.743770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfbb2-727b-4a5d-8387-56a4441b262a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:54.866062 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:55.012009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:55.012672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:55.012998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:55.013295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/ee322f5cef5845b7b0f72002f294d9f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:55.015944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee322f5cef5845b7b0f72002f294d9f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:55.016980 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:55.016980 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:16:55.016980 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:16:55.020703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:55.106427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role ee322f5cef5845b7b0f72002f294d9f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:55.106781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.108606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.114055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2301/4582] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:54 2022] DELETE /identity/v3/roles/ee322f5cef5845b7b0f72002f294d9f2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:55.115320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:55.135963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58b8-7a58-4e1e-ba6e-fe069d242078 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:55.257056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:55.257822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:55.259859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:55.260456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/groups/8212eb68d588442faedfd0648ef0d5b7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:55.262720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8212eb68d588442faedfd0648ef0d5b7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:55.265696 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:16:55.265696 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:16:55.265696 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:16:55.278400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:55.436246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2282/4583] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:16:55 2022] DELETE /identity/v3/groups/8212eb68d588442faedfd0648ef0d5b7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:55.439696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:55.441101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:55.466196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e207-bd0b-488b-8281-9fb5df608a09 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:55.634735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:55.635408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:55.635693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:55.635983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:55.645083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b2eace077d74a3d94ddf84b4c42d7e5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:55.647436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:55.765256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2eace077d74a3d94ddf84b4c42d7e5', 'request_id': 'req-f826f5c1-3a61-4c31-ab77-b25d29b77013'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.775818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2eace077d74a3d94ddf84b4c42d7e5', 'request_id': 'req-f826f5c1-3a61-4c31-ab77-b25d29b77013'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.792051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2eace077d74a3d94ddf84b4c42d7e5', 'request_id': 'req-f826f5c1-3a61-4c31-ab77-b25d29b77013'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.833365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] The token cache is being invalidate because project 0b2eace077d74a3d94ddf84b4c42d7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:55.833859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.835146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:55.840621 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2302/4584] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:16:55 2022] DELETE /identity/v3/projects/0b2eace077d74a3d94ddf84b4c42d7e5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:55.846053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:55.848807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:55.871158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2695-bd58-4435-ad13-91c4dbefebe9 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:55.960107 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:55.973092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:55.973092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:55.973492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:55.973801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:55.975399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=78d3b45199c64549ac43ab2e5da084db)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:55.978326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:56.011894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.013523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.057347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.058510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.064505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2283/4585] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:16:55 2022] PATCH /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db => generated 278 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:16:56.068326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:56.091636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826f5c1-3a61-4c31-ab77-b25d29b77013 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:56.164172 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:56.239791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:56.240956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:56.242368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:56.243389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/domains/78d3b45199c64549ac43ab2e5da084db` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:56.280641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=78d3b45199c64549ac43ab2e5da084db)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:56.283497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:56.347876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.359311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '78d3b45199c64549ac43ab2e5da084db'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.539075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.554114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.568342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.596451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] The token cache is being invalidate because project 78d3b45199c64549ac43ab2e5da084db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:56.596817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.597684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.609140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.614776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.615828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '78d3b45199c64549ac43ab2e5da084db', 'request_id': 'req-349b3c70-d4ea-4ded-935d-27826df20719'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.626625 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2303/4586] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:16:56 2022] DELETE /identity/v3/domains/78d3b45199c64549ac43ab2e5da084db => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:56.632077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:56.634325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:56.656710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfb4ef-7e80-4934-995a-32b5173b023f tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:56.822967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:56.823618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:56.823907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:56.824191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/c8344da74d5f4ac09f30ed6788c7c184` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:56.825684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c8344da74d5f4ac09f30ed6788c7c184)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:56.836112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:56.921900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role c8344da74d5f4ac09f30ed6788c7c184 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:56.922935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.925366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:56.930891 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2284/4587] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:56 2022] DELETE /identity/v3/roles/c8344da74d5f4ac09f30ed6788c7c184 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:56.934692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:56.936264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:56.955904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b3c70-d4ea-4ded-935d-27826df20719 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:57.141995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:57.142662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:57.142951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:57.143225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/dcc91c39caad4fe390f2ff89f5d4050b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:57.147549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dcc91c39caad4fe390f2ff89f5d4050b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:57.149160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:57.151350 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:57.256016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role dcc91c39caad4fe390f2ff89f5d4050b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:57.256495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.257629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.267087 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2304/4588] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:56 2022] DELETE /identity/v3/roles/dcc91c39caad4fe390f2ff89f5d4050b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:57.268676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:57.270432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:57.309050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ee9aa-523b-4a9f-a04d-725f33444390 tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:57.446873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '334d287fc34642549fab4a7a19b50050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476a314e66a244e9afe4db07b2b048fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:57.447547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:57.447962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:57.448250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] PATH_INFO: `/v3/roles/625d34acf9c64f71b8903c25dc84f325` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:57.449907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorizing `identity:delete_role(role_id=625d34acf9c64f71b8903c25dc84f325)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:57.452413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:57.514946 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:57.550177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invalidating the token cache because role 625d34acf9c64f71b8903c25dc84f325 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:16:57.550878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.552271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe089ae7-6c7b-4565-834f-22acfa25050a tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.555408 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2285/4589] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:57 2022] DELETE /identity/v3/roles/625d34acf9c64f71b8903c25dc84f325 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:57.559454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:57.561046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:57.655848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa396-b149-4bed-abe9-30698ed353bc tempest-RolesV3TestJSON-380167755 tempest-RolesV3TestJSON-380167755-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:57.830831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:57.831499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:57.831782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:57.832057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] PATH_INFO: `/v3/users/205baf9d5fe84ca3aa4475f3767dbc8f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:57.835994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=205baf9d5fe84ca3aa4475f3767dbc8f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:57.838877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:57.940926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205baf9d5fe84ca3aa4475f3767dbc8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.956633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205baf9d5fe84ca3aa4475f3767dbc8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.984476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205baf9d5fe84ca3aa4475f3767dbc8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.985786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205baf9d5fe84ca3aa4475f3767dbc8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.985970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205baf9d5fe84ca3aa4475f3767dbc8f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:16:57.990199 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:58.013173 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2305/4590] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:16:57 2022] DELETE /identity/v3/users/205baf9d5fe84ca3aa4475f3767dbc8f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:16:58.017536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d2df3-e8c2-4e82-8fca-f5e537f17a28 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:58.018630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d2df3-e8c2-4e82-8fca-f5e537f17a28 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:58.019396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d2df3-e8c2-4e82-8fca-f5e537f17a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:58.066480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7a0d2df3-e8c2-4e82-8fca-f5e537f17a28 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:58.068131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a0d2df3-e8c2-4e82-8fca-f5e537f17a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:58.250349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2286/4591] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:58.330642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:58.332440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:58.457927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473da2-753e-4ea5-bd2c-21eb9e36ad9d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:16:58.467064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:16:58.467850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:58.468002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:58.468263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:58.499869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:16:58.501534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad865e0-aa83-4eca-a5ae-2d8d474b6e40 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:16:58.525470 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2306/4592] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:16:59.491501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:59.492147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:59.492147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:59.562571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] MFA Rules not processed for user `ab3394e2971741d7aa5956de0d4afba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:59.563837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:59.702602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2287/4593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:59.713438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:16:59.714108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:16:59.714108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:16:59.738417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] MFA Rules not processed for user `ab3394e2971741d7aa5956de0d4afba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:16:59.740087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:16:59.755426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2307/4594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:16:59.982282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:16:59.984195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:00.199050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b5605-fc39-4839-aeac-456783317799 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:00.206457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:00.207225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:00.207604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:00.208712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:00.240155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:00.242086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:00.269790 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2288/4595] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:16:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:01.222559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:01.224698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:01.283600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2689e6f-5f50-4ab5-91d3-ea3fd74054cb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:01.299281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:01.300153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:01.300686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:01.301128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] PATH_INFO: `/v3/projects/cb5652d0e7db4b1f891a36dae7d01a58` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:01.302912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5652d0e7db4b1f891a36dae7d01a58)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:01.307048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:01.426550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5652d0e7db4b1f891a36dae7d01a58', 'request_id': 'req-16567724-f013-4ab1-bc45-a5e0485cdea8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.443172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5652d0e7db4b1f891a36dae7d01a58', 'request_id': 'req-16567724-f013-4ab1-bc45-a5e0485cdea8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.473952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5652d0e7db4b1f891a36dae7d01a58', 'request_id': 'req-16567724-f013-4ab1-bc45-a5e0485cdea8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.496088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] The token cache is being invalidate because project cb5652d0e7db4b1f891a36dae7d01a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:01.496604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.497994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.501789 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2308/4596] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:01 2022] DELETE /identity/v3/projects/cb5652d0e7db4b1f891a36dae7d01a58 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:01.505943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:01.516061 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:01.525605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96b5b6-c7d7-492a-88e6-660cf918fe7e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:01.668414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:01.669107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:01.669396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:01.669722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] PATH_INFO: `/v3/users/334d287fc34642549fab4a7a19b50050` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:01.672677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] RBAC: Authorizing `identity:delete_user(user_id=334d287fc34642549fab4a7a19b50050)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:01.674763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:01.764135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334d287fc34642549fab4a7a19b50050'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.764870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334d287fc34642549fab4a7a19b50050'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.798957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334d287fc34642549fab4a7a19b50050'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.889681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334d287fc34642549fab4a7a19b50050'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.898141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71bd47ed-7727-4c82-9371-a60d4b30871d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334d287fc34642549fab4a7a19b50050'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:01.937840 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2289/4597] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:01 2022] DELETE /identity/v3/users/334d287fc34642549fab4a7a19b50050 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:03.369570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:03.371140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:03.396693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567724-f013-4ab1-bc45-a5e0485cdea8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:03.580150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:03.580836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:03.581101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:03.581371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] PATH_INFO: `/v3/projects/476a314e66a244e9afe4db07b2b048fd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:03.583674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=476a314e66a244e9afe4db07b2b048fd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:03.585643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:03.623043 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:03.693244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476a314e66a244e9afe4db07b2b048fd', 'request_id': 'req-fad827cb-185e-4c3a-893a-e0184bf6e2cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:03.706346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476a314e66a244e9afe4db07b2b048fd', 'request_id': 'req-fad827cb-185e-4c3a-893a-e0184bf6e2cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:03.733625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476a314e66a244e9afe4db07b2b048fd', 'request_id': 'req-fad827cb-185e-4c3a-893a-e0184bf6e2cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:03.750515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] The token cache is being invalidate because project 476a314e66a244e9afe4db07b2b048fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:03.753538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:03.754612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fad827cb-185e-4c3a-893a-e0184bf6e2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:03.761458 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2309/4598] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:03 2022] DELETE /identity/v3/projects/476a314e66a244e9afe4db07b2b048fd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:03.764819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:03.765357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:03.765473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:03.802600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:03.804322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:03.973110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:03.973427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:03.974036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:03.982916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2290/4599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:04.033469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:04.037757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:04.069818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2310/4600] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:04.073848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.086881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f33f7-ba5d-450e-a009-3cdeecfa7d0b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.101610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.102967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.103434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.103711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.104960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:04.105469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.107766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.137757 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2291/4601] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:04.143976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.163263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea493-b3a0-414c-84cc-53986851cfe4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.177189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.178157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.178636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.179106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.180586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.183375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.252568 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2311/4602] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:04 2022] POST /identity/v3/projects => generated 397 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:17:04.256453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.276406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523fea-d967-4bb0-bd8e-f1e922e8f398 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.302592 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:04.430108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.431172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.431627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.432094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.433696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.436197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.490057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.491406 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2292/4603] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:04 2022] POST /identity/v3/users => generated 305 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:04.508829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b75d5-103d-4411-b440-ec9e70e8adab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.523122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.524965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.525254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.525560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.526538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.531484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.559677 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2312/4604] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:04.565818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.581900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a66d-297f-4eed-a874-1c3887701ade admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.589268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.590217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.590587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.591027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] PATH_INFO: `/v3/projects/5b2fea3201d24ccb89bae6517a7beeba/users/5a52a899cdbc4368a41c1f79475cdfa6/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.615432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2fea3201d24ccb89bae6517a7beeba, user_id=5a52a899cdbc4368a41c1f79475cdfa6, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.632243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.672823 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2293/4605] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:04 2022] PUT /identity/v3/projects/5b2fea3201d24ccb89bae6517a7beeba/users/5a52a899cdbc4368a41c1f79475cdfa6/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:04.694733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.716228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa705c-4fba-4047-951a-3bd52c803076 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.856461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.857587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.858051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.858848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.859690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.862002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978587-0af0-445e-b7fe-d9eccd3bd32d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.887694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2313/4606] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:04.889122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:04.914851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8ecfd-2a63-4dea-bb6d-8f92b50f6cb1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:04.943390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:04.944599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.944880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.945156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] PATH_INFO: `/v3/projects/5b2fea3201d24ccb89bae6517a7beeba/users/5a52a899cdbc4368a41c1f79475cdfa6/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:04.948474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2fea3201d24ccb89bae6517a7beeba, user_id=5a52a899cdbc4368a41c1f79475cdfa6, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:04.951496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:04.981635 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2294/4607] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:04 2022] PUT /identity/v3/projects/5b2fea3201d24ccb89bae6517a7beeba/users/5a52a899cdbc4368a41c1f79475cdfa6/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:04.992806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:04.992806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:04.993080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.072705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] MFA Rules not processed for user `5a52a899cdbc4368a41c1f79475cdfa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:05.074151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:05.171787 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:05.228061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2314/4608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:05.234000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:05.402471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30823e2-1e24-4d86-801c-719f3f709a0e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:05.408457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:05.409054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.409324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.409622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.410411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:05.415481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:05.465165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2295/4609] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:05 2022] POST /identity/v3/projects => generated 397 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:05.469080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:05.483644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a234a-dfee-4bda-b04b-a024d239c98a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:05.628626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:05.631394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.631830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.632854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.633682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:05.635968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:05.670556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2315/4610] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:05 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:05.674382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:05.692857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b2f1-6f8c-4db2-ae39-a933d4a0f69d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:05.702343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:05.703857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.704331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.704529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.705215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:05.708062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:05.730455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2296/4611] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:05.734406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:05.758142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363dad9-16e6-4c93-bfc0-397c1771c6d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:05.771105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:05.771881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.772885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.774665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.775427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:05.777165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189d15-0126-448d-9549-f49436075c97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:05.814612 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2316/4612] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:05.817458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:05.833642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa063-c7f9-4896-b361-881ddf5710e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:05.848823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:05.850054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.850518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.850821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] PATH_INFO: `/v3/projects/017474918192452e9777bdf754287533/users/8ef69277b58743ba9e08fd78fe699d92/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:05.887834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017474918192452e9777bdf754287533, user_id=8ef69277b58743ba9e08fd78fe699d92, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:05.896195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:05.937486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2297/4613] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:05 2022] PUT /identity/v3/projects/017474918192452e9777bdf754287533/users/8ef69277b58743ba9e08fd78fe699d92/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:05.949493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:05.949879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:05.950113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:06.049960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] MFA Rules not processed for user `8ef69277b58743ba9e08fd78fe699d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:06.055788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:06.175404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2317/4614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:17:06.202491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:06.204398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:06.221930 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:06.306588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b75c-ae03-45e4-8765-327ed6d42496 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:06.311165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:06.311791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:06.312067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:06.312332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:06.425382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:06.428412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f66e6-20ba-4481-92a9-901deacbda64 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:06.443776 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2298/4615] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:07.062406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:07.130097 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:07.145656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dee26-eec2-446a-8069-6369953a53ec None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:07.151371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:07.152108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:07.152458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:07.152817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] PATH_INFO: `/v3/users/5a52a899cdbc4368a41c1f79475cdfa6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:07.153967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a52a899cdbc4368a41c1f79475cdfa6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:07.155927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:07.217667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a52a899cdbc4368a41c1f79475cdfa6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:07.227819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a52a899cdbc4368a41c1f79475cdfa6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:07.244050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a52a899cdbc4368a41c1f79475cdfa6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:07.245011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a52a899cdbc4368a41c1f79475cdfa6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:07.245738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a52a899cdbc4368a41c1f79475cdfa6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:07.264091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2318/4616] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:07 2022] DELETE /identity/v3/users/5a52a899cdbc4368a41c1f79475cdfa6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:07.268363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:07.268876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:07.268975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:07.294285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:07.295922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:07.368457 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2299/4617] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:17:07.382453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:07.389864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:07.511188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1cb4-0855-4c58-a05f-a868bc708ab7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:07.517552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:07.518649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:07.519526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:07.520044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:07.534624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:07.536489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:07.552344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2319/4618] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:08.466419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:08.469124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:08.498086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605165-69bb-430d-bf1c-50c811aab5c7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:08.510855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:08.512618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:08.513338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:08.514138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] PATH_INFO: `/v3/projects/5b2fea3201d24ccb89bae6517a7beeba` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:08.516395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2fea3201d24ccb89bae6517a7beeba)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:08.519783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:08.613490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2fea3201d24ccb89bae6517a7beeba', 'request_id': 'req-0f4da751-959e-46a6-a11a-32f08071a731'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.614846 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:08.627174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2fea3201d24ccb89bae6517a7beeba', 'request_id': 'req-0f4da751-959e-46a6-a11a-32f08071a731'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.639513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2fea3201d24ccb89bae6517a7beeba', 'request_id': 'req-0f4da751-959e-46a6-a11a-32f08071a731'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.670697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] The token cache is being invalidate because project 5b2fea3201d24ccb89bae6517a7beeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:08.671219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.672535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.677381 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2300/4619] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:08 2022] DELETE /identity/v3/projects/5b2fea3201d24ccb89bae6517a7beeba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:08.682281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:08.697045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc29c-eccf-469c-b0a1-bb1e71db512f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:08.830248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:08.830837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:08.831115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:08.831383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] PATH_INFO: `/v3/users/8ef69277b58743ba9e08fd78fe699d92` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:08.832744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef69277b58743ba9e08fd78fe699d92)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:08.834900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:08.861184 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:08.933202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef69277b58743ba9e08fd78fe699d92'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.941998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef69277b58743ba9e08fd78fe699d92'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.979080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef69277b58743ba9e08fd78fe699d92'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.979803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef69277b58743ba9e08fd78fe699d92'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:08.980425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef69277b58743ba9e08fd78fe699d92'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.010668 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2320/4620] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:08 2022] DELETE /identity/v3/users/8ef69277b58743ba9e08fd78fe699d92 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:09.554173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:09.557465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:09.636772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:09.638310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:09.653074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da751-959e-46a6-a11a-32f08071a731 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:09.757513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8d1a5-467e-4bbd-bd87-cb68275c4380 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:09.767129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:09.767784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:09.768063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:09.768926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] PATH_INFO: `/v3/projects/017474918192452e9777bdf754287533` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:09.770402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=017474918192452e9777bdf754287533)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:09.772435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:09.778631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:09.779421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:09.779816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:09.780451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:09.782856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:09.801443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:09.803781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7606413-d1e3-4cef-8202-0ec9ea54aa9b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:09.823227 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2301/4621] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:09.834708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017474918192452e9777bdf754287533', 'request_id': 'req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.843229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017474918192452e9777bdf754287533', 'request_id': 'req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.852133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017474918192452e9777bdf754287533', 'request_id': 'req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.867924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] The token cache is being invalidate because project 017474918192452e9777bdf754287533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:09.868304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.869296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a84c1024-91b2-4a86-ab23-61dca5f3a7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:09.871033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2321/4622] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:09 2022] DELETE /identity/v3/projects/017474918192452e9777bdf754287533 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:09.875970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:09.876265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:09.876544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:09.904493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:09.905807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:10.040647 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2302/4623] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:10.048184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.048486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.051265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.086813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:10.088352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:10.113771 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2322/4624] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:10.119119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.126269 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:10.147166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91f39e-b5a0-4af4-90f2-0ebedab3d5d0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.182560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.184536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.187560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.188095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.189009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:10.189599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.195742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.228551 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2303/4625] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:10.232903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.247023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcced5-55d1-4387-87e1-a667cadbc537 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.260685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.261434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.261801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.262145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.262939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.264885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.301500 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:10.323044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2323/4626] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:10 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:10.327357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.352292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdec50-14a6-4d87-a0bb-92afc1b4b09f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.469690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.470475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.470864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.471145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.471798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.473892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.503006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2304/4627] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:10 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:10.503936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.521500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6391d-36f2-4438-bcd6-8d33feb1b17d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.530823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.532545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.534548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.535397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.537076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.540277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.556252 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2324/4628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:17:10.560116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.574998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6b15-88ce-4f3c-a6fe-bf03e21ec290 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.580511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.581294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.581630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.581906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.582569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.584320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542723ff-d4d1-4a2f-8b0a-1e1664a35758 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.604983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:10.612657 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2305/4629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:10.618516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a35db7-1d88-48fb-b843-7c5c11f82ebf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:10.625081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:10.626283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.626736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.627176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] PATH_INFO: `/v3/projects/00f430b9214b48ccb76f28c080298b0e/users/6cb19827b20b4794ad9dba37729cb622/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.648066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f430b9214b48ccb76f28c080298b0e, user_id=6cb19827b20b4794ad9dba37729cb622, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:10.652289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:10.681778 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2325/4630] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:10 2022] PUT /identity/v3/projects/00f430b9214b48ccb76f28c080298b0e/users/6cb19827b20b4794ad9dba37729cb622/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:10.690246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:10.690932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:10.691491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:10.745039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] MFA Rules not processed for user `6cb19827b20b4794ad9dba37729cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:10.746734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:10.865632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2306/4631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:10.866740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.018922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef734202-8cd3-402b-91f9-1fc680467b18 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.025129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.025936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.026217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.026491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.027241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.029239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.079170 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2326/4632] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:10 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:11.083721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.101911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64260e4-7ae3-42e5-9c6f-9c3076621909 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.191217 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:11.206762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.207881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.207881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.208123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.208918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.210943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.246361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2307/4633] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:11 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:11.249996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.266505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7970b8-de15-4694-8512-07e55a96881c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.274664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.275229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.275515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.275789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.276586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.278524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.294036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2327/4634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:11.297570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.314646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257bab6-76ae-4fc2-8c1d-aaa8835cbde6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.321481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.322541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.323183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.323650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.324508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.326550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1bdd0-fcb9-4d15-8d59-c63113d637bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.342233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2308/4635] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:11.346500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.360962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a283-881e-4535-a5f2-c4d24e0ddc29 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.369171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.369898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.370235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.370520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] PATH_INFO: `/v3/projects/937c9218713a42cb9eb2288a7d47cabc/users/c9c1b4a6ae7f401ebafc4b8613afc24a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.404009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=937c9218713a42cb9eb2288a7d47cabc, user_id=c9c1b4a6ae7f401ebafc4b8613afc24a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.411282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.448321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2328/4636] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:11 2022] PUT /identity/v3/projects/937c9218713a42cb9eb2288a7d47cabc/users/c9c1b4a6ae7f401ebafc4b8613afc24a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:11.458990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.459712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.460185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.517964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] MFA Rules not processed for user `c9c1b4a6ae7f401ebafc4b8613afc24a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:11.532829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:11.678877 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2309/4637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:11.693646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:11.695553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:11.785551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30e4a3-80d2-47fd-8932-9f21594ff62a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:11.791603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:11.792481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:11.792995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:11.793534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:11.830305 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:11.890736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:11.894848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:11.918295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2329/4638] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:12.140326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:12.158999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c7a9-6a38-43f8-aeec-b3b2db634309 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:12.167512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:12.168612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:12.169158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:12.169678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:12.182542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:12.185130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:12.204864 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2310/4639] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:14.428711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:14.431651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:14.552882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:14.560608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdab84-e080-46b0-99e1-c2828cede129 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:14.564943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:14.566155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:14.566609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:14.576669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:14.579140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:14.614717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:14.617051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f53924-162c-4af0-9df8-e46bfc2abef7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:14.651100 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2330/4640] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:14.684957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb579a8-1159-4471-9440-6a69a1d8a982 service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:14.690924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:14.691777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:14.692126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:14.692507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] PATH_INFO: `/v3/users/6cb19827b20b4794ad9dba37729cb622` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:14.693832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb19827b20b4794ad9dba37729cb622)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:14.696540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:14.782038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb19827b20b4794ad9dba37729cb622'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:14.783194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb19827b20b4794ad9dba37729cb622'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:14.797952 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:14.803631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb19827b20b4794ad9dba37729cb622'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:14.825956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb19827b20b4794ad9dba37729cb622'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:14.827582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb19827b20b4794ad9dba37729cb622'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:14.872775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2311/4641] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:14 2022] DELETE /identity/v3/users/6cb19827b20b4794ad9dba37729cb622 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:14.877074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:14.877587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:14.879522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:14.923972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:14.925891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:15.062969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2331/4642] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:15.090645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:15.092129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:15.265345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4b918-208b-4f92-ad7a-c04712386b2b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:15.274409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:15.275047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:15.275748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:15.279388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:15.293531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:15.298224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:15.315615 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2312/4643] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:16.456754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:16.458264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:16.487988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628af65-0fb0-4ad1-b918-88810cf9b4d2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:16.510924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:16.511443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:16.511865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:16.512267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] PATH_INFO: `/v3/projects/00f430b9214b48ccb76f28c080298b0e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:16.521074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f430b9214b48ccb76f28c080298b0e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:16.523101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:16.621563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f430b9214b48ccb76f28c080298b0e', 'request_id': 'req-bf31abbb-9769-4415-922a-77a87dacd801'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:16.631094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f430b9214b48ccb76f28c080298b0e', 'request_id': 'req-bf31abbb-9769-4415-922a-77a87dacd801'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:16.654741 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:16.657918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f430b9214b48ccb76f28c080298b0e', 'request_id': 'req-bf31abbb-9769-4415-922a-77a87dacd801'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:16.697383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] The token cache is being invalidate because project 00f430b9214b48ccb76f28c080298b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:16.698084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:16.699745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf31abbb-9769-4415-922a-77a87dacd801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:16.701651 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2332/4644] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:16 2022] DELETE /identity/v3/projects/00f430b9214b48ccb76f28c080298b0e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:16.705792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:16.719917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b99a-3cbb-44eb-aaec-a07605c431cc service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:16.886030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:16.886365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:16.886659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:16.889034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] PATH_INFO: `/v3/users/c9c1b4a6ae7f401ebafc4b8613afc24a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:16.893911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c1b4a6ae7f401ebafc4b8613afc24a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:16.899138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:17.028659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b14-1ba3-4d94-bb1a-c13ce4283214 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:17.029145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b14-1ba3-4d94-bb1a-c13ce4283214 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:17.029606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b14-1ba3-4d94-bb1a-c13ce4283214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:17.057747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c1b4a6ae7f401ebafc4b8613afc24a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:17.059773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c1b4a6ae7f401ebafc4b8613afc24a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:17.084465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2f613b14-1ba3-4d94-bb1a-c13ce4283214 None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:17.086335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f613b14-1ba3-4d94-bb1a-c13ce4283214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:17.087180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c1b4a6ae7f401ebafc4b8613afc24a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:17.117929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c1b4a6ae7f401ebafc4b8613afc24a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:17.119143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c1b4a6ae7f401ebafc4b8613afc24a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:17.122489 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:17.146858 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2313/4645] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:16 2022] DELETE /identity/v3/users/c9c1b4a6ae7f401ebafc4b8613afc24a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:17.217707 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2333/4646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:17:18.023846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.025576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:18.148236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716b2c8-e399-434a-8cfe-3cc5c2e1e86c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.154092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.155104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.155628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.156170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] PATH_INFO: `/v3/projects/937c9218713a42cb9eb2288a7d47cabc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.157677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937c9218713a42cb9eb2288a7d47cabc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.159887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.237936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937c9218713a42cb9eb2288a7d47cabc', 'request_id': 'req-6c8388fa-3b6e-4301-8f9c-9f983217a857'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:18.250438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937c9218713a42cb9eb2288a7d47cabc', 'request_id': 'req-6c8388fa-3b6e-4301-8f9c-9f983217a857'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:18.259077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937c9218713a42cb9eb2288a7d47cabc', 'request_id': 'req-6c8388fa-3b6e-4301-8f9c-9f983217a857'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:18.277093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] The token cache is being invalidate because project 937c9218713a42cb9eb2288a7d47cabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:18.277794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:18.278672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6c8388fa-3b6e-4301-8f9c-9f983217a857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:18.281373 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2314/4647] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:18 2022] DELETE /identity/v3/projects/937c9218713a42cb9eb2288a7d47cabc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:18.286786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.287652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.288103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.312779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:18.314221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:18.425715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2334/4648] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:18.435647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.436875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.437777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.453182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.455587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:18.487448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:18.489224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:18.501590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2315/4649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:18.505641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.517910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f88b5f-ba58-4201-bf81-faa72772ae58 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.540199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.540905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.541292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.541808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.542479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:18.542783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.544860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.565179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2316/4650] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:18.569245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.573616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562e1d-23a8-41ff-8c86-cf631fdfa023 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.577384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.578024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.578305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.578580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.580416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b211d37-9565-46ad-a9c2-26b0c1f1d9fe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.581606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:18.586261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.587099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.587752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.588037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.588675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.590638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.593928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.595388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.606673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2335/4651] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:18.621030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2317/4652] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:18.625247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.636905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27642-7c82-4ad0-9502-0e2b4a8e2a39 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.672664 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:18.699115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.700426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.700709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.700975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.701906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.703822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.732324 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2336/4653] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:18 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:18.733739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.746493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d08e-4960-4bd1-9ebd-3222b678a6f2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.752324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.752961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.753240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.753612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.754272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.755884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.774483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2318/4654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:18.776558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.795892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be72e7-92ed-4269-8a30-eb00b04fc1a0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.803086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.803783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.804134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.804488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.805223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.807037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d58f1-4dcf-4cf7-872a-104b71364a91 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.818925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2337/4655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:18.822420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:18.833811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715d88-b52a-48d4-b6a9-9fa88127831b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:18.839590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:18.841354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.842172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.842172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] PATH_INFO: `/v3/projects/d42e4617b1564b02bcd3a121a7b74fa1/users/4f2109e2331342aa8ac5aa4d4171e5a3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.858352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42e4617b1564b02bcd3a121a7b74fa1, user_id=4f2109e2331342aa8ac5aa4d4171e5a3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:18.861023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:18.885437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2319/4656] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:18 2022] PUT /identity/v3/projects/d42e4617b1564b02bcd3a121a7b74fa1/users/4f2109e2331342aa8ac5aa4d4171e5a3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:18.890883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:18.891174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:18.891453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:18.931569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] MFA Rules not processed for user `4f2109e2331342aa8ac5aa4d4171e5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:18.932820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:19.047464 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2338/4657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:17:19.062713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:19.064561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:19.084460 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:19.164541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d82dd-f1ec-4b2f-894f-d896e778ce58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:19.170347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:19.172241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:19.173090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:19.173090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:19.205663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:19.207403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7689fd8-e817-4573-9be5-04f4e71eca9c service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:19.231314 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2320/4658] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:19.366576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:19.460467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095e86a-858b-4653-9b13-93f28a2d983b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:19.466952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:19.467937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:19.468379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:19.469029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] PATH_INFO: `/v3/users/4f2109e2331342aa8ac5aa4d4171e5a3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:19.471640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2109e2331342aa8ac5aa4d4171e5a3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:19.475303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:19.547162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2109e2331342aa8ac5aa4d4171e5a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:19.548930 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:19.566410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2109e2331342aa8ac5aa4d4171e5a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:19.583678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2109e2331342aa8ac5aa4d4171e5a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:19.585300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2109e2331342aa8ac5aa4d4171e5a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:19.586127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2109e2331342aa8ac5aa4d4171e5a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:19.624079 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2339/4659] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:19 2022] DELETE /identity/v3/users/4f2109e2331342aa8ac5aa4d4171e5a3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:19.626750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:19.627142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:19.627519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:19.672603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:19.675121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:19.769505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2321/4660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:19.789722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:19.791455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:19.885093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e07f1-431e-451c-a57f-fcf20f5a7325 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:19.889953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:19.890773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:19.894637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:19.895059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:19.910944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:19.916430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c265a8-295f-4515-94b4-e5f450a5e928 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:19.932195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2340/4661] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:20.733969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:20.735989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:20.784340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d604-bcc0-49a3-83fc-cac27d754e29 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:20.798589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:20.799322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:20.800373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:20.800790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] PATH_INFO: `/v3/projects/d42e4617b1564b02bcd3a121a7b74fa1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:20.806277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42e4617b1564b02bcd3a121a7b74fa1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:20.809516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:20.916564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42e4617b1564b02bcd3a121a7b74fa1', 'request_id': 'req-45aff105-0078-48e8-887d-dafdb1b54cf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:20.927777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42e4617b1564b02bcd3a121a7b74fa1', 'request_id': 'req-45aff105-0078-48e8-887d-dafdb1b54cf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:20.939476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42e4617b1564b02bcd3a121a7b74fa1', 'request_id': 'req-45aff105-0078-48e8-887d-dafdb1b54cf4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:20.974215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] The token cache is being invalidate because project d42e4617b1564b02bcd3a121a7b74fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:20.975045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:20.979120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45aff105-0078-48e8-887d-dafdb1b54cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:20.980906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2322/4662] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:20 2022] DELETE /identity/v3/projects/d42e4617b1564b02bcd3a121a7b74fa1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:20.985977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:20.986590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:20.986590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.028508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:21.030230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:21.154829 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2341/4663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:21.253915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.254376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.254772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.280680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:21.281965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:21.290543 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2323/4664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:21.295169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.306597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bfef2-3f3a-4f03-84c8-fccfd622e59d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.311587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.312313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.312592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.312906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.313558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:21.313859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.315481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.330660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2342/4665] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:21.333699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.344251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d937e-69aa-4d9d-adad-d3ebb6b11679 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.349880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.350498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.350776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.351051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.351741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.353735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.383714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2324/4666] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:21 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:21.388366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.400052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff28a-8eac-4899-a3df-9d40d3dedf56 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.455954 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:21.465513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.466623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.467086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.467488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.468387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.470515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.505759 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2343/4667] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:21 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:21.505923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.516954 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:21.523145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fa3ea-1e56-4b38-bb61-b628510cffca admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.533495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.534498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.534861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.535270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.536169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.538363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.553840 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2325/4668] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:21.559333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.572369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a21c6-69f3-40f4-a971-134436e2ccba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.578640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.579452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.580260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.580260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.580867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.582663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977cbc4-9218-4351-8909-868b8bbb8305 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.601450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2344/4669] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:21.603124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.614147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee319-3ed3-4f2d-978d-c779e0747a8b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:21.622723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:21.623302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.623489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.624305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] PATH_INFO: `/v3/projects/ace2756781c743b2ad292ffe6ec29988/users/cdc1d8bfa22a4e29952bd21494b6525e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.671117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace2756781c743b2ad292ffe6ec29988, user_id=cdc1d8bfa22a4e29952bd21494b6525e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:21.688340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:21.728988 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2326/4670] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:21 2022] PUT /identity/v3/projects/ace2756781c743b2ad292ffe6ec29988/users/cdc1d8bfa22a4e29952bd21494b6525e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:21.741635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:21.742463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:21.742746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:21.793508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] MFA Rules not processed for user `cdc1d8bfa22a4e29952bd21494b6525e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:21.795440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:21.921815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:21.923825 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2345/4671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:21.995337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be91bfa-b774-4b1c-958a-4d5128c22946 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.000186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.001002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.001118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.001319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.002131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.003903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.034335 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2327/4672] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:17:22.039241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.050803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9573df-b004-46bb-94a7-e5333d779f74 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.120259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.120981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.121490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.121969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.123430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.125791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.154552 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2346/4673] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:22 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:17:22.158865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.172538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03fe8-8058-41bb-921a-e2e73fac8d25 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.178766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.180423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.181034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.181427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.182676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.184995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.204940 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2328/4674] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:22.210370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.221413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0138-0b94-46ad-8970-6624285ea266 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.228275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.229696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.229696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.229928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] PATH_INFO: `/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4/users/654f6446b3eb47059205cbd7c7ef0863/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.246912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4d2e6655a148058ae2173da0a5b4c4, user_id=654f6446b3eb47059205cbd7c7ef0863, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.249883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.268767 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2347/4675] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:22 2022] PUT /identity/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4/users/654f6446b3eb47059205cbd7c7ef0863/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:22.275424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.288202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22388-0349-47a5-aaff-ae3973c0aec7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.370113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.370936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.371220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.371492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.372742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.374842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61d5a2-19f5-4998-b07f-bf05bf8e20b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.417001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2329/4676] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:22.421817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.440902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109291-8510-4401-91dc-ed5918e2449d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.455587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.456486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.456844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.457972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] PATH_INFO: `/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4/users/654f6446b3eb47059205cbd7c7ef0863/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.460089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4d2e6655a148058ae2173da0a5b4c4, user_id=654f6446b3eb47059205cbd7c7ef0863, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.463756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.489470 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2348/4677] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:22 2022] PUT /identity/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4/users/654f6446b3eb47059205cbd7c7ef0863/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:22.496947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.497377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.497729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.531960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] MFA Rules not processed for user `654f6446b3eb47059205cbd7c7ef0863`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:22.533793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:22.569106 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:22.618056 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2330/4678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:22.630581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:22.635267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:22.658765 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:22.727099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada277-6660-4284-896d-5744aed65624 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:22.731483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:22.732110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:22.732393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:22.732664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:22.806143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:22.807623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:22.818437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2349/4679] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:24.421166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:24.426334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:24.449022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271023-7f7a-412d-80c0-34aac9c46626 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:24.461139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:24.464681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:24.465195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:24.468488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:24.537277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:24.539425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:24.553836 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2331/4680] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:28.452217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:28.454775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:28.564338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805f01-68cf-4c00-b81a-ee2123aaf0c4 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:28.570667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:28.571357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:28.571644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:28.571924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] PATH_INFO: `/v3/users/996dbc72936a46fda11429f9f8438100` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:28.573642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] RBAC: Authorizing `identity:delete_user(user_id=996dbc72936a46fda11429f9f8438100)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:28.580372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:28.674189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996dbc72936a46fda11429f9f8438100'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:28.685129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996dbc72936a46fda11429f9f8438100'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:28.701062 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:28.708764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996dbc72936a46fda11429f9f8438100'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:28.709860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996dbc72936a46fda11429f9f8438100'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:28.710525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d7456b66-8ada-4a83-b94f-1481ebaf07da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996dbc72936a46fda11429f9f8438100'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:28.727839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2350/4681] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:28 2022] DELETE /identity/v3/users/996dbc72936a46fda11429f9f8438100 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:28.982300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:28.996900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f06eb-dd51-45e6-970b-f30e7bd8d107 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:29.079798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:29.080701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.080992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.081269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] PATH_INFO: `/v3/projects/512a9166d806477ab93d8eed468bab93` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.082457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512a9166d806477ab93d8eed468bab93)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:29.084563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:29.267115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512a9166d806477ab93d8eed468bab93', 'request_id': 'req-529b531e-6e12-4404-a5ed-c5b0a8c27765'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:29.281314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512a9166d806477ab93d8eed468bab93', 'request_id': 'req-529b531e-6e12-4404-a5ed-c5b0a8c27765'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:29.299761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512a9166d806477ab93d8eed468bab93', 'request_id': 'req-529b531e-6e12-4404-a5ed-c5b0a8c27765'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:29.325269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] The token cache is being invalidate because project 512a9166d806477ab93d8eed468bab93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:29.328733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:29.329954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-529b531e-6e12-4404-a5ed-c5b0a8c27765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:29.336172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2332/4682] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:28 2022] DELETE /identity/v3/projects/512a9166d806477ab93d8eed468bab93 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:29.342946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.343309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.343659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.383263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:29.390047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:29.545222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2351/4683] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:29.550599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.550599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.550599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.607650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:29.610170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:29.632797 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2333/4684] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:29.634161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:29.647551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a629-4229-48da-a6d9-05ba9102342d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:29.663143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:29.667591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.667911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.668196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.668957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:29.669184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:29.677633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:29.704799 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2352/4685] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:29.709232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:29.726969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877f9f2-23ba-4439-904c-8b4a85dd0cd4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:29.735080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:29.735861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.736156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.736642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.737293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:29.739335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:29.785360 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2334/4686] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:29 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:29.789132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:29.803492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0ad8-31a2-40ca-a0a0-c55ac91bca71 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:29.917483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:29.920272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:29.922344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:29.923046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:29.923868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:29.930497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:29.989658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2353/4687] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:29 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:17:29.994734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:30.011447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecdb11-9229-428d-8fb5-7dcf4ef24173 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:30.021287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:30.025077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:30.025610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:30.026630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:30.030530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:30.035919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:30.067958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:30.070668 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2335/4688] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:30.120535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225aac1-ed05-4766-a1a6-86a73bae2c76 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:30.140329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:30.142495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:30.142884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:30.143762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:30.145308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:30.148944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003ce9b-8d32-4d1d-85cd-356f8f262820 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:30.170083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:30.176789 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:30.182018 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2354/4689] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:30.188011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3c0c-7b36-4f2b-8e3a-cd51fd11babc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:30.203292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:30.204431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:30.204946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:30.205266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] PATH_INFO: `/v3/projects/ba24a0d735e74e24aa2cabf4233d0e71/users/67ce0396cdb949558664fac11b83aca1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:30.254117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba24a0d735e74e24aa2cabf4233d0e71, user_id=67ce0396cdb949558664fac11b83aca1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:30.257201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:30.277455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2336/4690] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:30 2022] PUT /identity/v3/projects/ba24a0d735e74e24aa2cabf4233d0e71/users/67ce0396cdb949558664fac11b83aca1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:30.281387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f242-8c9c-4c51-9efb-821f9f2a44e0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:30.281737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f242-8c9c-4c51-9efb-821f9f2a44e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:30.282018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f242-8c9c-4c51-9efb-821f9f2a44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:30.317729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6900f242-8c9c-4c51-9efb-821f9f2a44e0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:30.320363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6900f242-8c9c-4c51-9efb-821f9f2a44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:30.402486 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:30.433317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2355/4691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:30.496958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:30.498771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:30.596441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa117b-1945-41da-9a80-287ff09d40ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:30.605681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:30.606323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:30.606645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:30.606881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:30.628484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:30.630576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:30.649586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2337/4692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:31.046361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:31.048485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:31.049080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:31.180608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:31.184923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:31.340479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2356/4693] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:31.426172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:31.428834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:31.565174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba068-d010-48d8-8425-ab921cf44170 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:31.572541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:31.573812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:31.574316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:31.574954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:31.587482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:31.589353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efadb9-4210-4c1c-8473-980e259d7d91 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:31.603120 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2338/4694] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:17:40.241170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:40.243584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:40.566632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3c757-93e8-4af0-8910-92a0b2d37c15 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:40.574245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:40.575266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:40.575715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:40.576180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:40.582700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:40.726363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:40.728361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf7000-d23e-4785-bd7b-f59356e1abbc service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:40.762518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2357/4695] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:41.598299 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:45.805799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:45.806499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:45.806499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:45.878801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:45.880203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:46.038226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2339/4696] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:46.048084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:46.048577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:46.048710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:46.059798 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:46.094657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:46.097913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:46.108970 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2358/4697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:46.123048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:46.150104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ed995-9097-4b2a-9016-c93dd05cfd99 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:46.163704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:46.165957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:46.166386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:46.169038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:46.188397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:46.192629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602f098-8b2e-4c62-a38d-e35000b01404 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:46.241764 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2340/4698] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:51.103538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:51.107209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:51.168721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9d32-5cbe-427c-8305-101da6569ad1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:51.185135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:51.187604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:51.189276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:51.190992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] PATH_INFO: `/v3/users/cdc1d8bfa22a4e29952bd21494b6525e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:51.195452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc1d8bfa22a4e29952bd21494b6525e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:51.206625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:51.347946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc1d8bfa22a4e29952bd21494b6525e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:51.376707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc1d8bfa22a4e29952bd21494b6525e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:51.437713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc1d8bfa22a4e29952bd21494b6525e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:51.439321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc1d8bfa22a4e29952bd21494b6525e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:51.442994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc1d8bfa22a4e29952bd21494b6525e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:51.496026 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2359/4699] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:51 2022] DELETE /identity/v3/users/cdc1d8bfa22a4e29952bd21494b6525e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:51.498335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:51.499214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:51.499722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:51.552701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:51.555866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:51.751785 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2341/4700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:17:51.776216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:51.778365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:51.969837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da28789-d1c6-4139-a9a9-0e125ee13880 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:52.000980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:52.000980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:52.000980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:52.000980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:52.053817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:52.055767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:52.091077 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2360/4701] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:53.101025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:53.104934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:53.152125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3906f9-e523-44ca-98f5-8c4b2577b349 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:53.160163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:53.161521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:53.162145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:53.162666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] PATH_INFO: `/v3/projects/ace2756781c743b2ad292ffe6ec29988` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:53.166524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace2756781c743b2ad292ffe6ec29988)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:53.169571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:53.291927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace2756781c743b2ad292ffe6ec29988', 'request_id': 'req-ce541e82-22a6-494d-a46a-650185b3e822'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.322882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace2756781c743b2ad292ffe6ec29988', 'request_id': 'req-ce541e82-22a6-494d-a46a-650185b3e822'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.368496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace2756781c743b2ad292ffe6ec29988', 'request_id': 'req-ce541e82-22a6-494d-a46a-650185b3e822'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.468183 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:53.480568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] The token cache is being invalidate because project ace2756781c743b2ad292ffe6ec29988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:53.480851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.483097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.488235 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2342/4702] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:53 2022] DELETE /identity/v3/projects/ace2756781c743b2ad292ffe6ec29988 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:53.492260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:53.510209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0430dc-2f33-4646-b292-e2771389301d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:53.662159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:53.663665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:53.664156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:53.664563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] PATH_INFO: `/v3/users/654f6446b3eb47059205cbd7c7ef0863` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:53.666119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654f6446b3eb47059205cbd7c7ef0863)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:53.668104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:53.696023 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:53.776787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654f6446b3eb47059205cbd7c7ef0863'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.798305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654f6446b3eb47059205cbd7c7ef0863'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.837048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654f6446b3eb47059205cbd7c7ef0863'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.837878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654f6446b3eb47059205cbd7c7ef0863'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.838517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a4b5591-f082-4d68-b0bb-638304575b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654f6446b3eb47059205cbd7c7ef0863'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:53.866597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2361/4703] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:17:53 2022] DELETE /identity/v3/users/654f6446b3eb47059205cbd7c7ef0863 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:54.583339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:54.584844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:54.657174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541e82-22a6-494d-a46a-650185b3e822 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:54.888737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:54.891185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:54.892611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:54.893144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] PATH_INFO: `/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:54.897092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4d2e6655a148058ae2173da0a5b4c4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:54.903579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.039372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4d2e6655a148058ae2173da0a5b4c4', 'request_id': 'req-07f666c4-3fd2-41a6-9888-48ee591fba77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:55.047789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4d2e6655a148058ae2173da0a5b4c4', 'request_id': 'req-07f666c4-3fd2-41a6-9888-48ee591fba77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:55.070999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4d2e6655a148058ae2173da0a5b4c4', 'request_id': 'req-07f666c4-3fd2-41a6-9888-48ee591fba77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:55.126868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] The token cache is being invalidate because project 2b4d2e6655a148058ae2173da0a5b4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:17:55.127343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:55.129762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-07f666c4-3fd2-41a6-9888-48ee591fba77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:17:55.132506 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2343/4704] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:54 2022] DELETE /identity/v3/projects/2b4d2e6655a148058ae2173da0a5b4c4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:17:55.137993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.138547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.138547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.161588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:55.163585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:55.330665 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2362/4705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:55.340569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.340913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.341247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.368779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:55.371126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:55.385237 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2344/4706] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:55.389773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:55.405147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be05b8-71f9-441e-bcf6-32e6177b26be None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:55.412110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:55.416412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.417381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.417916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.419454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:17:55.419957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:55.427728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.467243 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2363/4707] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:17:55.471548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:55.487578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11303-4dc9-4744-9f5c-42d07d44c299 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:55.502953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:55.503747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.504133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.505260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.506258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:55.510012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.572106 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2345/4708] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:17:55 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:55.576366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:55.597636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766904e-fac7-400b-a006-c681f3e0572d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:55.763531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:55.764379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.764921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.765382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.766355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:55.768486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.818043 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2364/4709] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:17:55 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:17:55.820083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:55.840237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043d27b-d3ca-4c48-b80b-ce85ee9e058a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:55.857778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:55.859026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.859551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.860056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.863581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:55.865946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.890373 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2346/4710] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:55.898565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:55.920376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdb24-82f4-40f7-9fc3-bdcef7850282 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:55.937770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:55.938867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:55.939372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:55.940126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:55.941198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:55.951244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaf640-089e-47e6-a78a-6772afde0952 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:55.955918 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:55.990807 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2365/4711] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:17:55.992569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:56.020785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477f78-fed4-4ff8-ba2a-c852bd94766e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:56.036768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83858-638c-4955-a024-9235a041464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:56.037706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83858-638c-4955-a024-9235a041464e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:56.038092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83858-638c-4955-a024-9235a041464e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:56.038488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83858-638c-4955-a024-9235a041464e admin admin] PATH_INFO: `/v3/projects/6ea4ae06ca4b476db85a0a44019ddbaf/users/7f4687df5f8445c791381cacfc59e1f5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:56.078508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83858-638c-4955-a024-9235a041464e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea4ae06ca4b476db85a0a44019ddbaf, user_id=7f4687df5f8445c791381cacfc59e1f5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:56.081482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83858-638c-4955-a024-9235a041464e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:56.110089 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2347/4712] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:17:55 2022] PUT /identity/v3/projects/6ea4ae06ca4b476db85a0a44019ddbaf/users/7f4687df5f8445c791381cacfc59e1f5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:17:56.123316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf500f-6772-470c-a0b6-34fe1820c867 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:56.124019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf500f-6772-470c-a0b6-34fe1820c867 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:56.124656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf500f-6772-470c-a0b6-34fe1820c867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:56.174008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-29bf500f-6772-470c-a0b6-34fe1820c867 None None] MFA Rules not processed for user `7f4687df5f8445c791381cacfc59e1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:56.175703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-29bf500f-6772-470c-a0b6-34fe1820c867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:56.408132 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2366/4713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:56.539213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83858-638c-4955-a024-9235a041464e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:56.542936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7af83858-638c-4955-a024-9235a041464e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:56.616983 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:56.698703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83858-638c-4955-a024-9235a041464e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:56.707363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:56.707363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:56.707363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:56.707363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:56.720860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:56.722559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:56.756484 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2348/4714] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:17:57.888948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553e43-c9d1-4758-8086-33ae012a3c07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:57.889487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553e43-c9d1-4758-8086-33ae012a3c07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:57.890117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553e43-c9d1-4758-8086-33ae012a3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:57.916479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82553e43-c9d1-4758-8086-33ae012a3c07 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:57.918028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82553e43-c9d1-4758-8086-33ae012a3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:57.984722 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2367/4715] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:17:57.998560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:17:58.000093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:58.079366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c833-f68e-45ae-8cbf-6cee5b09621b service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:17:58.084421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:17:58.085430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:58.085610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:58.085881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:58.094778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:17:58.096392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63183f93-7316-4866-b9a4-71b41ad5bfdd service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:17:58.106355 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2349/4716] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:58.831520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:17:58.832690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:17:58.832690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:17:58.859278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] MFA Rules not processed for user `ab3394e2971741d7aa5956de0d4afba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:17:58.860102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:17:59.017897 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2368/4717] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:08.102625 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=46 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:08.980337 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:11.347024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbfd0-6359-4c1a-aacd-54140ec39ee9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:11.348227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbfd0-6359-4c1a-aacd-54140ec39ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:11.348758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cbfd0-6359-4c1a-aacd-54140ec39ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:11.367120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:11.369221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:11.374553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc7cbfd0-6359-4c1a-aacd-54140ec39ee9 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:11.376236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc7cbfd0-6359-4c1a-aacd-54140ec39ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:11.524363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2350/4718] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:11.544205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d31f3b-31e7-420f-8cc3-7bcac09136c9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:11.558957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:11.559590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:11.559867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:11.560143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:11.569210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:11.711371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:11.713096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:11.759064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2369/4719] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:19.399948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:19.400877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:19.401164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:19.438068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:19.439704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:19.449811 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2351/4720] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:19.466278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:19.482071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b93c9-f8b0-4f9c-be1a-f15ea8cb3c0d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:19.490523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:19.491481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:19.492000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:19.492665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:19.508909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:19.511927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0907a8-0c67-40f5-93cb-78de667e8ff9 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:19.527034 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2370/4721] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:18:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:22.049333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:22.053521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:22.251975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8518f03-4e4f-4f7b-859a-95dcdc8df044 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:22.258586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:22.259253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:22.259541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:22.259814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] PATH_INFO: `/v3/users/be2f64cb4feb4b03a269e15ea3b2e0e0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:22.269808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2f64cb4feb4b03a269e15ea3b2e0e0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:22.272736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:22.399129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2f64cb4feb4b03a269e15ea3b2e0e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:22.399842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2f64cb4feb4b03a269e15ea3b2e0e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:22.426384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2f64cb4feb4b03a269e15ea3b2e0e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:22.453206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2f64cb4feb4b03a269e15ea3b2e0e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:22.456262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2f64cb4feb4b03a269e15ea3b2e0e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:22.498572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2352/4722] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:22 2022] DELETE /identity/v3/users/be2f64cb4feb4b03a269e15ea3b2e0e0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:22.499848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:22.500357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:22.500476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:22.647073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:22.656199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:22.892476 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2371/4723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:22.907398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:22.911519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:22.937081 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:23.027242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321eedd-c267-4bb2-a479-d1a95e54425e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:23.033527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:23.034599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:23.035139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:23.036070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:23.051962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:23.054635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:23.072560 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2353/4724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:23.407876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:23.409650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:23.435001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad264-308e-4d31-a3ba-e7a9d353987c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:23.451103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:23.451913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:23.452302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:23.452683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] PATH_INFO: `/v3/users/b83c3369cd634d3aa48681fd18492a0a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:23.454041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83c3369cd634d3aa48681fd18492a0a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:23.457564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:23.463384 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:23.535460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83c3369cd634d3aa48681fd18492a0a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:23.545796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83c3369cd634d3aa48681fd18492a0a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:23.573291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83c3369cd634d3aa48681fd18492a0a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:23.577625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83c3369cd634d3aa48681fd18492a0a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:23.578533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc5dbbe-67d4-4aa3-a935-5cf9d6b5bad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83c3369cd634d3aa48681fd18492a0a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:23.614502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2372/4725] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:23 2022] DELETE /identity/v3/users/b83c3369cd634d3aa48681fd18492a0a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:23.748823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:23.750542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:23.781956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c435b4-30bc-4f86-8511-0831d3c51338 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:23.886902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:23.887999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:23.888449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:23.888912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] PATH_INFO: `/v3/projects/f77abfdfb5204656a54210ed2c7a0a30` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:23.890337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77abfdfb5204656a54210ed2c7a0a30)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:23.893300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.008839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77abfdfb5204656a54210ed2c7a0a30', 'request_id': 'req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:24.020444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77abfdfb5204656a54210ed2c7a0a30', 'request_id': 'req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:24.041158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77abfdfb5204656a54210ed2c7a0a30', 'request_id': 'req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:24.068901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] The token cache is being invalidate because project f77abfdfb5204656a54210ed2c7a0a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:24.069801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:24.070231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e92deb0-47e3-4da6-bc9f-afc5b86ee63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:24.072368 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2354/4726] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:23 2022] DELETE /identity/v3/projects/f77abfdfb5204656a54210ed2c7a0a30 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:24.076944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.077678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.078315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.103595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:24.105061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:24.228281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2373/4727] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:18:24.237380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.238752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.239156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.288394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:24.291506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:24.321864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.333930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101ed0-bd33-49f7-9cef-bfb355126381 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.339868 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2355/4728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:24.363991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.364948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.368885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.369366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.370360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:24.370833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.372883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.401007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2374/4729] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:18:24.405049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.432988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb55928-6fda-49cc-9795-a14932d4df65 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.442483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.443145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.443437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.443714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.444370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.448297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.508310 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2356/4730] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:24 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:24.512548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.523866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1bb5-0952-4673-8331-fe1333ca4e02 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.678071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.680869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:24.755565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.756804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.757088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.757824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.758493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.760487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.779812 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:24.793835 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:24.804968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2375/4731] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:24 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:18:24.814333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.827836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2fd6-f7be-40a6-8613-cd8f50bf6856 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.836133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.837373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.837847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.838283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.839112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.841663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.862162 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2376/4732] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:24.867863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.887320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd4330-266e-40fc-973b-e36fe7ae9058 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.890425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13238f-9515-4112-b1f0-46d995f1be95 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.904149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.904690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.905357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.905662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.906310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.907924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.918304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.920578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.920754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.920964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] PATH_INFO: `/v3/projects/31a0aa9bcbe5414eb0e4e412069cca3b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.923581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a0aa9bcbe5414eb0e4e412069cca3b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:24.926636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:24.936944 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2377/4733] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:24.938203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:24.962173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79743-fb7a-4c97-8ed1-f177462b3567 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:24.968390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:24.969639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:24.970509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:24.971752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] PATH_INFO: `/v3/projects/a132f7840f6c4bdca0e8411f1030682c/users/2f041235c56e44b8b50eb5c3c19b37e3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:24.997542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a132f7840f6c4bdca0e8411f1030682c, user_id=2f041235c56e44b8b50eb5c3c19b37e3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.012539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e75be-9118-4115-b22a-cd6f75521b36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.049032 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2378/4734] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:24 2022] PUT /identity/v3/projects/a132f7840f6c4bdca0e8411f1030682c/users/2f041235c56e44b8b50eb5c3c19b37e3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:18:25.053893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.055371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a0aa9bcbe5414eb0e4e412069cca3b', 'request_id': 'req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:25.055939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.056569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.072368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a0aa9bcbe5414eb0e4e412069cca3b', 'request_id': 'req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:25.088324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a0aa9bcbe5414eb0e4e412069cca3b', 'request_id': 'req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:25.111336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] The token cache is being invalidate because project 31a0aa9bcbe5414eb0e4e412069cca3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:25.112037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:25.113565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-722d7c40-a3ba-4aab-a117-e994cdf6b5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:25.116539 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2357/4735] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:24 2022] DELETE /identity/v3/projects/31a0aa9bcbe5414eb0e4e412069cca3b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:18:25.122090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc721a1-a4fc-4068-8f4e-c50b072d4629 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.124287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc721a1-a4fc-4068-8f4e-c50b072d4629 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.125651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc721a1-a4fc-4068-8f4e-c50b072d4629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.133877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] MFA Rules not processed for user `2f041235c56e44b8b50eb5c3c19b37e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:25.135952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:25.173065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6fc721a1-a4fc-4068-8f4e-c50b072d4629 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:25.176736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6fc721a1-a4fc-4068-8f4e-c50b072d4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:25.264573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2379/4736] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:25.277616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.289023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:25.334965 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2358/4737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:25.342621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.342982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.343182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.393043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:25.394300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:25.410476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2359/4738] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:25.414833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.425007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e8994-70ab-43db-a743-5b7bae255720 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.426718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319a4e-48c9-419d-be8d-5f6a5049e045 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.430660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.431395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.431582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.431761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.432036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.432405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.432684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:25.432866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.433079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.433323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.435071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.442828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.445673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.450027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2360/4739] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:25.454756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.461098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2380/4740] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:18:25.469515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be49a-6aa8-46b2-8338-1bd64d7e5bf3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.475085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.476048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.476397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.476733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.477582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.481156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.537236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2361/4741] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:25.542477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.558805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1aebd-0117-45b4-af87-da4f593a35e9 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.620893 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:25.645604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.655789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.656401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.656863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.658599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.662474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.715769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.716070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2381/4742] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:25.734661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bce2-1023-4f7e-b592-69249e5e16c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.744045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.745004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.746915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.746915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.748084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.754201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.762357 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:25.782339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.793227 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2362/4743] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:18:25.809570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c314b-5fe5-4d3d-b779-c4845c3aa875 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.824534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.825172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.825472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.825744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.826542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.828435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0373db-4ea1-4ae2-a028-cc80d673cd18 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.845870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:25.853234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2382/4744] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:25.863411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae301e-99b8-4a90-b160-4d79062478e8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:25.870563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:25.871248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.871526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.872406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] PATH_INFO: `/v3/projects/5404f5e8a04445d08a69a14616c5e008/users/c1c655b1afc54b6c98d771d6acf81ee0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:25.908546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5404f5e8a04445d08a69a14616c5e008, user_id=c1c655b1afc54b6c98d771d6acf81ee0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:25.918359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:25.952289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2363/4745] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:25 2022] PUT /identity/v3/projects/5404f5e8a04445d08a69a14616c5e008/users/c1c655b1afc54b6c98d771d6acf81ee0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:25.958915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139d7-766b-4a3e-bfb6-7a3c299b8d38 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:25.959232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139d7-766b-4a3e-bfb6-7a3c299b8d38 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:25.959600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139d7-766b-4a3e-bfb6-7a3c299b8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:26.011433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b08139d7-766b-4a3e-bfb6-7a3c299b8d38 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:26.015554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b08139d7-766b-4a3e-bfb6-7a3c299b8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:26.218197 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2383/4746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:26.235348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:26.484556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111344e-6338-409d-8061-5365bd674aaa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:26.535605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:26.536763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:26.537350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:26.538066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:26.563759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:26.573217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:26.604739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2364/4747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:36.145202 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:36.588451 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:38.064970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:38.065490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:38.066844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:38.166932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:38.183976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:38.547559 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2384/4748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:38.777369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:38.779374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:39.086503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329ac85-994d-4539-93fc-8a0d2062d2a7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:39.098393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:39.099000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:39.099658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:39.100272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:39.150465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:39.152202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c330b1-2673-4557-a225-d9528c0e0ecb service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:39.192611 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2365/4749] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:39.715848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:39.723366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:39.749511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a8396-df3a-44b0-893e-d1df019e6a84 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:39.756092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:39.758025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:39.758314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:39.762341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] PATH_INFO: `/v3/users/5db19a97588e41d1858915c9ccc48620` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:39.769987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db19a97588e41d1858915c9ccc48620)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:39.773034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:39.921956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db19a97588e41d1858915c9ccc48620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:39.949604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db19a97588e41d1858915c9ccc48620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:40.003305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db19a97588e41d1858915c9ccc48620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:40.004076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db19a97588e41d1858915c9ccc48620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:40.004843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db19a97588e41d1858915c9ccc48620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:40.045084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2385/4750] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:39 2022] DELETE /identity/v3/users/5db19a97588e41d1858915c9ccc48620 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:40.047358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:40.047899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:40.048021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:40.132624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:40.136682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:40.334618 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2366/4751] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:40.401848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:40.403363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:40.501184 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:40.537256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f1fd-c92e-4aab-9671-9e5e5bffd681 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:40.546871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:40.547517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:40.547797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:40.548070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:40.573968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:40.575780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:40.600596 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2386/4752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:42.034628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:42.036464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:42.067172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec6e05-d2d1-40f5-9528-6e1e5773bf0a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:42.114210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:42.115595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:42.115881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:42.116158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] PATH_INFO: `/v3/projects/46ae8b5de3254713b60172f6c0b351e1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:42.132478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ae8b5de3254713b60172f6c0b351e1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:42.134570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:42.300452 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:42.315229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ae8b5de3254713b60172f6c0b351e1', 'request_id': 'req-83b4837d-de3c-422b-8ced-81f5e1119f22'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.338205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ae8b5de3254713b60172f6c0b351e1', 'request_id': 'req-83b4837d-de3c-422b-8ced-81f5e1119f22'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.346736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ae8b5de3254713b60172f6c0b351e1', 'request_id': 'req-83b4837d-de3c-422b-8ced-81f5e1119f22'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.379651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] The token cache is being invalidate because project 46ae8b5de3254713b60172f6c0b351e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:42.380350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.392175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83b4837d-de3c-422b-8ced-81f5e1119f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.394330 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2367/4753] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:42 2022] DELETE /identity/v3/projects/46ae8b5de3254713b60172f6c0b351e1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:42.399082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:42.429706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350fce-d57f-40fb-80f0-f70994f76f94 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:42.727664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:42.729171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:42.729765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:42.730279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] PATH_INFO: `/v3/users/231418d4fb2246adb38aaeefb031655e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:42.731855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231418d4fb2246adb38aaeefb031655e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:42.738554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:42.796382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e538-b1cd-4ce5-82d7-867b01798cd9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:42.797428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e538-b1cd-4ce5-82d7-867b01798cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:42.797967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e538-b1cd-4ce5-82d7-867b01798cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:42.851375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0cf7e538-b1cd-4ce5-82d7-867b01798cd9 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:42.852942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0cf7e538-b1cd-4ce5-82d7-867b01798cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:42.924237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231418d4fb2246adb38aaeefb031655e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:42.956893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231418d4fb2246adb38aaeefb031655e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:43.007872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231418d4fb2246adb38aaeefb031655e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:43.009030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231418d4fb2246adb38aaeefb031655e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:43.009779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231418d4fb2246adb38aaeefb031655e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:43.042427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2387/4754] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:42 2022] DELETE /identity/v3/users/231418d4fb2246adb38aaeefb031655e => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:43.060629 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2368/4755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:43.993321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:43.994830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:44.132433 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:44.146110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da22e-ee92-4f61-b2e2-3b336c5c8346 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:44.157437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:44.158381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:44.158857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:44.159309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] PATH_INFO: `/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:44.160635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7569ed03c4fc4fd5a6e987cf82ea14fb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:44.164107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:44.272837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7569ed03c4fc4fd5a6e987cf82ea14fb', 'request_id': 'req-66c8b80e-b805-4120-b0b5-4bf40eb79b44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:44.282539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7569ed03c4fc4fd5a6e987cf82ea14fb', 'request_id': 'req-66c8b80e-b805-4120-b0b5-4bf40eb79b44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:44.302323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7569ed03c4fc4fd5a6e987cf82ea14fb', 'request_id': 'req-66c8b80e-b805-4120-b0b5-4bf40eb79b44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:44.341032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] The token cache is being invalidate because project 7569ed03c4fc4fd5a6e987cf82ea14fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:44.341335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:44.348655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66c8b80e-b805-4120-b0b5-4bf40eb79b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:44.351299 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2388/4756] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:43 2022] DELETE /identity/v3/projects/7569ed03c4fc4fd5a6e987cf82ea14fb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:44.356848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:44.357343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:44.357465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:44.423978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:44.425693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:44.554319 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2369/4757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:18:44.561763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:44.562056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:44.568832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:44.635265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:44.636689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:44.682083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2389/4758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:44.686753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:44.708831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8262-6493-4a40-bef4-dbe821feb9c6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:44.723277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:44.724324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:44.724790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:44.725322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:44.726458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:44.726965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:44.728954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:44.776496 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2370/4759] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:44.777850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:44.791289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f921-c48a-4f67-8899-69a3d503ba84 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:44.806613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:44.807443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:44.808025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:44.808865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:44.809807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:44.823194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:44.892018 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2390/4760] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:44 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:44.896322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:44.937025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45a2a0-c661-4a9c-9ff7-80cc95bceccf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:45.179841 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:45.198252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:45.199226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:45.199860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:45.200948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:45.201698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:45.204074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:45.281772 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2371/4761] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:44 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:45.287962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:45.308817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6f85b-73fb-486c-9d2a-7a29653ca210 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:45.320569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:45.321640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:45.322598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:45.323105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:45.324018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:45.326231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:45.391180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2391/4762] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:45.397386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:45.415193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f0f8-127e-4f0b-bd36-ed9f4b43642c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:45.448833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:45.449997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:45.450543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:45.451046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:45.452053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:45.473160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2b4e-df55-479a-ae47-beca9324c8a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:45.560642 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2372/4763] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:45.588045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:45.655833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bc077-6ff0-4b44-98c3-30f22072dd0b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:45.692501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:45.693825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:45.694314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:45.694772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] PATH_INFO: `/v3/projects/c8e729aceb0e4a74b34d3943024b76a1/users/e01c15992b9e4498bee89b5fe1b55d8f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:45.715242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e729aceb0e4a74b34d3943024b76a1, user_id=e01c15992b9e4498bee89b5fe1b55d8f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:45.719555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:45.751936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2392/4764] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:45 2022] PUT /identity/v3/projects/c8e729aceb0e4a74b34d3943024b76a1/users/e01c15992b9e4498bee89b5fe1b55d8f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:45.766967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:45.770270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:45.772497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:45.846910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] MFA Rules not processed for user `e01c15992b9e4498bee89b5fe1b55d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:45.849648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:46.107549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2373/4765] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:46.112191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:46.306201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d1cb-5535-44e7-93bb-87094f9f7807 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:46.320568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:46.324701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:46.325302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:46.327799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:46.328910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:46.331514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:46.409631 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2393/4766] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:46.410844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:46.431876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a7dc-0718-4935-a1b0-a783d27519b5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:46.608748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:46.609703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:46.610233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:46.610739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:46.611593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:46.614887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:46.699550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:46.699759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2374/4767] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:46 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:46.723310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db914-8f03-4c06-8da4-cf4ea10f28cd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:46.747434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:46.748266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:46.748714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:46.749701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:46.750544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:46.752402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:46.766872 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:46.799309 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2394/4768] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:46.800752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:46.816455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275165-f5b5-46c7-b35a-8e9b747e30ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:46.825487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:46.826649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:46.827120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:46.827584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] PATH_INFO: `/v3/projects/9a2df597cd6f44bf9daa92a786c81848/users/15485219060a4d3da5a007d516f1d349/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:46.852948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2df597cd6f44bf9daa92a786c81848, user_id=15485219060a4d3da5a007d516f1d349, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:46.857499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:46.887791 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2375/4769] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:46 2022] PUT /identity/v3/projects/9a2df597cd6f44bf9daa92a786c81848/users/15485219060a4d3da5a007d516f1d349/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:46.888354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:46.902387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b7d6-ff71-4b34-9808-bc832ae18dd4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:47.059014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:47.059886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:47.060753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:47.060753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:47.061501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:47.065962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75c374-4c39-45d9-96ae-c10cc4319ec9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:47.111300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2395/4770] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:47.111537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:47.129954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909e44-1099-4be7-bc33-219f4bbf6379 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:47.147448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:47.148138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:47.148418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:47.148688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] PATH_INFO: `/v3/projects/9a2df597cd6f44bf9daa92a786c81848/users/15485219060a4d3da5a007d516f1d349/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:47.149624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:47.150159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:47.150661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:47.150861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2df597cd6f44bf9daa92a786c81848, user_id=15485219060a4d3da5a007d516f1d349, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:47.153549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24dcf0-0123-4a61-a009-1900e551ec3f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:47.180384 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2376/4771] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:47 2022] PUT /identity/v3/projects/9a2df597cd6f44bf9daa92a786c81848/users/15485219060a4d3da5a007d516f1d349/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:47.190626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:47.193021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:47.193645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:47.193934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:47.194208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:47.258273 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:47.278243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] MFA Rules not processed for user `15485219060a4d3da5a007d516f1d349`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:47.279584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:47.344342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2396/4772] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:47.506688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2377/4773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:47.519421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:47.522574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:47.733493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7718-eb68-41bd-a44e-7de3f152b1b8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:47.739591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:47.740500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:47.740863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:47.741216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:47.751617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:47.753665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14788403-575c-4c72-bdad-461a910bf55d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:47.769397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2397/4774] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:49.830448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:49.911665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d1253-93b5-42ef-9b98-0be5b9abe225 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:49.912199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d1253-93b5-42ef-9b98-0be5b9abe225 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:49.912371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d1253-93b5-42ef-9b98-0be5b9abe225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:49.986256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a52d1253-93b5-42ef-9b98-0be5b9abe225 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:49.987771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a52d1253-93b5-42ef-9b98-0be5b9abe225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:50.039138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8669c-2681-43a7-b87b-8f76d0dae1d6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:50.046642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:50.047768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:50.048273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:50.048842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] PATH_INFO: `/v3/users/e01c15992b9e4498bee89b5fe1b55d8f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:50.050447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01c15992b9e4498bee89b5fe1b55d8f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:50.052873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:50.057784 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:50.144343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01c15992b9e4498bee89b5fe1b55d8f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:50.146140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01c15992b9e4498bee89b5fe1b55d8f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:50.159635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01c15992b9e4498bee89b5fe1b55d8f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:50.173936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2398/4775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:50.181864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01c15992b9e4498bee89b5fe1b55d8f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:50.183871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01c15992b9e4498bee89b5fe1b55d8f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:50.212057 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2378/4776] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:49 2022] DELETE /identity/v3/users/e01c15992b9e4498bee89b5fe1b55d8f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:50.216492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:50.216822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:50.217042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:50.254169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:50.256680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:50.389368 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2399/4777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:50.405315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:50.407368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:50.449505 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:50.521397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2f3b-752c-4d84-a464-fc50522dba7a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:50.529295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:50.532111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:50.532720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:50.533275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:50.549856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:50.552937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:50.568654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2379/4778] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:51.876978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:51.879108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:51.909555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c173-adf8-46ad-b588-047284bc2bae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:51.925439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:51.926111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:51.926387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:51.926697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] PATH_INFO: `/v3/projects/c8e729aceb0e4a74b34d3943024b76a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:51.930403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e729aceb0e4a74b34d3943024b76a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:51.934212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:52.109833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e729aceb0e4a74b34d3943024b76a1', 'request_id': 'req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.142962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e729aceb0e4a74b34d3943024b76a1', 'request_id': 'req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.175540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e729aceb0e4a74b34d3943024b76a1', 'request_id': 'req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.198149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] The token cache is being invalidate because project c8e729aceb0e4a74b34d3943024b76a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:52.198454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.199181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-860fce5f-9ca5-4b5b-a59b-92a6f8afdd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.202514 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2400/4779] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:51 2022] DELETE /identity/v3/projects/c8e729aceb0e4a74b34d3943024b76a1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:52.206898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:52.229042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884cfae-3cd7-45e8-93fb-17d0849acf81 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:52.394456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:52.395970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:52.396406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:52.396679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] PATH_INFO: `/v3/users/15485219060a4d3da5a007d516f1d349` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:52.400362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15485219060a4d3da5a007d516f1d349)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:52.405263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:52.553892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15485219060a4d3da5a007d516f1d349'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.553892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15485219060a4d3da5a007d516f1d349'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.570299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15485219060a4d3da5a007d516f1d349'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.595914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15485219060a4d3da5a007d516f1d349'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.596691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15485219060a4d3da5a007d516f1d349'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:52.619541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2380/4780] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:18:52 2022] DELETE /identity/v3/users/15485219060a4d3da5a007d516f1d349 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:54.124980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda800ab-7464-49ee-b93b-473945b482f1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:54.125932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda800ab-7464-49ee-b93b-473945b482f1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:54.127753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda800ab-7464-49ee-b93b-473945b482f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:54.169137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cda800ab-7464-49ee-b93b-473945b482f1 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:54.171560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cda800ab-7464-49ee-b93b-473945b482f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:54.267748 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:54.291623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2401/4781] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:54.508552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:54.510646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:54.611734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:54.612024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:54.612303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:54.704322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:54.705809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:54.752352 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:54.816280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5e7fd-a140-4652-98ec-d044b3edcf75 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:54.838554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:54.841348 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2402/4782] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:54.846369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:54.853736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:54.854129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] PATH_INFO: `/v3/projects/9a2df597cd6f44bf9daa92a786c81848` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:54.866094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2df597cd6f44bf9daa92a786c81848)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:54.868111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:54.869941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:54.871493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:55.022113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2df597cd6f44bf9daa92a786c81848', 'request_id': 'req-0429c4e5-9468-4818-a6c3-5d3420d4deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:55.036857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2df597cd6f44bf9daa92a786c81848', 'request_id': 'req-0429c4e5-9468-4818-a6c3-5d3420d4deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:55.055972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2df597cd6f44bf9daa92a786c81848', 'request_id': 'req-0429c4e5-9468-4818-a6c3-5d3420d4deca'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:55.077022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] The token cache is being invalidate because project 9a2df597cd6f44bf9daa92a786c81848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:55.078315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:55.079378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0429c4e5-9468-4818-a6c3-5d3420d4deca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:55.082928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2381/4783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:54 2022] DELETE /identity/v3/projects/9a2df597cd6f44bf9daa92a786c81848 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:55.101979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f8ea-a810-47fe-adae-8fea16f34175 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.103393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f8ea-a810-47fe-adae-8fea16f34175 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.104048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f8ea-a810-47fe-adae-8fea16f34175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.123755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa82329-0ce7-4654-8ccb-31f953000481 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.175387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3205f8ea-a810-47fe-adae-8fea16f34175 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:55.179116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3205f8ea-a810-47fe-adae-8fea16f34175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:55.305810 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2382/4784] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:55.313872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.314972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.315324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.338275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.339004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.339364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.339704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.344441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:55.345688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:55.345981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:55.360114 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2383/4785] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:55.364239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.381873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d703e3-2eb8-4ccc-b1c5-9d5fab920a1c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.406485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.407535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.408011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.409042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.410702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:55.413909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.417638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.438744 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:55.480533 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2384/4786] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:55.483371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.492121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.494791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.498288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4bd3-cb3b-45ac-a4fa-8cd949f131c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.505552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.506464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.506861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.507253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.508141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.510264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.529260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2403/4787] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:18:55.577448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2385/4788] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:55.581108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.594742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae8e1-b94f-439b-8045-4780139b2507 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.761852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.764200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.764692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.766159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.767495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.774222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.835520 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2404/4789] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:55 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:18:55.836124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.849113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79470cc0-1672-4294-903b-7a0649389cf2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.854675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.855314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.855599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.855878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.856598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.862603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.893292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2386/4790] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:55.898529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.922844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7686a-4306-4288-81d9-bb9f3230b913 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.935053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.935692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.942693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.943066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:55.943743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:55.945435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264788e7-0c09-488c-b400-5ed530f981b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:55.967020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2405/4791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:55.971081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:55.982208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27b56-a458-4ba2-9fbd-b35f780f0e57 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:55.998019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:55.998717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:55.999072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:55.999359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5/users/a315d6e3436442a89fd7016f1afa8972/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.044571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4291fa29af3b4a0fbc4b48548718edc5, user_id=a315d6e3436442a89fd7016f1afa8972, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:56.046736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:56.058503 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:56.084090 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2387/4792] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:55 2022] PUT /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5/users/a315d6e3436442a89fd7016f1afa8972/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:56.095330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:56.095708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:56.095998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.142717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] MFA Rules not processed for user `a315d6e3436442a89fd7016f1afa8972`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:56.144586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:56.268785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2406/4793] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:56.272861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:56.379090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754604ec-bf37-41c6-ba47-1dd635f3dfd4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:56.386879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:56.387513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:56.388188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:56.388474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.389388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:56.391098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:56.443046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2388/4794] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:56 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:56.444089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:56.457996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93853b-9844-44f2-ad0d-4c6c7b71a3e8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:56.533095 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:56.566040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:56.566734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:56.566978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:56.567260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.568073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:56.570074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:56.615137 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2407/4795] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:18:56 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:56.619356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:56.650905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f20a1-67fd-48d9-a203-88f6f3b38e24 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:56.670694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:56.671409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:56.672634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:56.672950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.673656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:56.677744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:56.709418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:56.709775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2389/4796] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:56.729262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5428b-7636-4426-87f3-6e21fa4c7e4f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:56.743770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:56.744856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:56.745393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:56.745917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] PATH_INFO: `/v3/projects/80cb5b0d29a740cbb11e272239213e33/users/ce51fed916d1499fbffbf13f25eef2e9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:56.810287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cb5b0d29a740cbb11e272239213e33, user_id=ce51fed916d1499fbffbf13f25eef2e9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:56.818395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:56.851955 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2408/4797] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:56 2022] PUT /identity/v3/projects/80cb5b0d29a740cbb11e272239213e33/users/ce51fed916d1499fbffbf13f25eef2e9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:18:56.853517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:56.867279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e003ba-0bf6-4662-af84-e3ab25cc5b88 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:57.022610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:57.023665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.023955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.024225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.024880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:57.026659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404938d-e1c9-44d8-bd22-578f86e6400b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:57.046593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2390/4798] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:18:57.050475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:57.064386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178e7d-5290-4901-b86a-b06784f2d7e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:57.077452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:57.078156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.078440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.078723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] PATH_INFO: `/v3/projects/80cb5b0d29a740cbb11e272239213e33/users/ce51fed916d1499fbffbf13f25eef2e9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.090303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cb5b0d29a740cbb11e272239213e33, user_id=ce51fed916d1499fbffbf13f25eef2e9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:57.093101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:57.112937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2409/4799] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:18:57 2022] PUT /identity/v3/projects/80cb5b0d29a740cbb11e272239213e33/users/ce51fed916d1499fbffbf13f25eef2e9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:18:57.124530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.124817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.125098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.158041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] MFA Rules not processed for user `ce51fed916d1499fbffbf13f25eef2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:57.159297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:57.258452 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:57.284536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2391/4800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:57.290984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:57.307709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bab51-d57a-4128-8a64-9b8a28a7d7fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:57.321352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:57.322164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.322449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.322726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.323394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:57.323700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:57.325500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:57.350330 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2410/4801] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:57.354677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:57.375698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e98150-6c79-4782-b6de-0b09a1d7d8e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:57.381603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:57.382239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.383362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.383362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.383605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:57.385527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:57.436413 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2392/4802] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:57 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:57.440408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:57.452117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e6362-17f4-4741-9f43-c3f60b868280 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:57.531857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:57.533363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.533866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.534313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.535136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:57.535635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:57.537704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3563b-222a-4428-847a-e4f23c9e7606 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:57.555721 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2411/4803] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:18:57.810947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:57.817655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:57.818886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea78af-2989-4934-b3ec-c7fbe125d72e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:57.819180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea78af-2989-4934-b3ec-c7fbe125d72e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:57.819454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea78af-2989-4934-b3ec-c7fbe125d72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:57.843841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a1ea78af-2989-4934-b3ec-c7fbe125d72e None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:57.845451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1ea78af-2989-4934-b3ec-c7fbe125d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:57.968597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2412/4804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:18:58.061019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75710b7-4b6e-4efa-a618-724f67257ae7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:58.069952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:58.070871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.072124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.072517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:58.084068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:58.085913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:58.111542 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2393/4805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:18:58.120963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421b7d-ea4e-40b7-9e52-5fa83ab93fd6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.121253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421b7d-ea4e-40b7-9e52-5fa83ab93fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.121565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421b7d-ea4e-40b7-9e52-5fa83ab93fd6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:58.123085 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2413/4806] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:18:58.132082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:18:58.149916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:58.169313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84abb6-87f4-41e5-8772-c5f2f1e7b714 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:58.181035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:58.181741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.182034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.182304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:58.183476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=fde2cee6c52c4c85a795f1ce9aa1abc3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:58.185617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:58.194534 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2394/4807] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:18:58 2022] GET /identity/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 369 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:58.488197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a5c1-f2f4-4065-bbdb-e2b627059e46 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.488878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a5c1-f2f4-4065-bbdb-e2b627059e46 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.489085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a5c1-f2f4-4065-bbdb-e2b627059e46 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:58.491365 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2414/4808] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:18:58.496790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:18:58.498856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:58.525332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:58.546385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8250b-421a-402f-99cd-d4032d219bd0 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:58.553185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:58.553881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.554173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.554455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:58.555667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=fde2cee6c52c4c85a795f1ce9aa1abc3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:58.559223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bf3d-57bd-4ae3-8751-3ea2e481549a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:58.561162 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2395/4809] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:18:58 2022] GET /identity/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 369 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:58.997043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947e97-df2b-4821-808d-ce1722a9623f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:58.998053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947e97-df2b-4821-808d-ce1722a9623f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:58.998330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947e97-df2b-4821-808d-ce1722a9623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.014253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.014758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.015520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.019083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2396/4810] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:18:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:18:59.023983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:18:59.038318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1f947e97-df2b-4821-808d-ce1722a9623f None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:59.040063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f947e97-df2b-4821-808d-ce1722a9623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:59.062413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.069599 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:59.078751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e137-d7f0-4efc-9006-69c0f24932ff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.090148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.090807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.093848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.094452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.099033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=fde2cee6c52c4c85a795f1ce9aa1abc3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.102361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.108266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2397/4811] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:18:59 2022] GET /identity/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 369 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:59.121960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2415/4812] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:18:59.137874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.151249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521014c-2909-4f8c-92f2-ff8c7305c9cd tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.160951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.161768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.162492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.162492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.163479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fde2cee6c52c4c85a795f1ce9aa1abc3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.165429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.236451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde2cee6c52c4c85a795f1ce9aa1abc3', 'request_id': 'req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:59.270738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde2cee6c52c4c85a795f1ce9aa1abc3', 'request_id': 'req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:59.271799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.272195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.272521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.279342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde2cee6c52c4c85a795f1ce9aa1abc3', 'request_id': 'req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:59.303686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] The token cache is being invalidate because project fde2cee6c52c4c85a795f1ce9aa1abc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:18:59.304081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:59.304947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa5f2aaa-df27-4ee0-8c07-70a44c30dc10 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:18:59.306606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2398/4813] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:59 2022] DELETE /identity/v3/projects/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:18:59.326262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:18:59.327581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:59.328385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.328748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.329970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.331600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2399/4814] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:18:59.336753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:18:59.338658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:59.369175 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:59.433289 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2416/4815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:18:59.478727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.480336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:18:59.590965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d2e1-4dd8-4855-bcf9-a2c10178566f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.601732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.603583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.604298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.604753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.606275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=4291fa29af3b4a0fbc4b48548718edc5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.610539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.629605 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2400/4816] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:18:59 2022] GET /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5 => generated 375 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:59.641170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.656447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f83ed7-d6b8-4685-b850-d3528d57d06a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.669145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.669911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.670266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.670614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.671370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:59.671755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.673487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.698664 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2417/4817] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:18:59.702609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.713447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069de3-696d-41b1-a747-67014869e622 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.720036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.720811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.721215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.721625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.722417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.725093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3df1-8403-472f-897c-0d1e78f75f12 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.768789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2401/4818] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:18:59 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:18:59.771554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:18:59.784507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7199d-cbca-4114-976f-1e2d64312913 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:18:59.872635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:18:59.873563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:18:59.874725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:18:59.875207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:18:59.876237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:18:59.876720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:18:59.878611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:18:59.898487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2418/4819] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:00.224673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41736d-5c49-4142-9fb1-8a71a515b2d9 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:00.225498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41736d-5c49-4142-9fb1-8a71a515b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:00.225498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41736d-5c49-4142-9fb1-8a71a515b2d9 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:00.229316 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2402/4820] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:19:00.245257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:00.374033 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:00.421861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:00.447166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a810-517d-481c-a747-bc7f8cbe02be tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:00.464741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:00.465437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:00.465720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:00.466000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/89ecd98342b049518496c33a80754dbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:00.470128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=89ecd98342b049518496c33a80754dbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:00.472237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:00.480050 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2419/4821] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:00 2022] GET /identity/v3/projects/89ecd98342b049518496c33a80754dbf => generated 369 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.053945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f25d8-a91f-4901-aaf2-f68db6f448f7 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.054258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f25d8-a91f-4901-aaf2-f68db6f448f7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.054867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f25d8-a91f-4901-aaf2-f68db6f448f7 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.056623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2403/4822] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:01.062786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:01.066710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.067347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.068197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.087024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.094000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:01.095564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:01.113027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799d9e-7df8-48f2-a860-7a0cea80e893 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.132281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.133019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.133629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.133914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/89ecd98342b049518496c33a80754dbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.138015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=89ecd98342b049518496c33a80754dbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.140304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.143473 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2420/4823] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:01 2022] GET /identity/v3/projects/89ecd98342b049518496c33a80754dbf => generated 369 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.205234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2404/4824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:01.254535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.274250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfaf-17f5-408e-ab35-779a051d72e8 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.286876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.287745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.288032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.288306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.288985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:01.289294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.290944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.304320 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2421/4825] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.308103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.320999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62104-3660-4a08-87d0-671b6b3fcdfe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.327649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.328436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.328814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.329182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.330241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.332362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cd2f-c46a-488f-8c7d-542dda8692cb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.371475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2405/4826] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:01 2022] POST /identity/v3/users => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:01.372995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.392582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d7b3-ed7c-4dab-b2af-b35530cd3ee6 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.403594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.405088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.405336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.405830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.406679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:01.407123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.409330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.430856 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2422/4827] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.453358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d0104-1d7c-4997-9aad-7f71d67c885f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.453678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d0104-1d7c-4997-9aad-7f71d67c885f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.453872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d0104-1d7c-4997-9aad-7f71d67c885f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.455744 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2406/4828] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:01.463926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:01.467222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:01.486641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.496537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0b6d-59b2-4e21-be67-1ed7e1ae7373 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.503965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.504832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.505396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.505933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/89ecd98342b049518496c33a80754dbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.507380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=89ecd98342b049518496c33a80754dbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.509786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.512028 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2423/4829] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:01 2022] GET /identity/v3/projects/89ecd98342b049518496c33a80754dbf => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.751068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3455b-f774-42b1-b16e-05826ee62c79 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.751701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3455b-f774-42b1-b16e-05826ee62c79 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.752042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3455b-f774-42b1-b16e-05826ee62c79 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.753621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2407/4830] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:01.763341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:01.783843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.796460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd5ee-9acf-4f24-8eb6-93b68c9144e5 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.801820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.802879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.803338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.803794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/89ecd98342b049518496c33a80754dbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.805226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=89ecd98342b049518496c33a80754dbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.807672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dd3cf-8164-4d66-880a-606a9ca9cd5b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.819087 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2424/4831] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:01 2022] GET /identity/v3/projects/89ecd98342b049518496c33a80754dbf => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:01.845670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3455b-f774-42b1-b16e-05826ee62c79 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:01.860585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3455b-f774-42b1-b16e-05826ee62c79 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:01.873053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:01.873757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.874048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.876698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/users/bfdee4887dbc41488ae1f1f223b07098` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.898410 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:01.914505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:01.916138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bfdee4887dbc41488ae1f1f223b07098)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:01.916335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:01.916564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:01.919322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:01.962625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:01.968194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:01.992546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2425/4832] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:02.032009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdee4887dbc41488ae1f1f223b07098'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.036152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdee4887dbc41488ae1f1f223b07098'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.062360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdee4887dbc41488ae1f1f223b07098'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.095212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdee4887dbc41488ae1f1f223b07098'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.096213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6c3a75b-6c88-43e6-b9ad-661a2a2ef3ba tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdee4887dbc41488ae1f1f223b07098'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.120240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2408/4833] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:01 2022] DELETE /identity/v3/users/bfdee4887dbc41488ae1f1f223b07098 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:02.124278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:02.144017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf6dd-6fe6-4f24-ad17-9ada0f513e2c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:02.254140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:02.257046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:02.257955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:02.258131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/89ecd98342b049518496c33a80754dbf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:02.259847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89ecd98342b049518496c33a80754dbf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:02.263329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:02.403421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ecd98342b049518496c33a80754dbf', 'request_id': 'req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.432606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ecd98342b049518496c33a80754dbf', 'request_id': 'req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.450618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ecd98342b049518496c33a80754dbf', 'request_id': 'req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.475824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] The token cache is being invalidate because project 89ecd98342b049518496c33a80754dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:02.476315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.477203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:02.479622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2426/4834] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:02 2022] DELETE /identity/v3/projects/89ecd98342b049518496c33a80754dbf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:02.930972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28a60e-e5e3-46fc-a0ff-81f38e224bda None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:02.931586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28a60e-e5e3-46fc-a0ff-81f38e224bda None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:02.932436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28a60e-e5e3-46fc-a0ff-81f38e224bda None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:02.936720 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2409/4835] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:02.954932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:02.960430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:03.012358 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:03.040730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.041019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.041654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.089519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:03.090808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:03.194119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:03.196631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:03.200837 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2410/4836] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:03.213340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:03.214835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:03.333873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd525e-3db7-49c0-8ba1-f00dfec30b9b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:03.339206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:03.339864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.340148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.340580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.342064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=4291fa29af3b4a0fbc4b48548718edc5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:03.344192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad93d-aa9b-4feb-9ab1-d51782aea75b tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:03.347368 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2427/4837] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:02 2022] GET /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5 => generated 375 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:03.353846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9afcc3-0550-4d10-bd80-c4c8d471bf7b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:03.360115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:03.360967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.361359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.361792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.372469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:03.374243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:03.403023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2411/4838] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:19:03.517042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f191-3b04-438a-8934-9ef1debb67cd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.517447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f191-3b04-438a-8934-9ef1debb67cd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.517806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f191-3b04-438a-8934-9ef1debb67cd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.519287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2428/4839] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:03.526578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:03.546048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:03.565232 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:03.593267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7e80f-eacb-41e9-9f0a-94f1e93893f1 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:03.605731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:03.608116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.609149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.610030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.612224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=4291fa29af3b4a0fbc4b48548718edc5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:03.616183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:03.647859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cbaaf-8dad-4a91-bb94-a8dbd97df00d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:03.648765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cbaaf-8dad-4a91-bb94-a8dbd97df00d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:03.649628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cbaaf-8dad-4a91-bb94-a8dbd97df00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:03.666189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2412/4840] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:03 2022] GET /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5 => generated 375 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:03.713065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d5cbaaf-8dad-4a91-bb94-a8dbd97df00d None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:03.715650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d5cbaaf-8dad-4a91-bb94-a8dbd97df00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:03.919020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2429/4841] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:05.023442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:05.026243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:05.069809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:05.070751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:05.071239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:05.073496 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2430/4842] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:19:05.079049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:19:05.111260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:05.136710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9a4a-63c6-49b9-9bdc-b423a436b74d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:05.152524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce51fed916d1499fbffbf13f25eef2e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80cb5b0d29a740cbb11e272239213e33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:05.153274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:05.153589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:05.154075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:05.155707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorizing `identity:get_project(project_id=4291fa29af3b4a0fbc4b48548718edc5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:05.159205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:05.166786 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2431/4843] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:19:05 2022] GET /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5 => generated 375 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:05.220293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66a57f-7b8b-4f12-8f04-ff138591ffc7 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:05.231466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:05.232877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:05.233305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:05.233680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:05.237890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:05.262068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:05.263649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1d34-de65-4187-a0be-6aac88d5618f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:05.278669 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2413/4844] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:05.810670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:05.812462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:05.910389 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:05.959125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49e2e-7341-4c5d-970a-7c58196e93db tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:05.976513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:05.977229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:05.977545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:05.977826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] PATH_INFO: `/v3/users/a315d6e3436442a89fd7016f1afa8972` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:05.979894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a315d6e3436442a89fd7016f1afa8972)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:05.982002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:06.077585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a315d6e3436442a89fd7016f1afa8972'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:06.087085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a315d6e3436442a89fd7016f1afa8972'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:06.102918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a315d6e3436442a89fd7016f1afa8972'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:06.103951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a315d6e3436442a89fd7016f1afa8972'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:06.104757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a315d6e3436442a89fd7016f1afa8972'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:06.122374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2432/4845] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:05 2022] DELETE /identity/v3/users/a315d6e3436442a89fd7016f1afa8972 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:06.126668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7c47-6e6f-43af-be07-1af2f65dad4b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:06.127560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7c47-6e6f-43af-be07-1af2f65dad4b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:06.128029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7c47-6e6f-43af-be07-1af2f65dad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:06.153165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-92cd7c47-6e6f-43af-be07-1af2f65dad4b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:06.157633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92cd7c47-6e6f-43af-be07-1af2f65dad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:06.302693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2414/4846] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:06.315022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:06.317549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:06.503665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6947e-485c-4cfb-bdc0-1668c66681f2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:06.520764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:06.521546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:06.533338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:06.534029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:06.562470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:06.567592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:06.629864 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2433/4847] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:07.757338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:07.759117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:07.759578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:07.821627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:07.823809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:07.937075 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2415/4848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:08.375096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:08.376709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:08.403539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a8ba-487a-42aa-82d4-da739460b74d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:08.445460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:08.445460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:08.445460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:08.445460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] PATH_INFO: `/v3/projects/4291fa29af3b4a0fbc4b48548718edc5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:08.457927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4291fa29af3b4a0fbc4b48548718edc5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:08.471874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:08.651448 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:08.656056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4291fa29af3b4a0fbc4b48548718edc5', 'request_id': 'req-5550375e-7ece-4394-b6b1-da06b505a45f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:08.676417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4291fa29af3b4a0fbc4b48548718edc5', 'request_id': 'req-5550375e-7ece-4394-b6b1-da06b505a45f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:08.721507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4291fa29af3b4a0fbc4b48548718edc5', 'request_id': 'req-5550375e-7ece-4394-b6b1-da06b505a45f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:08.763706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] The token cache is being invalidate because project 4291fa29af3b4a0fbc4b48548718edc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:08.764010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:08.766249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:08.776273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2434/4849] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:08 2022] DELETE /identity/v3/projects/4291fa29af3b4a0fbc4b48548718edc5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:08.779819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:08.802985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342da6c-fa62-45dc-8023-776a3bfb1cf0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:08.867140 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:09.009330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:09.010306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:09.010986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:09.011477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] PATH_INFO: `/v3/users/ce51fed916d1499fbffbf13f25eef2e9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:09.013554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce51fed916d1499fbffbf13f25eef2e9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:09.015793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:09.143840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce51fed916d1499fbffbf13f25eef2e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:09.144558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce51fed916d1499fbffbf13f25eef2e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:09.171786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce51fed916d1499fbffbf13f25eef2e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:09.206492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce51fed916d1499fbffbf13f25eef2e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:09.207528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-39bcbbdc-b154-4d39-8408-c112d5a67b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce51fed916d1499fbffbf13f25eef2e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:09.239781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2416/4850] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:08 2022] DELETE /identity/v3/users/ce51fed916d1499fbffbf13f25eef2e9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:11.001279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:11.003457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:11.033972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550375e-7ece-4394-b6b1-da06b505a45f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:11.187511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:11.188194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.188478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.188753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] PATH_INFO: `/v3/projects/80cb5b0d29a740cbb11e272239213e33` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:11.197962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cb5b0d29a740cbb11e272239213e33)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:11.206322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:11.408312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cb5b0d29a740cbb11e272239213e33', 'request_id': 'req-510c4b6e-1b37-424f-8012-4d10d54b9ca9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:11.432671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cb5b0d29a740cbb11e272239213e33', 'request_id': 'req-510c4b6e-1b37-424f-8012-4d10d54b9ca9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:11.455066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cb5b0d29a740cbb11e272239213e33', 'request_id': 'req-510c4b6e-1b37-424f-8012-4d10d54b9ca9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:11.486547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] The token cache is being invalidate because project 80cb5b0d29a740cbb11e272239213e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:11.486547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:11.492580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-510c4b6e-1b37-424f-8012-4d10d54b9ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:11.494591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2435/4851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:10 2022] DELETE /identity/v3/projects/80cb5b0d29a740cbb11e272239213e33 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:11.501517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.502278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.502718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:11.555908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:11.557967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:11.677206 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2417/4852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:11.685991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.686277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.686559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:11.751904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:11.757152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:11.773981 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2436/4853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:11.782715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:11.800070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fce2a2-6d4d-4813-9319-c92ba0848ff1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:11.820858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:11.820858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.820858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.820858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:11.821271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:11.821271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:11.829790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:11.857705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2418/4854] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:11.863019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:11.886261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593d54-f125-4859-a73c-55c27442c621 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:11.891853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:11.892644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.893000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.893329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:11.894571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:11.899002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140dbba-0ede-4173-80f3-a35c7b41a208 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:11.955476 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2437/4855] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:11 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:19:11.960471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:11.984069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bd847-dec7-4964-ba52-20f844b746ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:11.986909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:11.987499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:11.989685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.055375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:12.058087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:12.087296 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:12.203820 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:12.231625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:12.232291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:12.232569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:12.237984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.243805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:12.249285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:12.302145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2438/4856] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:12.307748 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2419/4857] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:11 2022] POST /identity/v3/users => generated 296 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:19:12.311565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:12.325134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6128c-3937-4625-afc6-5fe67d94d4a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:12.330762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:12.331631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:12.332126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:12.332657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.333727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:12.336256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:12.355153 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2439/4858] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:12.359019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:12.407106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7109-4bc8-4c87-b948-f9d58af1b2e0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:12.444608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:12.445528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:12.450650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:12.451103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.453943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:12.461076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e4ca-a71f-4c3c-9d1a-97d0434dc80f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:12.498270 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2420/4859] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:12.503542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:12.522490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0f074-0dfb-42f3-9571-f94b8860e60f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:12.539478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:12.539916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:12.540209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:12.540492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] PATH_INFO: `/v3/projects/07da64bac2374cb198fd4fe19579fbfc/users/c9035edc30954d749d5c70f004a018b3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.569630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07da64bac2374cb198fd4fe19579fbfc, user_id=c9035edc30954d749d5c70f004a018b3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:12.575134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:12.609827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2440/4860] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:12 2022] PUT /identity/v3/projects/07da64bac2374cb198fd4fe19579fbfc/users/c9035edc30954d749d5c70f004a018b3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:12.622190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:12.622687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:12.622872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:12.703205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] MFA Rules not processed for user `c9035edc30954d749d5c70f004a018b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:12.704522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:12.862645 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2421/4861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:12.868741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.009753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd7ae-6264-40da-bde2-fb381b510017 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.019431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.020704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.021161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.021503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.022558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.025616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.097574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2441/4862] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:12 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:13.101069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.117048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1df38-237c-42ba-8f63-87598044d081 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.188704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.189559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.189844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.190110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.190743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.192838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.226676 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2422/4863] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:13 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:13.228406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.255458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfe1a-f60c-4d4a-af5e-ccb0f953d907 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.282575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.283580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.283858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.284128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.284804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.286853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.314695 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2442/4864] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:13.317813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.330440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03f7-4353-471d-96b8-30db5874368d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.339219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.340463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.340947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.342427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] PATH_INFO: `/v3/projects/7d804db97c174dee932a39d3b51cf60c/users/0146dcaa053046538ea351b3e0c6a186/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.369892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d804db97c174dee932a39d3b51cf60c, user_id=0146dcaa053046538ea351b3e0c6a186, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.373050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.398769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2423/4865] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:13 2022] PUT /identity/v3/projects/7d804db97c174dee932a39d3b51cf60c/users/0146dcaa053046538ea351b3e0c6a186/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:13.403883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.424547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314ae9-8038-4a37-bac3-1fb7630279e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.524364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.525267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.525930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.526392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.527227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.529081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c406-5a9b-4927-92da-80942c2b205e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.541642 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2443/4866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:13.549245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:13.555526 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:13.565932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459fced-2e41-4319-8e83-2194fdc5a803 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:13.581979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:13.582959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.583189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.583399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] PATH_INFO: `/v3/projects/7d804db97c174dee932a39d3b51cf60c/users/0146dcaa053046538ea351b3e0c6a186/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.585551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d804db97c174dee932a39d3b51cf60c, user_id=0146dcaa053046538ea351b3e0c6a186, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:13.588321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86962e-206e-47e1-8cd9-0621e9257e9e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:13.624956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2424/4867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:13 2022] PUT /identity/v3/projects/7d804db97c174dee932a39d3b51cf60c/users/0146dcaa053046538ea351b3e0c6a186/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:13.627499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.628766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.628766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.669165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] MFA Rules not processed for user `0146dcaa053046538ea351b3e0c6a186`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:13.671897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:13.681134 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:13.813500 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2444/4868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:13.819423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:13.819895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:13.820424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:13.849020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] MFA Rules not processed for user `c9035edc30954d749d5c70f004a018b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:13.850272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:13.955762 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2425/4869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:14.566704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:14.569696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:14.611444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:14.614555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:14.772274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67d99-e9ec-4b09-ac2a-d6e22f009405 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:14.789099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642687-86a7-4f25-92f9-4b3b6c96346a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:14.790039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:14.790790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:14.791080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:14.791406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:14.806981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:14.808796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:14.809464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:14.809840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:14.810285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] PATH_INFO: `/v3/users/2f041235c56e44b8b50eb5c3c19b37e3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:14.813564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f041235c56e44b8b50eb5c3c19b37e3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:14.814578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251ecd5-e38f-4869-af25-f9acba6125cd service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:14.818928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:14.844626 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2445/4870] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:19:14.946156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f041235c56e44b8b50eb5c3c19b37e3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:14.948278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f041235c56e44b8b50eb5c3c19b37e3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:14.968234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f041235c56e44b8b50eb5c3c19b37e3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:15.000947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f041235c56e44b8b50eb5c3c19b37e3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:15.004233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f041235c56e44b8b50eb5c3c19b37e3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:15.033196 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2426/4871] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:14 2022] DELETE /identity/v3/users/2f041235c56e44b8b50eb5c3c19b37e3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:15.038479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:15.038768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:15.039045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:15.104232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:15.105493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:15.322538 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2446/4872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:15.362955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:15.364868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:15.401881 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:15.599588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9313da-6c74-417c-94ef-02c5229c99af admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:15.611028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:15.611725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:15.612104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:15.612479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:15.635160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:15.637063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df249bb-9b27-4709-b690-9bb96f59b88b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:15.662643 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2427/4873] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:17.379647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:17.382687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:17.431932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665e53-88c8-44bf-af37-d712b3ee7baa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:17.473895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:17.478502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:17.480378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:17.480819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] PATH_INFO: `/v3/projects/a132f7840f6c4bdca0e8411f1030682c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:17.486059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a132f7840f6c4bdca0e8411f1030682c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:17.506669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:17.600801 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:17.667465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a132f7840f6c4bdca0e8411f1030682c', 'request_id': 'req-4a911fee-dab5-4b41-bf3a-0a8be82bf899'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:17.686577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a132f7840f6c4bdca0e8411f1030682c', 'request_id': 'req-4a911fee-dab5-4b41-bf3a-0a8be82bf899'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:17.693274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a132f7840f6c4bdca0e8411f1030682c', 'request_id': 'req-4a911fee-dab5-4b41-bf3a-0a8be82bf899'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:17.720470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] The token cache is being invalidate because project a132f7840f6c4bdca0e8411f1030682c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:17.720788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:17.722065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4a911fee-dab5-4b41-bf3a-0a8be82bf899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:17.729649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2447/4874] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:17 2022] DELETE /identity/v3/projects/a132f7840f6c4bdca0e8411f1030682c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:17.732969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:17.732969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:17.732969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:17.771623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:17.772867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:17.978159 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2428/4875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:17.985998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:17.986204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:17.986468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.060458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:18.061854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:18.092936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2448/4876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:18.100414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.116110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a66b-5a8e-498d-9981-39e126099f5f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.130687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.131617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.132070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.132505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.133317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:18.133845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.135822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.158968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2429/4877] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:18.163980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.178335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48832262-88ad-4f64-8863-83ae9d955ba4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.189748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.190678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.191128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.192259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.193387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.195564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.283084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2449/4878] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:18 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:19:18.287209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.300929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6bc1-66ec-405d-ad39-cb1278ca1a2c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.444000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.444621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.444900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.445173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.445904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.447836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.491979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2430/4879] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:18 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:18.495923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.521378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420dcf7-595c-4db4-b568-2bf44dbfa156 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.538139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.538139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.538139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.538139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.538829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.539304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.570242 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2450/4880] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:18.574121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.587724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60476c4e-1346-45ba-b512-aa5f05e5561e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.611497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.612207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.612485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.612760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.614954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.616639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2509-432f-422a-a110-339fb9f14d63 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.652906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2431/4881] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:18.654169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.678236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053297a4-ee57-4320-bed7-772e87868a34 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:18.700987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:18.701886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.702327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.702741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] PATH_INFO: `/v3/projects/8b853bfd28bd4c9da9c04eb0401a9854/users/6f7720c53d754d48bb0ae9b2205349a1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.763611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b853bfd28bd4c9da9c04eb0401a9854, user_id=6f7720c53d754d48bb0ae9b2205349a1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:18.766613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:18.823230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2451/4882] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:18 2022] PUT /identity/v3/projects/8b853bfd28bd4c9da9c04eb0401a9854/users/6f7720c53d754d48bb0ae9b2205349a1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:18.836442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:18.837488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:18.838282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:18.895235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:18.898227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:18.927519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] MFA Rules not processed for user `6f7720c53d754d48bb0ae9b2205349a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:18.931879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:18.979787 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:19.158078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2432/4883] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:19.172111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:19.178139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:19.213496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0c49-5dd3-4006-838c-89f9d2c64f3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:19.237992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:19.239724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:19.239724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:19.239991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:19.258315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:19.302458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:19.306713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:19.338185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2452/4884] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:19.401540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df26d3-d366-4e37-8528-a4765a5c8ec4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:19.409142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:19.410954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:19.412357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:19.412884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:19.434064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:19.436228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2693af7-72dd-4f71-b1ec-47438a32085b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:19.450972 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2433/4885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:19.470466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:19.569907 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:19.622592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff87ae-9248-4f47-aadf-1b7423e7cf0b service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:19.631960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:19.632681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:19.635522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:19.635522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] PATH_INFO: `/v3/users/6f7720c53d754d48bb0ae9b2205349a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:19.635917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7720c53d754d48bb0ae9b2205349a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:19.656697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:19.766209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7720c53d754d48bb0ae9b2205349a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:19.783192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7720c53d754d48bb0ae9b2205349a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:19.799444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7720c53d754d48bb0ae9b2205349a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:19.800419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7720c53d754d48bb0ae9b2205349a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:19.802279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7720c53d754d48bb0ae9b2205349a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:19.843019 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2453/4886] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:19 2022] DELETE /identity/v3/users/6f7720c53d754d48bb0ae9b2205349a1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:19.846573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:19.847059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:19.847426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:19.877078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:19.878378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:20.000252 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2434/4887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:20.013094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:20.015930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:20.197333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010801ed-75e2-4f49-ae97-a8c936e71ea7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:20.210040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:20.211103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:20.212439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:20.213298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:20.242750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:20.244521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29948452-18f4-46a8-af46-e1a6e80e4782 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:20.303523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2454/4888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:21.343458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:21.345061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:21.371779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba6f84-c4c1-4c04-8356-0efbf00541cf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:21.405281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:21.405918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:21.406199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:21.406471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] PATH_INFO: `/v3/projects/8b853bfd28bd4c9da9c04eb0401a9854` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:21.420799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b853bfd28bd4c9da9c04eb0401a9854)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:21.428925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:21.603169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b853bfd28bd4c9da9c04eb0401a9854', 'request_id': 'req-fe1fc465-3c44-49ad-86d9-e04f98da04e4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:21.608395 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:21.622739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b853bfd28bd4c9da9c04eb0401a9854', 'request_id': 'req-fe1fc465-3c44-49ad-86d9-e04f98da04e4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:21.637998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b853bfd28bd4c9da9c04eb0401a9854', 'request_id': 'req-fe1fc465-3c44-49ad-86d9-e04f98da04e4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:21.688925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] The token cache is being invalidate because project 8b853bfd28bd4c9da9c04eb0401a9854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:21.689461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:21.690693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:21.693866 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2435/4889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:21 2022] DELETE /identity/v3/projects/8b853bfd28bd4c9da9c04eb0401a9854 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:21.700104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcd58-a52f-4691-a2d6-0dfe4cad79db None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:21.700631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcd58-a52f-4691-a2d6-0dfe4cad79db None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:21.700631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcd58-a52f-4691-a2d6-0dfe4cad79db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:21.754447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e6bcd58-a52f-4691-a2d6-0dfe4cad79db None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:21.755866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e6bcd58-a52f-4691-a2d6-0dfe4cad79db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:21.907107 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:21.942416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:21.944022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:21.954207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2455/4890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:21.955686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:21.955832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:21.956109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:21.982807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:21.984058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:22.015599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2456/4891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:22.016567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.028198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5621a3-dca7-454c-9c83-ec9fec43c9e7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.033317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.034040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.036779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.036779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.036779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:22.036779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.037560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.056402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2457/4892] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:22.057310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.070612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d37c7-ad8c-44c6-bdbc-247b284a7cf0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.079547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.080522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.080969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.081268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.082837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.085510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.102782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc465-3c44-49ad-86d9-e04f98da04e4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.126667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.130350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.130350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.130350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.134494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2458/4893] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:22 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:22.138326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:22.141028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.240808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.242890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.284077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2436/4894] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:22.328057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4ead3-4775-4a71-80ec-a372d5383541 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.347833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.350779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.350779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.350779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.350779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.362455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.436118 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2459/4895] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:22 2022] POST /identity/v3/users => generated 303 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:22.440602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.460632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f894-8103-4460-aacd-625dfcdf3da6 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.476224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.476864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.477151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.477451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.478106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.480625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.516031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2437/4896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:19:22.520659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.539758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f1242-f35f-4bf2-8c70-bcf2a5108c1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.555339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.556143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.556549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.557041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.557915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.564503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad7e6-a61a-4c74-a5e6-7c6a80332105 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.591213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:22.591456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2460/4897] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:22.643868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7f1a-3f42-4e3e-8b07-59b34ef84a70 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:22.674388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:22.679273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.681985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.681985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] PATH_INFO: `/v3/projects/c64a60207f614b37b21f45509285d424/users/a8a9cd5ff62645c39698463a4c16e332/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.739457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64a60207f614b37b21f45509285d424, user_id=a8a9cd5ff62645c39698463a4c16e332, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:22.747318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:22.770247 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2438/4898] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:22 2022] PUT /identity/v3/projects/c64a60207f614b37b21f45509285d424/users/a8a9cd5ff62645c39698463a4c16e332/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:22.782696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:22.783129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:22.783129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:22.865309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] MFA Rules not processed for user `a8a9cd5ff62645c39698463a4c16e332`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:22.866611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:23.088992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2461/4899] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:23.093554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:23.185190 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:23.233138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105436f-0beb-4124-a316-6b1738fedf0f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:23.239825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:23.240460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:23.240745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:23.241023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:23.241700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:23.243934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2d633-c5f3-442c-8c2e-54196ab80340 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:23.287456 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2439/4900] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:23 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:23.291410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:23.308039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd815-3064-4006-b33b-f042f5e64410 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:23.385204 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:23.455252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:23.464066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:23.464394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:23.464836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:23.467937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:23.469165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:23.525708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:23.526260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:23.526260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:23.531336 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2462/4901] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:23 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:23.537117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:23.580637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508d21-62ea-4ff1-a7c3-405561475b84 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:23.588935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:23.593336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:23.595593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:23.596273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:23.596608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:23.596961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:23.604171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:23.606853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:23.649181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2463/4902] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:23.650459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:23.674620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24993-8900-4140-b9c5-54c7952ad617 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:23.683099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:23.683786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:23.685018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:23.685018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] PATH_INFO: `/v3/projects/50bea4bac42c4da5916d7c78d7210b6b/users/ee05edef62674146b603159e6bb58926/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:23.734006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bea4bac42c4da5916d7c78d7210b6b, user_id=ee05edef62674146b603159e6bb58926, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:23.739706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:23.760703 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2440/4903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:23.799968 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2464/4904] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:23 2022] PUT /identity/v3/projects/50bea4bac42c4da5916d7c78d7210b6b/users/ee05edef62674146b603159e6bb58926/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:23.804556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:23.823252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477f831-9154-4457-9587-bfbfe58ba522 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:24.020343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:24.027244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:24.027528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:24.027807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:24.028489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:24.034822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183753b-1a55-41ad-bec0-8ff29859a9c3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:24.068846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2441/4905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:24.073037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:24.089582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906a68-397d-41dc-8a56-2ecf623f3423 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:24.104436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:24.105121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:24.105398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:24.105692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] PATH_INFO: `/v3/projects/50bea4bac42c4da5916d7c78d7210b6b/users/ee05edef62674146b603159e6bb58926/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:24.116775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bea4bac42c4da5916d7c78d7210b6b, user_id=ee05edef62674146b603159e6bb58926, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:24.122223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:24.180658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:24.180955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:24.181243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:24.184272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2465/4906] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:24 2022] PUT /identity/v3/projects/50bea4bac42c4da5916d7c78d7210b6b/users/ee05edef62674146b603159e6bb58926/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:24.247099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] MFA Rules not processed for user `ee05edef62674146b603159e6bb58926`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:24.247099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:24.404806 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:24.449826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2442/4907] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:24.462178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:24.464250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:24.613065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988eea-166c-464c-a2d6-b86a29b1ae1d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:24.618811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:24.619553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:24.620267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:24.620551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:24.634381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:24.636548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2826-1efd-4398-a53f-e0f4e61d7510 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:24.654446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2466/4908] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:24.866586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:25.094501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263cc4f-c5d6-4fe0-ba1a-28a10ed57e0b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:25.110341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:25.111296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:25.114430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:25.114956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] PATH_INFO: `/v3/users/a8a9cd5ff62645c39698463a4c16e332` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:25.117997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a9cd5ff62645c39698463a4c16e332)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:25.136675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:25.151110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:25.151661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:25.151865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:25.214067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:25.219152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a9cd5ff62645c39698463a4c16e332'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:25.220170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a9cd5ff62645c39698463a4c16e332'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:25.222599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:25.228712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a9cd5ff62645c39698463a4c16e332'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:25.257237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a9cd5ff62645c39698463a4c16e332'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:25.259397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55c9dc4c-2685-4b6b-8bb9-4d55f710b252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a9cd5ff62645c39698463a4c16e332'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:25.289006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2443/4909] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:24 2022] DELETE /identity/v3/users/a8a9cd5ff62645c39698463a4c16e332 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:25.291526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:25.292538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:25.292904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:25.320485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:25.323758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:25.381817 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:25.405476 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2467/4910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:25.427651 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2444/4911] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:25.462806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:25.465108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:25.561967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351be6-026f-4520-a450-f9e19a86e747 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:25.752241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:25.754472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:25.755413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:25.755805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:25.771782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:25.774434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:25.795194 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2468/4912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:27.081096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:27.083123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:27.109379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503338-80fe-41cf-9ac8-4bacb1a323ff None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:27.128313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:27.128313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:27.129193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:27.129570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] PATH_INFO: `/v3/projects/c64a60207f614b37b21f45509285d424` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:27.130767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64a60207f614b37b21f45509285d424)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:27.133647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:27.147550 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:27.320796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64a60207f614b37b21f45509285d424', 'request_id': 'req-4e878a83-2706-459e-8298-25a8c69df5b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.334387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64a60207f614b37b21f45509285d424', 'request_id': 'req-4e878a83-2706-459e-8298-25a8c69df5b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.360257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64a60207f614b37b21f45509285d424', 'request_id': 'req-4e878a83-2706-459e-8298-25a8c69df5b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.392280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] The token cache is being invalidate because project c64a60207f614b37b21f45509285d424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:27.392594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.393909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.400072 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2445/4913] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:27 2022] DELETE /identity/v3/projects/c64a60207f614b37b21f45509285d424 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:27.401537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:27.417519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8278b80-c399-434b-b896-78690346b719 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:27.564085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:27.564837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:27.565161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:27.565566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] PATH_INFO: `/v3/users/ee05edef62674146b603159e6bb58926` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:27.567546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee05edef62674146b603159e6bb58926)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:27.569531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:27.676639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee05edef62674146b603159e6bb58926'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.693143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee05edef62674146b603159e6bb58926'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.694648 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:27.719972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee05edef62674146b603159e6bb58926'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.721120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee05edef62674146b603159e6bb58926'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.723699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-458c355f-5f0f-470b-9962-92ab99b6cbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee05edef62674146b603159e6bb58926'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:27.754731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2469/4914] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:27 2022] DELETE /identity/v3/users/ee05edef62674146b603159e6bb58926 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:28.375788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:28.377880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:28.416172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878a83-2706-459e-8298-25a8c69df5b3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:28.510041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:28.510623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:28.510911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:28.511193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] PATH_INFO: `/v3/projects/50bea4bac42c4da5916d7c78d7210b6b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:28.512448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bea4bac42c4da5916d7c78d7210b6b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:28.514531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:28.640226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bea4bac42c4da5916d7c78d7210b6b', 'request_id': 'req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:28.661772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bea4bac42c4da5916d7c78d7210b6b', 'request_id': 'req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:28.686957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bea4bac42c4da5916d7c78d7210b6b', 'request_id': 'req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:28.715090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] The token cache is being invalidate because project 50bea4bac42c4da5916d7c78d7210b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:28.716594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:28.719212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ac4f1c0d-9402-46c4-96b0-eddb1398efa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:28.723721 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2446/4915] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:28 2022] DELETE /identity/v3/projects/50bea4bac42c4da5916d7c78d7210b6b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:28.729148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2c61-5f26-49d7-be00-a77674e33dd8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:28.729672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2c61-5f26-49d7-be00-a77674e33dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:28.729871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2c61-5f26-49d7-be00-a77674e33dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:28.790268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-deef2c61-5f26-49d7-be00-a77674e33dd8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:28.792008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-deef2c61-5f26-49d7-be00-a77674e33dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:28.881134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:28.881344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:28.881622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:28.924112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:28.928010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:28.958428 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:28.974431 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2470/4916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:28.983228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:28.983909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:28.984331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.027491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:29.028902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:29.044674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2447/4917] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:29.049077 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2471/4918] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:29.053440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.066680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.068292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:29.069373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6b91-f4e5-45b3-ad65-92dafa8e0f07 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.074376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.075311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.075732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.076364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.077272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:29.078826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.080968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.098591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2448/4919] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:29.114469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.127429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e15b-c647-4656-a3fb-bb99c3bf2c51 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.139437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.140062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.140362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.140626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.141270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.147678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.227391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a5c68-399f-4366-9e34-ef02105a3da0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.238412 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2449/4920] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:29 2022] POST /identity/v3/projects => generated 355 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:29.239786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.242113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.242923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.243351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.243796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.253100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.255108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.266592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2472/4921] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:19:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:19:29.402967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f768e6-19bd-4279-bb54-b73158328f57 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.421713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.422317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.422516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.422803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.423456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.425472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.475524 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2450/4922] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:29 2022] POST /identity/v3/users => generated 278 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:29.477480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.492463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada744-7037-4850-bf9d-3ef4fc78fae1 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.498397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.499095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.499451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.499803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.501314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.503343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.516981 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2473/4923] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:29.522051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.537308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7cf6-ac28-4931-80b8-622f858c3a5d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.543736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.544627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.545114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.545681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.546532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.548747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eb160-377c-4e08-a696-a8233b1629d7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.563164 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2451/4924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:29.567864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.584728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9018d-c74c-4a83-9662-6d613b689107 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.599035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.600186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.600529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.600860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] PATH_INFO: `/v3/projects/f1b083fc901744fd850ca788a7a801d8/users/983b9df61e034b70b95cd2ee5e662272/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.627628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b083fc901744fd850ca788a7a801d8, user_id=983b9df61e034b70b95cd2ee5e662272, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.631391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.656563 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2474/4925] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:29 2022] PUT /identity/v3/projects/f1b083fc901744fd850ca788a7a801d8/users/983b9df61e034b70b95cd2ee5e662272/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:29.669456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.669827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.670229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.713082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] MFA Rules not processed for user `983b9df61e034b70b95cd2ee5e662272`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:29.714442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:29.792156 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:29.798557 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2452/4926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:29.803654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.830342 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:29.875632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041f97-96ff-4476-b353-eedb5e1bc091 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:29.900906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:29.901918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:29.902387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:29.903025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:29.903780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:29.907694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f0aee-5e44-4691-8803-63becff6ec55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:29.958509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:29.958707 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2475/4927] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:29 2022] POST /identity/v3/projects => generated 357 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:29.972978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238733-d196-4b83-ad44-4d62796fb7fa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.091356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.091911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.092196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.094835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.095533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.100839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.185977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.186473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.186913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.200962 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2453/4928] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:29 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:30.203035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:30.239452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be5ef-c1b6-42f1-ba9f-d1f8605874f0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.258083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.258711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.264137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.264448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.265133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.267014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] MFA Rules not processed for user `ab3394e2971741d7aa5956de0d4afba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:30.269087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:30.271728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.289137 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2454/4929] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:30.296069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:30.342170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815ea3-eadc-41e9-9db2-3d4c4d6627f0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.350168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.350852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.351163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.352171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] PATH_INFO: `/v3/projects/10302f35edd14049ad5930aa2e9c876a/users/ad7f6792e788478b92a98b12bda73a42/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.370555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10302f35edd14049ad5930aa2e9c876a, user_id=ad7f6792e788478b92a98b12bda73a42, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.374382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.381832 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2476/4930] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:30.407453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2455/4931] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:30 2022] PUT /identity/v3/projects/10302f35edd14049ad5930aa2e9c876a/users/ad7f6792e788478b92a98b12bda73a42/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:30.420060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:30.433872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db620-c2fc-4f24-af6b-8684fef3ebba None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.530024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.531665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.532133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.532248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.533081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.535594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934200a-3cc7-449c-96f7-af2cb8c7f937 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.551734 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2477/4932] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:30.556537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:30.568675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57af45-fb9c-49da-94e9-f5811bf8983b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.573575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.574222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.574508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.574779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] PATH_INFO: `/v3/projects/10302f35edd14049ad5930aa2e9c876a/users/ad7f6792e788478b92a98b12bda73a42/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.576852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10302f35edd14049ad5930aa2e9c876a, user_id=ad7f6792e788478b92a98b12bda73a42, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.579661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.591136 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2456/4933] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:30 2022] PUT /identity/v3/projects/10302f35edd14049ad5930aa2e9c876a/users/ad7f6792e788478b92a98b12bda73a42/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:30.600984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.601177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.601483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.647656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] MFA Rules not processed for user `ad7f6792e788478b92a98b12bda73a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:30.649556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:30.745076 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:30.792226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2478/4934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:30.807751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:30.809891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:30.888100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95dec2-cc28-4f86-b02b-d4dd7c470267 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:30.892655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:30.893414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:30.893702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:30.894577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:30.926016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:30.930686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:30.956779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2457/4935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:31.059186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:31.071419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3495-fdba-4917-816c-b04bec320fa8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:31.111995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:31.112886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:31.115446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:31.115808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:31.188654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:31.190277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9775b08-c8ca-411b-88b0-f6cafd22e370 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:31.200817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2479/4936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:19:40.189289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:40.190537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:40.295059 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:40.315189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899003a-b542-4c02-94a8-29e0f4a6163d service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:40.320694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:40.321330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:40.321672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:40.321949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:40.323797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:40.481295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:40.482880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:40.495708 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2458/4937] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:41.196708 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=40 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:42.180105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:42.180433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:42.180659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:42.217042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] MFA Rules not processed for user `67ce0396cdb949558664fac11b83aca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:42.218665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:42.337966 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2480/4938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:48.155985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:48.157553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:48.173879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a815f-ce42-4775-bd48-0ba1d7d6490e service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:48.179104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:48.179752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:48.180066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:48.180574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] PATH_INFO: `/v3/users/bb85bd8db516469abb729c1fdc0a1ba1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:48.181826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb85bd8db516469abb729c1fdc0a1ba1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:48.183782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:48.234291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb85bd8db516469abb729c1fdc0a1ba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.234947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb85bd8db516469abb729c1fdc0a1ba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.242562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb85bd8db516469abb729c1fdc0a1ba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.258160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb85bd8db516469abb729c1fdc0a1ba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.270492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fa830fbe-6915-466a-9816-5531121a5572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb85bd8db516469abb729c1fdc0a1ba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.288637 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2459/4939] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:48 2022] DELETE /identity/v3/users/bb85bd8db516469abb729c1fdc0a1ba1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:48.502629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:48.518397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f856a-b08f-45ba-bb53-8c273143882f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:48.599813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:48.600396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:48.600943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:48.601455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] PATH_INFO: `/v3/projects/82fcf2dd9b2c41f5a87eda0402682069` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:48.603242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fcf2dd9b2c41f5a87eda0402682069)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:48.606333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:48.722507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fcf2dd9b2c41f5a87eda0402682069', 'request_id': 'req-b0f7fc1b-a2e7-42f1-8277-07353998fa05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.734320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fcf2dd9b2c41f5a87eda0402682069', 'request_id': 'req-b0f7fc1b-a2e7-42f1-8277-07353998fa05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.746763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fcf2dd9b2c41f5a87eda0402682069', 'request_id': 'req-b0f7fc1b-a2e7-42f1-8277-07353998fa05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.780175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] The token cache is being invalidate because project 82fcf2dd9b2c41f5a87eda0402682069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:48.780583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.781513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0f7fc1b-a2e7-42f1-8277-07353998fa05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:48.785004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2481/4940] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:48 2022] DELETE /identity/v3/projects/82fcf2dd9b2c41f5a87eda0402682069 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:48.790724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:48.791094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:48.791442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:48.870363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:48.872018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:48.898225 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:48.952606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2460/4941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:48.962070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:48.962353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:48.962623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:48.984522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:48.985843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:49.002518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2482/4942] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:49.003407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.017095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae79c-965c-4f3e-82ba-501751cc6848 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.024860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.025568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.026140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.027253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.027951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:49.028255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.030231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.050288 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2461/4943] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:19:49.054764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.066046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1f3-d7f0-4fc2-ad13-0771855337a0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.073573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.074301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.074577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.074924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.076071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.080581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.115767 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2483/4944] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:49 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:49.120458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.131882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207056-e65f-4eab-9e97-cbb431e69ad6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.198139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.199481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.199647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.199935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.200580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.202688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.234101 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2462/4945] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:49 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:49.235612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.247097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e45f-25e1-423c-b92b-ab3685d31b1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.253968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.254833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.255121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.255403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.256052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.257699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.261290 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:49.274374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2484/4946] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:49.275839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.293857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5454af-c642-4586-aacc-8467f35bbd59 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.299340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.300717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.301073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.301350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.302047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.304097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae872fd8-6c97-4cbf-96c1-51e73c684f84 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.316994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2463/4947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:49.321355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.337872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d93a4-c872-4bd8-83eb-cbbc67278010 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.342849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.343520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.343793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.344073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] PATH_INFO: `/v3/projects/3de566fc6cf74a44a29e5989042cdb5f/users/23d8b5256139488db144848ab8c0aa5e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.367744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de566fc6cf74a44a29e5989042cdb5f, user_id=23d8b5256139488db144848ab8c0aa5e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.370638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.386658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2485/4948] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:49 2022] PUT /identity/v3/projects/3de566fc6cf74a44a29e5989042cdb5f/users/23d8b5256139488db144848ab8c0aa5e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:49.399823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.400224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.400673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.441714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] MFA Rules not processed for user `23d8b5256139488db144848ab8c0aa5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:49.443877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:49.536297 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2464/4949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:49.595253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:49.598040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:49.707082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c464c-d6d6-498b-b978-0bc8cbcdd3d3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:49.713196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:49.713844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:49.714125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:49.714397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:49.723441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:49.725045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea81b-6575-4fab-b516-6d7909ab9a42 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:49.734601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2486/4950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:52.392788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:52.393743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:52.434737 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:52.530738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e86c4e-8f47-449c-8afd-3a598752535d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:52.538962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:52.539743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:52.540216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:52.540553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:52.542903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:52.579451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:52.584202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:52.620024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2465/4951] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:52.785963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:52.786902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:52.787845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:52.831127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:52.834391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:53.033457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2487/4952] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:53.066162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:53.073255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:53.240770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ac44-e036-4384-8a3d-fc4b1fd451e7 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:53.252846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:53.253688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:53.254089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:53.254464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:53.263838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:53.265749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:53.276624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2466/4953] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:53.808177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:53.810881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:53.871780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ec250-ed90-4715-9713-925aa3d99e0a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:53.892760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:53.893476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:53.893834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:53.894210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:53.896703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:53.928910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:53.930951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e4a3d-d3b0-410b-ab61-914592fdc612 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:53.957969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2488/4954] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:54.006331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:54.008874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:54.262695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85839-c164-4381-9806-81f908eaf9a5 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:54.269020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:54.269731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:54.270333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:54.270686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] PATH_INFO: `/v3/users/7f4687df5f8445c791381cacfc59e1f5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:54.272005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4687df5f8445c791381cacfc59e1f5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:54.273949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:54.349874 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:54.363651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4687df5f8445c791381cacfc59e1f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:54.364623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4687df5f8445c791381cacfc59e1f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:54.407732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4687df5f8445c791381cacfc59e1f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:54.444481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4687df5f8445c791381cacfc59e1f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:54.445617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4687df5f8445c791381cacfc59e1f5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:54.468305 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2467/4955] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:19:54 2022] DELETE /identity/v3/users/7f4687df5f8445c791381cacfc59e1f5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:54.473394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:54.473999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:54.474704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:54.518094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:54.521592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:54.619744 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:54.706607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2489/4956] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:19:54.713858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:54.719382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:54.825593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0c74-c16c-4a97-9350-30fe2087da87 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:54.829701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:54.830494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:54.831584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:54.831969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:54.842642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:54.844448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:54.856655 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2468/4957] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:55.091619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:55.093128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:55.202421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:55.207216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:55.243527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991b97c-1b62-46c7-a286-70cee0beb7ce service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:55.256859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:55.259655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.260546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.261350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] PATH_INFO: `/v3/projects/6ea4ae06ca4b476db85a0a44019ddbaf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.264804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea4ae06ca4b476db85a0a44019ddbaf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:55.273046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:55.302156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba738-098b-497a-8e63-23c98a078593 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:55.316576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:55.317205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.317546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.317775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.324162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:55.423015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea4ae06ca4b476db85a0a44019ddbaf', 'request_id': 'req-b60fd395-e87c-421d-a462-e673e8781a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:55.446231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea4ae06ca4b476db85a0a44019ddbaf', 'request_id': 'req-b60fd395-e87c-421d-a462-e673e8781a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:55.459911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea4ae06ca4b476db85a0a44019ddbaf', 'request_id': 'req-b60fd395-e87c-421d-a462-e673e8781a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:55.481238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] The token cache is being invalidate because project 6ea4ae06ca4b476db85a0a44019ddbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:19:55.481585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:55.483416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b60fd395-e87c-421d-a462-e673e8781a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:19:55.486415 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2469/4958] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:55 2022] DELETE /identity/v3/projects/6ea4ae06ca4b476db85a0a44019ddbaf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:19:55.491997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.492289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.492613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.506562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:55.508207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38e65-d739-4f10-a1fb-6053a8a9fb5c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:55.521525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2490/4959] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:55.606641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:55.607575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:55.697941 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:55.778301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.778508 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2470/4960] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:55.779653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.780618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.812556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:55.814255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:55.826821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2491/4961] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:55.831431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:55.848606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51409f-19a6-4c1b-86a3-82511dc6ace8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:55.879485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:55.880126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.880409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.880681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.881346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:19:55.883079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:55.884722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:55.921985 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2471/4962] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:19:55.934630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:55.959333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df630cd5-a8b7-4570-b6d0-6b7b95c0d0f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:55.987049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:55.991026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:55.991365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:55.991648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:55.992317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:56.005707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:56.093053 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2492/4963] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:19:55 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:56.097881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:56.126362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b795bc-2229-4521-99eb-c34744a02378 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:56.306588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:56.308676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:56.309596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:56.310976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:56.311824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:56.322907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:56.384602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2472/4964] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:19:56 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:19:56.385907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:56.407209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6f6d2-37c9-4d4f-bc6a-bf6c341fddff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:56.417857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:56.420845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:56.421149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:56.421443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:56.422117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:56.438412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:56.462624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2493/4965] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:56.467367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:56.486887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e4e3-4fa5-4523-a105-54e4cc08e205 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:56.505015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:56.505750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:56.506383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:56.506794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:56.510209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:56.511968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ac92b-0ff2-4583-bed6-2dd40a117325 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:56.533535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2473/4966] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:19:56.540531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:56.567347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97353b-60b5-406f-bb3a-c88db9fce865 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:56.585090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:56.586253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:56.586712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:56.587134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] PATH_INFO: `/v3/projects/390ee8f6c3594168923cb24405a5bf8d/users/91008d1f8b0a4a5d911eb0551f87a3b2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:56.627057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ee8f6c3594168923cb24405a5bf8d, user_id=91008d1f8b0a4a5d911eb0551f87a3b2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:56.631871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:56.661088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2494/4967] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:19:56 2022] PUT /identity/v3/projects/390ee8f6c3594168923cb24405a5bf8d/users/91008d1f8b0a4a5d911eb0551f87a3b2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:19:56.671972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9026ce-ee54-4ce6-998d-b4617d9dac92 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:56.672862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9026ce-ee54-4ce6-998d-b4617d9dac92 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:56.673248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9026ce-ee54-4ce6-998d-b4617d9dac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:56.747369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0b9026ce-ee54-4ce6-998d-b4617d9dac92 None None] MFA Rules not processed for user `91008d1f8b0a4a5d911eb0551f87a3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:56.749418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0b9026ce-ee54-4ce6-998d-b4617d9dac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:56.846299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2474/4968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:56.862884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:56.865186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:56.897794 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:57.076784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d84e86-0ab6-4eb2-94f1-eabcfbfe24c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:57.091562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:57.092508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:57.092976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:57.093519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:57.111852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:57.116209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:57.133550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2495/4969] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:58.290306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:58.290840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:58.291033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:58.332183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:19:58.338318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:58.441534 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:58.501454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2475/4970] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:19:58.548797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:19:58.551801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:19:58.761935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495267-3987-4fc4-ac0b-a605705319c9 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:19:58.771358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:19:58.771994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:19:58.772275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:19:58.772551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:19:58.798135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:19:58.807911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b593-10ef-48be-bb29-d7d3608bde42 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:19:58.820833 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2496/4971] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:01.025005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:01.026587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:01.200212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e87a5-7a62-4a64-b5ff-c0992bb59fda None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:01.207742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:01.208551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:01.208931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:01.209310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] PATH_INFO: `/v3/users/983b9df61e034b70b95cd2ee5e662272` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:01.218023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=983b9df61e034b70b95cd2ee5e662272)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:01.220132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:01.322646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983b9df61e034b70b95cd2ee5e662272'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:01.324512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983b9df61e034b70b95cd2ee5e662272'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:01.341781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983b9df61e034b70b95cd2ee5e662272'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:01.367522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983b9df61e034b70b95cd2ee5e662272'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:01.368436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983b9df61e034b70b95cd2ee5e662272'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:01.393757 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2476/4972] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:01 2022] DELETE /identity/v3/users/983b9df61e034b70b95cd2ee5e662272 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:01.411212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:01.411715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:01.411808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:01.477905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:01.479158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:01.774988 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2497/4973] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:01.782785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:01.784611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:02.083636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae01d-aeb6-456d-afa1-11824b1d98eb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:02.103048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:02.103689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:02.103970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:02.104248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:02.164723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:02.166219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:02.206842 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2477/4974] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:03.255180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:03.256791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:03.295586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e5a1-3bab-469d-869e-c24ad8510dd3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:03.322639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:03.326638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:03.327937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:03.329219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] PATH_INFO: `/v3/projects/f1b083fc901744fd850ca788a7a801d8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:03.339124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b083fc901744fd850ca788a7a801d8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:03.348139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:03.465202 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:03.487423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b083fc901744fd850ca788a7a801d8', 'request_id': 'req-1b5455ba-60dc-4251-90d2-5f03722aa37b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:03.522685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b083fc901744fd850ca788a7a801d8', 'request_id': 'req-1b5455ba-60dc-4251-90d2-5f03722aa37b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:03.535716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b083fc901744fd850ca788a7a801d8', 'request_id': 'req-1b5455ba-60dc-4251-90d2-5f03722aa37b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:03.579985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] The token cache is being invalidate because project f1b083fc901744fd850ca788a7a801d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:03.580868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:03.583391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b5455ba-60dc-4251-90d2-5f03722aa37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:03.587700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2498/4975] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:03 2022] DELETE /identity/v3/projects/f1b083fc901744fd850ca788a7a801d8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:03.591636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:03.599362 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:03.616737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a620-c4b3-45ab-98e2-b4221d36ab83 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:03.856297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:03.858951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:03.859472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:03.860177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] PATH_INFO: `/v3/users/ad7f6792e788478b92a98b12bda73a42` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:03.865252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7f6792e788478b92a98b12bda73a42)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:03.870467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:04.026655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8b759-9f9f-4020-b6d6-5cc361b70da5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:04.027428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8b759-9f9f-4020-b6d6-5cc361b70da5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:04.027908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8b759-9f9f-4020-b6d6-5cc361b70da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:04.046553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7f6792e788478b92a98b12bda73a42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:04.047504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7f6792e788478b92a98b12bda73a42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:04.071441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7f6792e788478b92a98b12bda73a42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:04.097467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-39f8b759-9f9f-4020-b6d6-5cc361b70da5 None None] MFA Rules not processed for user `8c4d799cd1354609a8604a2db0fc12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:04.106747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7f6792e788478b92a98b12bda73a42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:04.107263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39f8b759-9f9f-4020-b6d6-5cc361b70da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:04.110016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7f6792e788478b92a98b12bda73a42'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:04.146069 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2478/4976] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:03 2022] DELETE /identity/v3/users/ad7f6792e788478b92a98b12bda73a42 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:04.339575 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2499/4977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 25 01:20:05.056830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:05.059442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:05.288475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed05e-049c-4560-85af-3b5975c25787 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:05.301062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:05.301950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:05.302369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:05.302921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] PATH_INFO: `/v3/projects/10302f35edd14049ad5930aa2e9c876a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:05.305032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10302f35edd14049ad5930aa2e9c876a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:05.310295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:05.371895 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:05.425737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10302f35edd14049ad5930aa2e9c876a', 'request_id': 'req-a393f862-b320-4b32-a28d-3db082b82256'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:05.439589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10302f35edd14049ad5930aa2e9c876a', 'request_id': 'req-a393f862-b320-4b32-a28d-3db082b82256'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:05.458231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10302f35edd14049ad5930aa2e9c876a', 'request_id': 'req-a393f862-b320-4b32-a28d-3db082b82256'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:05.493190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] The token cache is being invalidate because project 10302f35edd14049ad5930aa2e9c876a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:05.495856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:05.496689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a393f862-b320-4b32-a28d-3db082b82256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:05.501250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2479/4978] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:05 2022] DELETE /identity/v3/projects/10302f35edd14049ad5930aa2e9c876a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:05.506542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:05.506992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:05.507081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:05.541145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:05.542434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:05.670678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2500/4979] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:05.679898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:05.680482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:05.681023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:05.713623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:05.718316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:05.742713 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2480/4980] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:05.747001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:05.762628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb09c91-53bc-4860-b704-ac6eba992df7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:05.779548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:05.780191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:05.780473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:05.780746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:05.785163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:05.785551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:05.787549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:05.812792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2501/4981] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:05.819254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:05.861655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843ec28-bd08-4d8e-89c4-cee1dbb5c67b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:05.872603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:05.873452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:05.873788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:05.874291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:05.875143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:05.882894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:05.963036 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2481/4982] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:05.964474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:05.978139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb60d5-7705-4917-b78e-ac51a6b43edb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:06.139310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:06.139310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:06.139310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:06.139310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:06.140420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:06.146569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:06.163709 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:06.209142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2502/4983] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:05 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:06.210591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:06.232239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32565-8a5d-4715-a5f6-cea82413369d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:06.250109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:06.251005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:06.251494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:06.254070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:06.255338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:06.262291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:06.323592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2482/4984] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:06.327184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:06.348318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34162-2d2e-443b-af5e-ac2f5f196bf1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:06.370531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:06.371274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:06.371560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:06.372925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:06.374570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:06.380968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ca20-9b51-42ea-b09f-8313a32cdddb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:06.422376 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2503/4985] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:06.425698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:06.450204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eaa46-d349-4a39-9138-74cd3a342230 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:06.475307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:06.486116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:06.486574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:06.487109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] PATH_INFO: `/v3/projects/7b7234436c1a478d87abcc29a2624cdf/users/17c040d8e0a345aaa783a28b4809ca44/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:06.551427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7234436c1a478d87abcc29a2624cdf, user_id=17c040d8e0a345aaa783a28b4809ca44, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:06.554281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:06.584152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2483/4986] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:06 2022] PUT /identity/v3/projects/7b7234436c1a478d87abcc29a2624cdf/users/17c040d8e0a345aaa783a28b4809ca44/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:06.594922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:06.595472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:06.595472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:06.660800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] MFA Rules not processed for user `17c040d8e0a345aaa783a28b4809ca44`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:06.662209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:06.871671 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2504/4987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:06.875760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.184058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767664b-0f87-4a2b-b84a-8604d54ffd5b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:07.211978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:07.212680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:07.213064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:07.213471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:07.217895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:07.222776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:07.288466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2484/4988] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:06 2022] POST /identity/v3/projects => generated 383 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:07.296742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.316158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa834719-3d47-4254-9e3c-be3459e13e91 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:07.477692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:07.478508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:07.478888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:07.479261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:07.480087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:07.482182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:07.539160 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2505/4989] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:07 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:07.543596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.561502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb8e1b-00ca-430f-8523-59fdf94e2da0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:07.579794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:07.581620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:07.582133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:07.582560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:07.584546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:07.590541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:07.634513 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2485/4990] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:07.639027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.654754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe43b-58bd-4b17-9c4b-75a1c496c5a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:07.671872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:07.672566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:07.672851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:07.673130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] PATH_INFO: `/v3/projects/046da90a3b354f249802a14ed1fbba90/users/b1e01e8e087345deb80023dd2415bef9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:07.691676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046da90a3b354f249802a14ed1fbba90, user_id=b1e01e8e087345deb80023dd2415bef9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:07.694559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:07.717892 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2506/4991] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:07 2022] PUT /identity/v3/projects/046da90a3b354f249802a14ed1fbba90/users/b1e01e8e087345deb80023dd2415bef9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:07.722026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.744129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0769-939f-4203-80b3-28e0f1f1b023 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:07.853186 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:07.960646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:07.961568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:07.962000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:07.962420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:07.963241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:07.965027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4fb8-6a84-4de3-b12d-4be6e3e6dc81 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:07.977295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2486/4992] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:07.981305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:07.999648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7089e-a219-4ec0-b314-9133ecbce5f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:08.017128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:08.019436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:08.019868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:08.020772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] PATH_INFO: `/v3/projects/046da90a3b354f249802a14ed1fbba90/users/b1e01e8e087345deb80023dd2415bef9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:08.031620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=046da90a3b354f249802a14ed1fbba90, user_id=b1e01e8e087345deb80023dd2415bef9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:08.041091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:08.071314 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2507/4993] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:07 2022] PUT /identity/v3/projects/046da90a3b354f249802a14ed1fbba90/users/b1e01e8e087345deb80023dd2415bef9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:08.081355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:08.081831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:08.082165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:08.146970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] MFA Rules not processed for user `b1e01e8e087345deb80023dd2415bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:08.148210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:08.311820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2487/4994] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:08.320842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:08.322651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:08.366943 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:08.481861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d010e-9e14-487e-afdc-504b9266bc9a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:08.489267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:08.490260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:08.491137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:08.491586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:08.503263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:08.505229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38088e-5fe3-4c23-9584-a9b59e05d3fc service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:08.527904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2508/4995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:08.709983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:08.726087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f93e-ce3b-4701-9289-79568686ce4e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:08.730906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:08.731798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:08.732396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:08.733558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:08.861624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:08.865090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:08.881179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2488/4996] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:14.376892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:14.378366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:14.378366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:14.410467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:14.414229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:14.556029 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2509/4997] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:14.589198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:14.592123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:14.687646 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:14.729356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1401ef-97d6-427c-9289-454854d9a902 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:14.742526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:14.743077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:14.743359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:14.743634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:14.776951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:14.780146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c071-691c-4873-acd2-62696eb0d363 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:14.800970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2489/4998] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:16.566831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:16.839089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803b6c-7908-41bd-b8f3-a3f8e9c37498 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:16.861137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:16.861872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:16.862159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:16.862439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] PATH_INFO: `/v3/users/17c040d8e0a345aaa783a28b4809ca44` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:16.868677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c040d8e0a345aaa783a28b4809ca44)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:16.870692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:17.031941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c040d8e0a345aaa783a28b4809ca44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:17.056301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c040d8e0a345aaa783a28b4809ca44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:17.108151 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:17.132814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c040d8e0a345aaa783a28b4809ca44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:17.136629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c040d8e0a345aaa783a28b4809ca44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:17.138095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c040d8e0a345aaa783a28b4809ca44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:17.188119 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2510/4999] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:16 2022] DELETE /identity/v3/users/17c040d8e0a345aaa783a28b4809ca44 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:17.193175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb17-25a7-423f-bf8a-c263d6c83cec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:17.193765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb17-25a7-423f-bf8a-c263d6c83cec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:17.193867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb17-25a7-423f-bf8a-c263d6c83cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:17.229700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b043eb17-25a7-423f-bf8a-c263d6c83cec None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:17.231653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b043eb17-25a7-423f-bf8a-c263d6c83cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:17.356802 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2490/5000] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:17.367519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:17.368955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:17.532355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a9d3-87cd-45ee-821c-c4aacf7c060a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:17.560838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:17.561932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:17.562898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:17.563782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:17.609369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:17.612181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:17.653757 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2511/5001] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:19.288290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:19.288798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:19.288903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:19.312728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:19.314342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:19.411798 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2491/5002] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:19.423101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:19.425521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:19.540338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:19.542321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:19.573969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0036805-f0c3-4bac-8950-8c6719292a23 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:19.588309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f97bd3-b230-4598-a00d-b22570bddc91 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:19.595049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:19.603519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:19.603965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:19.604407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:19.611370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:19.618567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:19.620730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:19.623986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] PATH_INFO: `/v3/projects/7b7234436c1a478d87abcc29a2624cdf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:19.628918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7234436c1a478d87abcc29a2624cdf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:19.631501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:19.633463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:19.637466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:19.674700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2512/5003] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:20:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:19.784228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7234436c1a478d87abcc29a2624cdf', 'request_id': 'req-dde64515-1b41-412c-98d7-1f7373ca9ffe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:19.808164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7234436c1a478d87abcc29a2624cdf', 'request_id': 'req-dde64515-1b41-412c-98d7-1f7373ca9ffe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:19.820807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7234436c1a478d87abcc29a2624cdf', 'request_id': 'req-dde64515-1b41-412c-98d7-1f7373ca9ffe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:19.850685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] The token cache is being invalidate because project 7b7234436c1a478d87abcc29a2624cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:19.851103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:19.859070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:19.866818 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2492/5004] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:19 2022] DELETE /identity/v3/projects/7b7234436c1a478d87abcc29a2624cdf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:19.868153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:19.885512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b30-5e6f-4c54-a84b-907e73df5527 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:20.060292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:20.060935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:20.064307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:20.065598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] PATH_INFO: `/v3/users/b1e01e8e087345deb80023dd2415bef9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:20.067118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e01e8e087345deb80023dd2415bef9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:20.069204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:20.122216 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:20.172082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e01e8e087345deb80023dd2415bef9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:20.195277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e01e8e087345deb80023dd2415bef9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:20.228513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e01e8e087345deb80023dd2415bef9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:20.229283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e01e8e087345deb80023dd2415bef9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:20.229941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e01e8e087345deb80023dd2415bef9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:20.260157 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2513/5005] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:19 2022] DELETE /identity/v3/users/b1e01e8e087345deb80023dd2415bef9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:21.213453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:21.216815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:21.240506 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:21.253460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64515-1b41-412c-98d7-1f7373ca9ffe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:21.271591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:21.273181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:21.411219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:21.411884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:21.415648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:21.415648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] PATH_INFO: `/v3/users/91008d1f8b0a4a5d911eb0551f87a3b2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:21.416205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91008d1f8b0a4a5d911eb0551f87a3b2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:21.419533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:21.426081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a0a4-d9a6-450b-b0f4-414df15ae7e4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:21.442285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:21.442555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:21.442803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:21.443001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] PATH_INFO: `/v3/projects/046da90a3b354f249802a14ed1fbba90` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:21.444318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=046da90a3b354f249802a14ed1fbba90)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:21.446311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:21.525986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91008d1f8b0a4a5d911eb0551f87a3b2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.526706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91008d1f8b0a4a5d911eb0551f87a3b2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.558691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91008d1f8b0a4a5d911eb0551f87a3b2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.608328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046da90a3b354f249802a14ed1fbba90', 'request_id': 'req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.613001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91008d1f8b0a4a5d911eb0551f87a3b2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.615944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ef83250-1761-47fe-95ac-1a662bf41126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91008d1f8b0a4a5d911eb0551f87a3b2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.636396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046da90a3b354f249802a14ed1fbba90', 'request_id': 'req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.667261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046da90a3b354f249802a14ed1fbba90', 'request_id': 'req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.672116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2493/5006] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:21 2022] DELETE /identity/v3/users/91008d1f8b0a4a5d911eb0551f87a3b2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:21.676559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:21.676850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:21.678315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:21.720758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] The token cache is being invalidate because project 046da90a3b354f249802a14ed1fbba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:21.721121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.729863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87edb9e5-3c9b-4098-acab-9df4ed22ac7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:21.750662 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2514/5007] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:21 2022] DELETE /identity/v3/projects/046da90a3b354f249802a14ed1fbba90 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:21.765896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe15e61-aea6-4200-9a79-b1d6222fe856 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:21.766199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe15e61-aea6-4200-9a79-b1d6222fe856 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:21.766402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe15e61-aea6-4200-9a79-b1d6222fe856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:21.782056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:21.785095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:21.814026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-abe15e61-aea6-4200-9a79-b1d6222fe856 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:21.815869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-abe15e61-aea6-4200-9a79-b1d6222fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:21.877967 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:21.964475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2515/5008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:21.973823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:21.974481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:21.975001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.028331 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2494/5009] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:22.031312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:22.032299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.032577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:22.037458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:22.051981 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2516/5010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:22.056280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.083493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214bb68-9667-4048-86b1-7e9c840bf6df None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.097533 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:22.101435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.102418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.102978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.103267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.103930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:22.104238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.105917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.136820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2517/5011] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:20:22.142358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.184425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532959-d797-48cd-b37b-0fe7469fe0de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.205629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.209236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.210403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.210403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.210598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.212520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.217958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e5245-8ac3-4088-96a8-48b52afbc383 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.225824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.226938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.229032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.229661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.257156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.264030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.272565 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2518/5012] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:22 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:20:22.275728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.300447 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2495/5013] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:22.376063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f610c-1bfd-47df-89bd-66589ccbb605 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.397196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.397584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.397872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.398147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.398801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.401336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.448972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2519/5014] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:22 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:22.452702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.466966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9345c-4b0c-4dbf-aebf-fea7169cfce0 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.485263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.486733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.488396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.488890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.490772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.494815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.511321 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2496/5015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:22.518282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.530364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168902-733a-4acc-98f7-b5f5a940fd68 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.539087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.539774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.540062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.540462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.541395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.544190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.563189 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2520/5016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:20:22.567725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.584983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.588641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:22.597056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2956f-7bf1-46ee-b7fd-eb331cb64def admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.611879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.612871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.613341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.614768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] PATH_INFO: `/v3/projects/3139b347192d4615adef88bdcef10a07/users/05caec2168914e72bfd8bea866684df0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.631013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97364de-f672-4335-85c4-7f420bc9d678 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:22.646291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:22.647365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.647535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.648890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] PATH_INFO: `/v3/projects/390ee8f6c3594168923cb24405a5bf8d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.652069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=390ee8f6c3594168923cb24405a5bf8d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.655136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.686583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3139b347192d4615adef88bdcef10a07, user_id=05caec2168914e72bfd8bea866684df0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:22.692625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104004-c22f-4549-bb65-88c9352872d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:22.725299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2497/5017] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:22 2022] PUT /identity/v3/projects/3139b347192d4615adef88bdcef10a07/users/05caec2168914e72bfd8bea866684df0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:22.741554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.741918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.742156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.776780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390ee8f6c3594168923cb24405a5bf8d', 'request_id': 'req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:22.791123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390ee8f6c3594168923cb24405a5bf8d', 'request_id': 'req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:22.808137 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:22.813889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390ee8f6c3594168923cb24405a5bf8d', 'request_id': 'req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:22.817025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] MFA Rules not processed for user `05caec2168914e72bfd8bea866684df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:22.819662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:22.871917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] The token cache is being invalidate because project 390ee8f6c3594168923cb24405a5bf8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:22.872891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:22.874921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d42c6ef7-8bfe-44e2-8893-d2328c79c8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:22.877937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2521/5018] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:22 2022] DELETE /identity/v3/projects/390ee8f6c3594168923cb24405a5bf8d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:22.882910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d7f4-2237-4d9e-b824-9a7df7417387 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:22.883202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d7f4-2237-4d9e-b824-9a7df7417387 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:22.883479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d7f4-2237-4d9e-b824-9a7df7417387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:22.914466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8ea4d7f4-2237-4d9e-b824-9a7df7417387 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:22.915746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ea4d7f4-2237-4d9e-b824-9a7df7417387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:22.926391 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2498/5019] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:22.937924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:22.939807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.027669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd073-5acb-4bf2-a79a-9648857dc20e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.031796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.032422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.032710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.032988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.049542 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2522/5020] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:23.052446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.052745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.053022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.060469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.063019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.102329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2499/5021] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:23.108906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:23.110421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.134398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.136277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.137796 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2523/5022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:23.141757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.162224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e69cbc-8624-488a-83a5-e117b936f723 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.163748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a44798-7f06-41f3-bf14-927cae35b261 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.168220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.169134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.169980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.170491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] PATH_INFO: `/v3/users/05caec2168914e72bfd8bea866684df0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.172542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05caec2168914e72bfd8bea866684df0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.174969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.177672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.178310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.178936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.178936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.179522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:23.179810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.181603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.199292 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:23.226210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2524/5023] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:20:23.231687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.252017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e121-420e-4482-a421-30873d3e5164 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.253134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05caec2168914e72bfd8bea866684df0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:23.255196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05caec2168914e72bfd8bea866684df0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:23.265203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05caec2168914e72bfd8bea866684df0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:23.271126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.271758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.272030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.272303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.272951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.275041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.290428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05caec2168914e72bfd8bea866684df0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:23.291602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5fa1ec7e-4d56-4109-bd80-cf4602b392f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05caec2168914e72bfd8bea866684df0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:23.310883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2500/5024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:23 2022] DELETE /identity/v3/users/05caec2168914e72bfd8bea866684df0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:23.316830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.317716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.318205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.329364 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2525/5025] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:23 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:23.334615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.336669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.351504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:23.353172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.447466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2501/5026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:23.463767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.472530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.475463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10ed27-bcf2-499f-9b64-8ea3c8f0af04 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.482711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.483344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.483626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.483901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.484543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.486753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.536755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2526/5027] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:23 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:20:23.540895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.563212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b0b2-99de-469c-981a-15b0319a1ba9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.582976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.583635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.583892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.584168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.584825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.586472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.607553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2527/5028] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:23.611539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.632851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c0b9c-0e48-48fd-bcf6-2166b1aaac80 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.638839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d65b98-d676-4e7f-b3cd-276d792bdd6b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.649489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.650794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.651337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.651832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.652681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.657106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.659454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.662082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.663176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.663687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.690315 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2528/5029] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:20:23.692087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.694351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:23.695753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f5d0-cdd1-4023-9916-392d55687ba8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.719822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a18c2-a276-484f-8676-1159d80f2637 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:23.737693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2502/5030] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:23.750674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:23.751674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.753001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.753534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] PATH_INFO: `/v3/projects/ac529a1d70be46599a7bce95987ae4c0/users/13fb36f84c5f4b8eb2759b68753cabf4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.783576 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:23.788335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac529a1d70be46599a7bce95987ae4c0, user_id=13fb36f84c5f4b8eb2759b68753cabf4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:23.792879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:23.821179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2529/5031] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:23 2022] PUT /identity/v3/projects/ac529a1d70be46599a7bce95987ae4c0/users/13fb36f84c5f4b8eb2759b68753cabf4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:23.834116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:23.835166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:23.835656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:23.886277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] MFA Rules not processed for user `13fb36f84c5f4b8eb2759b68753cabf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:23.888412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:23.928792 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:23.994971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2503/5032] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:24.009326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:24.012181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:24.196349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fefa-7578-4299-ba8b-ddeff0abc6f2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:24.207914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:24.209299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:24.211038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:24.211634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:24.236044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:24.239552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c84c7-d539-4183-b61e-bc3fd5464d4f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:24.265124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2530/5033] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:24.429382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:24.431110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:24.588477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ffcc1-bb83-4d7f-84b0-32a7547acd08 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:24.599117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:24.600520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:24.602207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:24.602482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] PATH_INFO: `/v3/projects/3139b347192d4615adef88bdcef10a07` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:24.604392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3139b347192d4615adef88bdcef10a07)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:24.607757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:24.806757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3139b347192d4615adef88bdcef10a07', 'request_id': 'req-aca44d5b-f136-402d-8ca8-b3aad421e99e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:24.822321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3139b347192d4615adef88bdcef10a07', 'request_id': 'req-aca44d5b-f136-402d-8ca8-b3aad421e99e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:24.842223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3139b347192d4615adef88bdcef10a07', 'request_id': 'req-aca44d5b-f136-402d-8ca8-b3aad421e99e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:24.862051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] The token cache is being invalidate because project 3139b347192d4615adef88bdcef10a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:24.862679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:24.863804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aca44d5b-f136-402d-8ca8-b3aad421e99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:24.866037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2504/5034] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:24 2022] DELETE /identity/v3/projects/3139b347192d4615adef88bdcef10a07 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:24.870851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:24.871785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:24.872254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:24.933075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:24.934367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:25.031071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2531/5035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:25.041105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.041420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.041711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.081142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:25.086827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:25.106940 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2505/5036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:25.110997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.125355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7486d8-c65d-4a82-aac9-8fe1b4f9132f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.149598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.150516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.152717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.155949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.157367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:25.159487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.176597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.204477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2532/5037] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:25.209737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.222325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a47a-143d-4e7c-8a57-99d20ff5df47 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.234913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.236455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.236912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.237667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.238639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.240742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.303239 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2506/5038] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:25.307350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.323351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc724f-ca4b-4593-9053-96a26894bdbb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.514504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.515143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.515428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.515703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.517010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.519657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.577130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.577704 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2533/5039] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:25 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:25.596500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c4d67-ee44-4a7e-921c-e74de3ed7b56 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.608375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.609332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.609743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.610118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.612978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.617145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.665612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2507/5040] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:25.666305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.682852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071e11-45d9-46e1-b55f-05e90199d991 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.694890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.695526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.695820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.696084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.696737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.698500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8581a-44b7-4a17-8342-2ed002bb7272 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.711234 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.729455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2534/5041] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:25.732286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:25.778143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945db8-aee5-43e0-a475-b06a7cc34bf3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:25.795512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:25.796836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.797392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.798346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] PATH_INFO: `/v3/projects/31367060596548b59603860aafed267f/users/2f080bae0ec94a5b88128dd69c8a3e74/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.848706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31367060596548b59603860aafed267f, user_id=2f080bae0ec94a5b88128dd69c8a3e74, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:25.854379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:25.863005 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.905836 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2508/5042] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:25 2022] PUT /identity/v3/projects/31367060596548b59603860aafed267f/users/2f080bae0ec94a5b88128dd69c8a3e74/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:25.907446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3061-0903-4d5c-9b95-1decadfe7a75 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:25.907929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3061-0903-4d5c-9b95-1decadfe7a75 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:25.908733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3061-0903-4d5c-9b95-1decadfe7a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:25.959243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ee2a3061-0903-4d5c-9b95-1decadfe7a75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:25.960538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee2a3061-0903-4d5c-9b95-1decadfe7a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:26.147195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2535/5043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:26.160175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:26.162584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:26.237430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151c04-2e44-4b59-9f9b-5abf9792a07f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:26.250622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:26.250622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:26.250622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:26.250622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:26.277994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:26.282398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:26.308921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2509/5044] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:27.847816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:27.848556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:27.848949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:27.917100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] MFA Rules not processed for user `2f080bae0ec94a5b88128dd69c8a3e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:27.918559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:28.065014 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2536/5045] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:28.077804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:28.079383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:28.190490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4549-e044-4708-981d-2616c4b27193 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:28.194813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:28.195439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:28.195751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:28.196049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:28.211491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:28.215013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773308b-a0e2-4be3-865d-ba6d25a6566e service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:28.238573 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2510/5046] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:31.797890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:31.798575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:31.830807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdb8b-0a04-4d16-9bf5-eb90b54eafae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:31.842098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:31.844041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:31.844623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:31.846315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] PATH_INFO: `/v3/users/23d8b5256139488db144848ab8c0aa5e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:31.850708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d8b5256139488db144848ab8c0aa5e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:31.854201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:31.956711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d8b5256139488db144848ab8c0aa5e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:31.990720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d8b5256139488db144848ab8c0aa5e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:32.015335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d8b5256139488db144848ab8c0aa5e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:32.016895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d8b5256139488db144848ab8c0aa5e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:32.018063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d8b5256139488db144848ab8c0aa5e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:32.055117 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2537/5047] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:31 2022] DELETE /identity/v3/users/23d8b5256139488db144848ab8c0aa5e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:32.060172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be566664-9711-4f13-b93e-b8078da5c112 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:32.060725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be566664-9711-4f13-b93e-b8078da5c112 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:32.060813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be566664-9711-4f13-b93e-b8078da5c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:32.126623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be566664-9711-4f13-b93e-b8078da5c112 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:32.128632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be566664-9711-4f13-b93e-b8078da5c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:32.323041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2511/5048] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:32.344979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:32.346960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:32.353012 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:32.528610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dd96f-04df-4d99-863b-3ac964bde99e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:32.541198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:32.544718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:32.545037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:32.545313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:32.568412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:32.569977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:32.597710 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2538/5049] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:32.753626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:32.753626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:32.753626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:32.791913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:32.793202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:32.876001 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:32.940414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2512/5050] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:32.955380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:32.957264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:33.058745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f009d-ae0a-45d2-bb4f-05b03084b938 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:33.065743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:33.066397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:33.066680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:33.066953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:33.081539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:33.085144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a1bf5-617c-4b4c-b157-9ce55098db4a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:33.102618 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2539/5051] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:33.619927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:33.623513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:33.665959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102df45-a4db-4af1-8dab-4a19841dfb3b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:33.687265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:33.688024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:33.690788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:33.691148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] PATH_INFO: `/v3/projects/3de566fc6cf74a44a29e5989042cdb5f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:33.693836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de566fc6cf74a44a29e5989042cdb5f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:33.702400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:33.875228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de566fc6cf74a44a29e5989042cdb5f', 'request_id': 'req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:33.890056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de566fc6cf74a44a29e5989042cdb5f', 'request_id': 'req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:33.906719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de566fc6cf74a44a29e5989042cdb5f', 'request_id': 'req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:33.935277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] The token cache is being invalidate because project 3de566fc6cf74a44a29e5989042cdb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:33.935580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:33.940951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dbf0a356-a987-4a8f-a1a8-b390cc2d2145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:33.954092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2513/5052] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:33 2022] DELETE /identity/v3/projects/3de566fc6cf74a44a29e5989042cdb5f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:33.956564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:33.957734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:33.958260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.006781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:34.008842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:34.145678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2540/5053] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:34.152835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.153155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.153434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.226837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:34.228088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:34.277321 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2514/5054] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:34.281240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.304502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8bbff-5a9f-4bbd-8394-5c78d52eacc2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.322772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.324214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.324498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.324773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.325445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:34.329514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:34.340846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:34.371176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2541/5055] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:20:34.371910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.414928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa6990-47b0-4c75-8d86-88828cff1389 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.462357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.483875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.483875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.483875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.493785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:34.507533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:34.589461 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2515/5056] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:34 2022] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:34.594012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.605955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140ba6-ef8c-4b94-87dc-12511dd70fd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.638003 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:34.712680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.713472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.717158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.717158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.717158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:34.717807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d95d-c24e-41ab-b104-87619076c088 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:34.757980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.766561 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2542/5057] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:34 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:34.778451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac2a28-e1c7-4cc9-9480-ec9b3cb76744 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.792291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.795259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.795696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.798632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.801721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:34.804671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:34.819940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ff23-534b-40ba-8880-2b9b1f25b76f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.820286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ff23-534b-40ba-8880-2b9b1f25b76f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.820604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ff23-534b-40ba-8880-2b9b1f25b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.854572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2516/5058] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:34.855516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.865464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8c71ff23-534b-40ba-8880-2b9b1f25b76f None None] MFA Rules not processed for user `ab3394e2971741d7aa5956de0d4afba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:34.867228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c71ff23-534b-40ba-8880-2b9b1f25b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:34.900921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071c44d-4e21-43b5-9f92-6090b3330240 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.929214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.930705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.931194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.931696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.932599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:34.936184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:34.958668 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2517/5059] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:34.962424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:34.977777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb420-88e1-4a18-a35a-1ae7d4b418bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:34.989462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:34.990733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:34.991225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:34.991732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] PATH_INFO: `/v3/projects/5d6dcffe49164ed28dd263b753a52a25/users/aa213cfb086e4cc5aeaaf86b00743160/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:34.997297 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2543/5060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:35.015021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6dcffe49164ed28dd263b753a52a25, user_id=aa213cfb086e4cc5aeaaf86b00743160, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.026597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.068303 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2518/5061] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:34 2022] PUT /identity/v3/projects/5d6dcffe49164ed28dd263b753a52a25/users/aa213cfb086e4cc5aeaaf86b00743160/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:35.069934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.070467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.070962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.124011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] MFA Rules not processed for user `aa213cfb086e4cc5aeaaf86b00743160`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:35.128340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:35.255845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2544/5062] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:35.261375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.362277 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:35.387590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f1d1-afd0-4f01-96c7-99bc252952d6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:35.396514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:35.397174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.397500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.397782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.398457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.400475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.435921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.441023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:35.481455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2519/5063] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:35 2022] POST /identity/v3/projects => generated 403 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:35.483456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.515287 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:35.533497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0eebc-c751-4d60-86a6-4c34c1172328 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:35.678285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8539fd-bb34-467a-ba73-8a1778d99373 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:35.684857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:35.685764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.686189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.686635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.687427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.690794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.703933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:35.705184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.705576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.705844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.707629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:35.720509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.722610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.736891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2545/5064] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:35.795533 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2520/5065] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:35 2022] POST /identity/v3/users => generated 308 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:35.797785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.811206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925bbe-00dc-44ff-8263-5645267ab220 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:35.817966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:35.819274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.819659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.820170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.821686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.824447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.857340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2546/5066] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:35.858776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.870508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209d63-fc0b-43e4-aebe-90264d62c38d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:35.875791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:35.876524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:35.877358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:35.877669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] PATH_INFO: `/v3/projects/f02d89d4a5184c34ac077031b4abfdae/users/ecbdc35aff604bdebf1f9e54f2ff0d69/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:35.904391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02d89d4a5184c34ac077031b4abfdae, user_id=ecbdc35aff604bdebf1f9e54f2ff0d69, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:35.909041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:35.937941 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2521/5067] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:35 2022] PUT /identity/v3/projects/f02d89d4a5184c34ac077031b4abfdae/users/ecbdc35aff604bdebf1f9e54f2ff0d69/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:35.938847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:35.953346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796d2d8-5091-410f-be43-0c251cd99105 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:36.091361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:36.091993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:36.092279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:36.092585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:36.093206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:36.095058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833447f9-409c-4c76-8118-e9d7079ae2e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:36.120717 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2547/5068] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:36.124693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:36.152661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5dbe-b0ff-42e6-8f0a-1599eb8c5f3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:36.166232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:36.168044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:36.168331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:36.168632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] PATH_INFO: `/v3/projects/f02d89d4a5184c34ac077031b4abfdae/users/ecbdc35aff604bdebf1f9e54f2ff0d69/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:36.173042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02d89d4a5184c34ac077031b4abfdae, user_id=ecbdc35aff604bdebf1f9e54f2ff0d69, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:36.182545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:36.261998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2522/5069] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:36 2022] PUT /identity/v3/projects/f02d89d4a5184c34ac077031b4abfdae/users/ecbdc35aff604bdebf1f9e54f2ff0d69/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:36.357571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:36.357865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:36.358153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:36.445460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] MFA Rules not processed for user `ecbdc35aff604bdebf1f9e54f2ff0d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:36.447201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:36.650111 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2548/5070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:36.650353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:36.672351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaebcd0-1acc-4c2c-bf88-61e5a1008b12 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:36.699955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecbdc35aff604bdebf1f9e54f2ff0d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f02d89d4a5184c34ac077031b4abfdae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:36.705803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:36.706095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:36.706367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:36.713947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:36.716094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:36.794162 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2523/5071] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:36 2022] POST /identity/v3/roles => generated 240 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:36.796216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:36.815503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085c4b4-2e36-49d0-b27e-920cf7a422a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:36.835866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecbdc35aff604bdebf1f9e54f2ff0d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f02d89d4a5184c34ac077031b4abfdae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:36.838047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:36.838294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:36.842322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] PATH_INFO: `/v3/projects/5d6dcffe49164ed28dd263b753a52a25/users/aa213cfb086e4cc5aeaaf86b00743160/roles/41ec2756d95941a3a9e07525f5df1054` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:36.868885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5d6dcffe49164ed28dd263b753a52a25, user_id=aa213cfb086e4cc5aeaaf86b00743160, role_id=41ec2756d95941a3a9e07525f5df1054)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:36.871668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6aefb-2ae6-4c47-bf3c-fbf5158d2405 tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:36.935097 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2549/5072] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:36 2022] PUT /identity/v3/projects/5d6dcffe49164ed28dd263b753a52a25/users/aa213cfb086e4cc5aeaaf86b00743160/roles/41ec2756d95941a3a9e07525f5df1054 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:36.937336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:37.192299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65e11-5cfd-40f7-8d65-fb9fe06b4cff tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:37.279881 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:37.425650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa213cfb086e4cc5aeaaf86b00743160', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d6dcffe49164ed28dd263b753a52a25', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-1406263125', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:37.429583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:37.430972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:37.431919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] PATH_INFO: `/v3/users/aa213cfb086e4cc5aeaaf86b00743160/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:37.440600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: Authorizing `identity:create_application_credential(user_id=aa213cfb086e4cc5aeaaf86b00743160)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:37.451134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91285-58fd-41e4-8872-2f5b964a68b3 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:37.682469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2524/5073] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:20:36 2022] POST /identity/v3/users/aa213cfb086e4cc5aeaaf86b00743160/application_credentials => generated 660 bytes in 747 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:37.687153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:37.687747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:37.688602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:37.694490 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:37.777071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:37.777769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:37.778188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:37.784843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] MFA Rules not processed for user `aa213cfb086e4cc5aeaaf86b00743160`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:37.787705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:37.837651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:37.839143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:38.029606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2525/5074] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:38.053386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:38.055421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:38.082313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2550/5075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 25 01:20:38.083600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:38.114641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea617-895b-4973-ba2c-4e73e7d01238 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:38.138227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa213cfb086e4cc5aeaaf86b00743160', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d6dcffe49164ed28dd263b753a52a25', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-1406263125', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:38.141445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:38.144127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:38.144728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] PATH_INFO: `/v3/users/aa213cfb086e4cc5aeaaf86b00743160/application_credentials/f39d52197da34e0280ee5cea8b74fc3e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:38.150973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: Authorizing `identity:delete_application_credential(user_id=aa213cfb086e4cc5aeaaf86b00743160, application_credential_id=f39d52197da34e0280ee5cea8b74fc3e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:38.155333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:38.220272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2551/5076] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:20:38 2022] DELETE /identity/v3/users/aa213cfb086e4cc5aeaaf86b00743160/application_credentials/f39d52197da34e0280ee5cea8b74fc3e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:38.224482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3c9e-1d0b-42cc-917e-52a6616ca296 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:38.225345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:38.230624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:38.231387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:38.231759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:38.232055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:38.261547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:38.266428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:38.285391 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:38.320589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2526/5077] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:20:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:38.378744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0671b-2915-466a-8346-69837f4dae80 tempest-ApplicationCredentialsV3AdminTest-2027773267 tempest-ApplicationCredentialsV3AdminTest-2027773267-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:38.404569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecbdc35aff604bdebf1f9e54f2ff0d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f02d89d4a5184c34ac077031b4abfdae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:38.405714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:38.406188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:38.406644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] PATH_INFO: `/v3/roles/41ec2756d95941a3a9e07525f5df1054` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:38.410941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorizing `identity:delete_role(role_id=41ec2756d95941a3a9e07525f5df1054)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:38.415356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:38.469944 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:38.549027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Invalidating the token cache because role 41ec2756d95941a3a9e07525f5df1054 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:38.554361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:38.559253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:38.569439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2552/5078] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:38 2022] DELETE /identity/v3/roles/41ec2756d95941a3a9e07525f5df1054 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:38.569888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:38.667709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:38.669910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:38.774332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cc12-0ac5-42d7-a834-07dc18d45d8f service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:38.926851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bca649-9944-4ebc-b76d-afd34003cbdf tempest-ApplicationCredentialsV3AdminTest-1010012338 tempest-ApplicationCredentialsV3AdminTest-1010012338-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:38.939202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:38.940276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:38.940773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:38.941247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:38.946078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:38.977794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:38.979795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:38.986801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:38.987096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] PATH_INFO: `/v3/users/aa213cfb086e4cc5aeaaf86b00743160` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:38.998199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa213cfb086e4cc5aeaaf86b00743160)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:39.022967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:39.127863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:39.129550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:39.177852 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2553/5079] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:39.182929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:39.187686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:39.208641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa213cfb086e4cc5aeaaf86b00743160'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:39.211772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa213cfb086e4cc5aeaaf86b00743160'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:39.271408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa213cfb086e4cc5aeaaf86b00743160'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:39.339288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa213cfb086e4cc5aeaaf86b00743160'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:39.340299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d57ee4-aa4c-4586-bdd9-8ae6a253043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa213cfb086e4cc5aeaaf86b00743160'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:39.420765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2527/5080] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:38 2022] DELETE /identity/v3/users/aa213cfb086e4cc5aeaaf86b00743160 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:39.427111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:39.427671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:39.428121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:39.477748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771b22-4340-481a-8bae-54192a6e2c14 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:39.512028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:39.517694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:39.584968 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:39.619387 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:39.661252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:39.661885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:39.662149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:39.662490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:39.670317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:39.780292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2528/5081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:39.784616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:39.788550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:39.818073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd77e-5509-40e4-bad4-297bd058248e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:39.831656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:39.832747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:39.833559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:39.834414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:39.862596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:39.868152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:39.897632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2529/5082] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:20:39.972009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:39.973534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:39.999175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2554/5083] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:40.201612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:40.204452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:40.241459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911512ba-5b72-4655-a13e-f898f7893d81 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:40.261005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:40.261723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:40.262035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:40.263463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:40.269148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:40.315082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:40.316571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:40.349718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2530/5084] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:40.763854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:40.766610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:40.784010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc559e97-ab42-43ad-bc30-0ced1be404bf service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:40.846943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:40.847169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:40.847984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:40.847984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] PATH_INFO: `/v3/projects/5d6dcffe49164ed28dd263b753a52a25` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:40.858324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6dcffe49164ed28dd263b753a52a25)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:40.860283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:40.955586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6dcffe49164ed28dd263b753a52a25', 'request_id': 'req-0f1d996e-5b2c-4131-96a7-4247b626d61b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:40.969048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6dcffe49164ed28dd263b753a52a25', 'request_id': 'req-0f1d996e-5b2c-4131-96a7-4247b626d61b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:40.980350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6dcffe49164ed28dd263b753a52a25', 'request_id': 'req-0f1d996e-5b2c-4131-96a7-4247b626d61b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.004663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] The token cache is being invalidate because project 5d6dcffe49164ed28dd263b753a52a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:41.005013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.005652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.007437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2555/5085] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:40 2022] DELETE /identity/v3/projects/5d6dcffe49164ed28dd263b753a52a25 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:41.011383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:41.031939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d08c-0a31-4c6c-94af-96c4cdb340e5 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:41.244150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:41.244822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:41.245084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:41.245346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] PATH_INFO: `/v3/users/ecbdc35aff604bdebf1f9e54f2ff0d69` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:41.247270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbdc35aff604bdebf1f9e54f2ff0d69)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:41.249238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:41.351012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbdc35aff604bdebf1f9e54f2ff0d69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.351672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbdc35aff604bdebf1f9e54f2ff0d69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.367589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbdc35aff604bdebf1f9e54f2ff0d69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.425028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbdc35aff604bdebf1f9e54f2ff0d69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.431610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-600726ef-734f-4b29-a0a4-c6c7519a16f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbdc35aff604bdebf1f9e54f2ff0d69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:41.459184 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2531/5086] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:41 2022] DELETE /identity/v3/users/ecbdc35aff604bdebf1f9e54f2ff0d69 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:42.264291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:42.265759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:42.284725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d996e-5b2c-4131-96a7-4247b626d61b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:42.463456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:42.464985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.465527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.466039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] PATH_INFO: `/v3/projects/f02d89d4a5184c34ac077031b4abfdae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.467815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02d89d4a5184c34ac077031b4abfdae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:42.472414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:42.496832 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:42.590941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02d89d4a5184c34ac077031b4abfdae', 'request_id': 'req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:42.614569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02d89d4a5184c34ac077031b4abfdae', 'request_id': 'req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:42.631770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02d89d4a5184c34ac077031b4abfdae', 'request_id': 'req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:42.668256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] The token cache is being invalidate because project f02d89d4a5184c34ac077031b4abfdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:42.668557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:42.669265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bbaefa9e-07db-4aec-8d7c-49a79e1b4cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:42.671342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2556/5087] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:42 2022] DELETE /identity/v3/projects/f02d89d4a5184c34ac077031b4abfdae => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:42.677421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.678368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.678841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.720597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:42.723312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:42.749212 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:42.834067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2532/5088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:42.836335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.836528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.836803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.860110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:42.862748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:42.873823 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2557/5089] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:42.878539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:42.888794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96503e5d-1485-41a9-9a80-29b705bc84d1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:42.896665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:42.897305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.897620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.897897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.898562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:42.898865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:42.900501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:42.907958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:42.910514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:42.925974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35d857-77a0-45ca-9056-65db7f8ecb00 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:42.930751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2533/5090] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:42.931984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:42.933000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.933515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.934015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] PATH_INFO: `/v3/users/13fb36f84c5f4b8eb2759b68753cabf4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.935790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fb36f84c5f4b8eb2759b68753cabf4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:42.937505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:42.938357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:42.953520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b9d5-ffba-40ba-b2b1-e748cbaf7f44 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:42.962005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:42.962458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:42.962736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:42.963007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:42.963811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:42.965779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.033883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fb36f84c5f4b8eb2759b68753cabf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:43.044691 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2534/5091] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:42 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:43.049938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:43.060666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fb36f84c5f4b8eb2759b68753cabf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:43.106286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fb36f84c5f4b8eb2759b68753cabf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:43.107186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fb36f84c5f4b8eb2759b68753cabf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:43.109029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5c3c0c07-3712-4e61-806f-99fb4ce5f86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fb36f84c5f4b8eb2759b68753cabf4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:43.146001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2558/5092] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:42 2022] DELETE /identity/v3/users/13fb36f84c5f4b8eb2759b68753cabf4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:43.149953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.150475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.151079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.183652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:43.185878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:43.197228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c545d3-75cc-44c0-9df0-b82b5821d93a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:43.286163 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:43.311999 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2559/5093] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:43.327980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:43.331040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:43.344168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:43.344806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.345440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.345736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.346373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:43.348327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.425047 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2535/5094] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:43 2022] POST /identity/v3/users => generated 286 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:43.430027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:43.431977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:43.457226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df442b4-8334-47f7-9316-6adb50c83760 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:43.473378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:43.474127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.474416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.474696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.475442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:43.477077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.482304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74dc13-3dfa-480f-8654-b2521b056ec8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:43.490110 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:43.492104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:43.492942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.493245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.493567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.508119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2536/5095] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:43.512152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:43.516958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:43.521789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.537694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c020c7-c27f-4e65-af4c-65f2abcfd61c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:43.556022 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2560/5096] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:20:43.570678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:43.571315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.571661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.572300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.573133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:43.574781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952095-97b6-449d-a73c-e20172ba206f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.602677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2537/5097] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:43.606889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:43.624567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513ae3e-b8b1-42b2-9afb-d4dc23d964e3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:43.641084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:43.641907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.642193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.642491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] PATH_INFO: `/v3/projects/70b0d587ac2240a39651432b1c369f99/users/e82a56e2ae524bda889e28eacde25706/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.682094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b0d587ac2240a39651432b1c369f99, user_id=e82a56e2ae524bda889e28eacde25706, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:43.688744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:43.718835 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2561/5098] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:43 2022] PUT /identity/v3/projects/70b0d587ac2240a39651432b1c369f99/users/e82a56e2ae524bda889e28eacde25706/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:43.731227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:43.731743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:43.732399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:43.852304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] MFA Rules not processed for user `e82a56e2ae524bda889e28eacde25706`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:43.855188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:43.976935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2538/5099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:43.985161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.249083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ecd9-812b-430f-a292-743fb17cb998 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:44.269878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:44.272969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.274946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.276272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.277874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:44.284930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:44.367744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.377655 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2562/5100] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:43 2022] POST /identity/v3/projects => generated 371 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:20:44.380256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262f3a4-0e89-4c3e-a283-f2483f16c1a6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:44.554609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:44.555687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.555845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.556264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.557167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:44.563052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:44.611479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.620775 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2539/5101] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:44 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:44.625373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8c596-f08a-4812-ab98-c322ae7d30b9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:44.633525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:44.635021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.635664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.636157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.637186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:44.639620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:44.673964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.677739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:44.736697 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2563/5102] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:44.738143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.738887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046393ab-2c76-480e-b05c-9ffd79c38534 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:44.748292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:44.749145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.764496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.769249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] PATH_INFO: `/v3/projects/ac529a1d70be46599a7bce95987ae4c0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.773034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac529a1d70be46599a7bce95987ae4c0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:44.777104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:44.782581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418527-d4c8-4a95-b10f-890e9eb1a199 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:44.799503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:44.800551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.801077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.801622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] PATH_INFO: `/v3/projects/5d179f20f86f400ba7de719273b92d62/users/b2ffd8802513453e9660e88a074b7b42/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.849101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d179f20f86f400ba7de719273b92d62, user_id=b2ffd8802513453e9660e88a074b7b42, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:44.851971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1a567-a198-4d4f-92a3-2887362e8b8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:44.882889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2564/5103] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:44 2022] PUT /identity/v3/projects/5d179f20f86f400ba7de719273b92d62/users/b2ffd8802513453e9660e88a074b7b42/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:44.882889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0fbc3-4aed-43e5-8eff-71a6656de503 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:44.882889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0fbc3-4aed-43e5-8eff-71a6656de503 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:44.882889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0fbc3-4aed-43e5-8eff-71a6656de503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:44.920100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac529a1d70be46599a7bce95987ae4c0', 'request_id': 'req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:44.926601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09e0fbc3-4aed-43e5-8eff-71a6656de503 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:44.929240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09e0fbc3-4aed-43e5-8eff-71a6656de503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:44.930319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac529a1d70be46599a7bce95987ae4c0', 'request_id': 'req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:44.938753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac529a1d70be46599a7bce95987ae4c0', 'request_id': 'req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:44.940985 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:44.983153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] The token cache is being invalidate because project ac529a1d70be46599a7bce95987ae4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:44.983511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:44.985449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:44.985982 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:44.989197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2540/5104] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:44 2022] DELETE /identity/v3/projects/ac529a1d70be46599a7bce95987ae4c0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:44.990164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:44.998296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:45.087735 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2565/5105] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:45.089964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.090431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.091156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.164355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:45.166521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:45.184221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f2d6-f8f7-4d83-8a3e-de72212debcb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:45.191816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:45.192755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.192755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.192970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.193650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:45.195499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054daad-f89f-4a5b-ac72-2623c1d09a60 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:45.207295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2566/5106] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:45.208188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:45.212833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:45.218633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2541/5107] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:45.220105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.225445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.225445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.300195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:45.301861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:45.353267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cea813-fb08-42e0-89fd-736f25630aa4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:45.359257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:45.359882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.360167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.360439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.365801 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2542/5108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:45.366857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:45.386165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:45.387759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:45.415844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2567/5109] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:20:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:45.418282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:45.421103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498173c-0933-4035-b0db-f7d517ab15b1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:45.440340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:45.443206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.443474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.443757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] PATH_INFO: `/v3/projects/5d179f20f86f400ba7de719273b92d62/users/b2ffd8802513453e9660e88a074b7b42/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.448705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d179f20f86f400ba7de719273b92d62, user_id=b2ffd8802513453e9660e88a074b7b42, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:45.449188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10b9a7-1ab7-44a1-a498-a4677dc725e7 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:45.452824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c0489-2959-4f89-a63e-55148c943ce4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:45.462443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:45.463898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.464174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.464453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.465126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:45.466021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:45.467633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:45.484010 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2543/5110] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:45 2022] PUT /identity/v3/projects/5d179f20f86f400ba7de719273b92d62/users/b2ffd8802513453e9660e88a074b7b42/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:45.495494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.495494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.495494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.506781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2568/5111] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:45.508603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:45.538018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634f83-7d80-483a-8f49-74bf56ba5f26 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:45.559909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] MFA Rules not processed for user `b2ffd8802513453e9660e88a074b7b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:45.561618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:45.851530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:45.852210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:45.852498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:45.852771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:45.853514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:45.856003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:45.956792 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2544/5112] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:45.959699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:45.991136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabb16-8c9f-4367-9847-bd3ec24f6b65 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:46.021248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:46.021803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:46.022104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:46.026000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:46.031176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:46.036728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:46.046110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2569/5113] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:45 2022] POST /identity/v3/projects => generated 377 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:46.073647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:46.147912 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2545/5114] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:20:45 2022] POST /identity/v3/domains => generated 277 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:46.152800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:46.289550 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:46.402969 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:46.404229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fe93-0ad0-42b2-b8c1-cf26837eb790 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:46.468701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b17e89-cf26-4122-95a7-14f83cde79bd tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:46.499106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:46.499968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:46.500260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:46.500540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:46.501238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:46.507435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:46.648276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2546/5115] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:46 2022] POST /identity/v3/projects => generated 400 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:46.648276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:46.789543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:46.798149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:46.803013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:46.803197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:46.809727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:46.815982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:46.849953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343148-beaa-4f70-9b4e-eb8e02c54508 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:46.869208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:46.871121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:46.871425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:46.871712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:46.872370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:46.881156 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:20:46.881156 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:20:46.881156 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:20:46.885064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2570/5116] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:46 2022] POST /identity/v3/users => generated 289 bytes in 818 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:46.885210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:46.886916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:46.914127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efb14-7d81-412c-9451-51296b46929f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:46.931027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2547/5117] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:20:46 2022] POST /identity/v3/groups => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:46.938283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:46.984237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791f4e-f41c-458c-bb22-7de730279d45 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.007247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.007875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.010934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.011514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.027522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.042735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.100084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2548/5118] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:46 2022] POST /identity/v3/users => generated 445 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:47.113589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.167631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159c33-78c4-4a1e-a45f-e30608a558a6 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.190274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.193493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.194064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.195862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.198767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.200037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.204952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.205536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.205880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.206617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.212054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.217831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.249845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2571/5119] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:47.254847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.279091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde07c-982c-4d23-9c8e-02b5e5d87bce admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.294051 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2549/5120] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:47 2022] POST /identity/v3/roles => generated 238 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:47.295778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.300296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.301304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.301304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.301812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.302707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.304701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.336719 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2572/5121] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:47 2022] GET /identity/v3/roles => generated 1649 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:47.341797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.364398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c9fb-5fd6-4a6c-b3b9-5d2ab52f20da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.369764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab452a6-c55a-4b27-b35e-827ace08936a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.376941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.377919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.378298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.378861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] PATH_INFO: `/v3/projects/cb98775f30874f7e809e9d0f3565fc57/users/749e75692e7f4a04b9e54f0fa131e337/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.408800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.413324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.417529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.418013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.442817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=2da484577d36452db0f8958aaeee57e4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.446287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb98775f30874f7e809e9d0f3565fc57, user_id=749e75692e7f4a04b9e54f0fa131e337, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.449303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.466479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a962a-27d8-452b-b102-0eafee5bffda admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.483504 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2550/5122] 10.222.0.16 () {60 vars in 1585 bytes} [Sun Sep 25 01:20:47 2022] PUT /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:47.487571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.562167 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2573/5123] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:47 2022] PUT /identity/v3/projects/cb98775f30874f7e809e9d0f3565fc57/users/749e75692e7f4a04b9e54f0fa131e337/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:47.573098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.576271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.576271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.648494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b4c3-bb3d-4183-ba9a-f0f185f3de6d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:47.661903 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:47.662962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] MFA Rules not processed for user `749e75692e7f4a04b9e54f0fa131e337`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:47.664609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:47.696561 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:47.888594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2574/5124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:20:47.893556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:47.914562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:47.933878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:47.934615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:47.935166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:47.947413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:check_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=2da484577d36452db0f8958aaeee57e4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:47.963558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:47.987454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2551/5125] 10.222.0.16 () {58 vars in 1567 bytes} [Sun Sep 25 01:20:47 2022] HEAD /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:47.991836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.049531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378713a-cb09-402e-ab93-5cc7c91d0055 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.050735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab232-0e8f-4715-a1cf-aa1d582f5048 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.063685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.064547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.064987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.065366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.066062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.069289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.070549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.072845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.073431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.075613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.080249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=2da484577d36452db0f8958aaeee57e4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.100176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.118845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 2da484577d36452db0f8958aaeee57e4 was removed from group c7e4b4af36954869b8b169aa6cd04845 on project 24a1e12b094540a4b6925cdbfdaa2eba. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:48.120188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:48.121127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:48.171128 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2552/5126] 10.222.0.16 () {58 vars in 1569 bytes} [Sun Sep 25 01:20:47 2022] DELETE /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/groups/c7e4b4af36954869b8b169aa6cd04845/roles/2da484577d36452db0f8958aaeee57e4/inherited_to_projects => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:48.174067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2575/5127] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:47 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:20:48.175566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.177444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:48.179526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.187574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:48.325885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de302e-fcd0-456f-9e51-ecb205043b15 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.378622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496d6-d9b4-43b1-a7cf-70e10cd0e6b0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.392909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.394624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.394916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.395221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.396110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.400155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.449474 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2576/5128] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:20:48 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:48.454223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.479708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb6-3905-43ee-8987-ae38045e0961 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.480841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.482230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.482883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.483515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/2da484577d36452db0f8958aaeee57e4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.485597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2da484577d36452db0f8958aaeee57e4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.487853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.488231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.489788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.490668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.490668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.493056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.494359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.523346 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2577/5129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:48 2022] GET /identity/v3/roles => generated 1649 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:20:48.528570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.555635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 2da484577d36452db0f8958aaeee57e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:48.556576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:48.559980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffc0b-39ee-4d29-bd07-bebf8bc3debd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.560607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:48.564433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2553/5130] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:48 2022] DELETE /identity/v3/roles/2da484577d36452db0f8958aaeee57e4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:48.571715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.573565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:48.583857 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:48.616334 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:48.816858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.817901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.834771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.835884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] PATH_INFO: `/v3/projects/c95bc2327c62463c9ff7d84fad929d2d/users/e04b489b6c81455da3d3ffea9decd1b5/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.856028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36240f-7d38-4c03-a89f-0a8a674d1ed0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.886596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:48.887303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:48.887739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:48.888638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:48.889352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.891017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.914543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95bc2327c62463c9ff7d84fad929d2d, user_id=e04b489b6c81455da3d3ffea9decd1b5, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:48.922149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:48.944395 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2554/5131] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:48 2022] POST /identity/v3/roles => generated 240 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:48.946255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.967081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2578/5132] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:48 2022] PUT /identity/v3/projects/c95bc2327c62463c9ff7d84fad929d2d/users/e04b489b6c81455da3d3ffea9decd1b5/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:48.968913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:48.970628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e176461-ed6c-41fb-be9b-8ba3911bc596 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:48.973790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:49.115560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.116233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.116524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.116914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.133949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e244e0-0ff5-4cde-957b-c8cb61e32c38 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:49.145689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=1231f3a7cc964255b665a801d8a31c09)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.145952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.146659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.146870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.147141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.158795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.159841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.160530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.191576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2579/5133] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:20:48 2022] GET /identity/v3/roles => generated 1651 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:20:49.193381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:49.213397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2555/5134] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 25 01:20:48 2022] PUT /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:49.217564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:49.284603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bcb17-9733-4283-8916-ddcccedbb2f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:49.438685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4e8a8-8dfd-460b-b8e2-065e42c7633e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:49.446584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.447780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.448278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.448755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.452344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:check_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=1231f3a7cc964255b665a801d8a31c09)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.456424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.467266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2556/5135] 10.222.0.16 () {58 vars in 1564 bytes} [Sun Sep 25 01:20:49 2022] HEAD /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:49.468723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:49.482624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78396d5-4b5a-48f7-bda2-888479ea521a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:49.482914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.483603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.483887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.484165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] PATH_INFO: `/v3/projects/c95bc2327c62463c9ff7d84fad929d2d/users/e04b489b6c81455da3d3ffea9decd1b5/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.489667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95bc2327c62463c9ff7d84fad929d2d, user_id=e04b489b6c81455da3d3ffea9decd1b5, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.490477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.491393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.491885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.492429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.492631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4bce-6156-430a-b428-91890089e9f9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.495826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=1231f3a7cc964255b665a801d8a31c09)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.498860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.518126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 1231f3a7cc964255b665a801d8a31c09 was removed from user 857c14e56eee45879ba90bc75fb9194f on project 24a1e12b094540a4b6925cdbfdaa2eba. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:49.518613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:49.519987 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2580/5136] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:20:49 2022] PUT /identity/v3/projects/c95bc2327c62463c9ff7d84fad929d2d/users/e04b489b6c81455da3d3ffea9decd1b5/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:49.530310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.531171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.531171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.532004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:49.558938 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:49.584752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2557/5137] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 25 01:20:49 2022] DELETE /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/1231f3a7cc964255b665a801d8a31c09/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:49.591124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:49.595552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:49.612902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] MFA Rules not processed for user `e04b489b6c81455da3d3ffea9decd1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:20:49.614255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:49.667506 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:49.772449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37395ad-522d-46a9-bf9b-560f482fca4c tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:49.785985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:49.786399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:49.787032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:49.787032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/1231f3a7cc964255b665a801d8a31c09` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:49.788618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1231f3a7cc964255b665a801d8a31c09)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:49.790313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:49.944805 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2581/5138] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:20:49.974738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:49.977171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:50.019349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 1231f3a7cc964255b665a801d8a31c09 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:50.019727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:50.023319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:50.036793 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2558/5139] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:49 2022] DELETE /identity/v3/roles/1231f3a7cc964255b665a801d8a31c09 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:50.040950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:50.047629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:50.165436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b00e7-d8f6-47f6-b393-4ffb08f0b0a4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:50.277754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5118-98d9-4f92-b50f-4ef77b20222d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:50.284616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:50.285543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:50.285941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:50.286314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:50.287005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:50.290371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:50.292826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:50.293547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:50.293833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:50.294235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:50.296846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:50.316136 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2559/5140] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:50 2022] POST /identity/v3/roles => generated 239 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:50.321573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:50.427948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2acab5-e7d6-4851-b87c-6b795d65a5c8 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:50.463548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:50.467464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:50.467761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:50.468049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:50.490767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:50.493418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:50.494656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=b0ca00a5775848429c0779e2b41b500a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:50.511869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:50.516066 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2582/5141] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:20:50.588161 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2560/5142] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 25 01:20:50 2022] PUT /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:50.592451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:50.621716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed881-2661-4125-8ebf-48fb6260a818 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:50.681323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:50.684188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:50.731894 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:50.890018 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:50.899649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:50.899649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:50.899649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:50.900571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:50.912162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ded81-4009-4943-9093-72fbfa4b4692 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:50.913233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=cfe70e3435d7438081a89dd350f97fc6, group_id=c7e4b4af36954869b8b169aa6cd04845)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:50.917562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:50.920899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:50.921614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:50.922212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:50.922319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:50.929361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:50.966754 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2583/5143] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 25 01:20:50 2022] GET /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/inherited_to_projects => generated 447 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:50.971532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:50.990008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9e85-f492-415b-a19b-9c8218525310 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:51.004384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:51.005093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:51.005680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:51.005968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:51.014172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=b0ca00a5775848429c0779e2b41b500a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:51.018001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:51.049938 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2584/5144] 10.222.0.16 () {58 vars in 1564 bytes} [Sun Sep 25 01:20:50 2022] HEAD /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:51.052397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:51.072628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75eeb5-ba25-4d76-9939-4cf21035f51f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:51.108365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:51.110628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:51.121638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:51.122232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:51.128262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, group_id=c7e4b4af36954869b8b169aa6cd04845, role_id=b0ca00a5775848429c0779e2b41b500a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:51.133138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:51.157291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role b0ca00a5775848429c0779e2b41b500a was removed from group c7e4b4af36954869b8b169aa6cd04845 on domain cfe70e3435d7438081a89dd350f97fc6. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:51.158424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:51.159146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:51.203539 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2585/5145] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 25 01:20:51 2022] DELETE /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/groups/c7e4b4af36954869b8b169aa6cd04845/roles/b0ca00a5775848429c0779e2b41b500a/inherited_to_projects => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:51.208662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:51.218466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:51.330576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:51.346094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:51.467622 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2561/5146] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:20:51.616055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea6196-a73b-4ebd-9a7b-68d824f29792 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:51.633698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:51.634867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:51.637911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:51.638931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/b0ca00a5775848429c0779e2b41b500a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:51.643944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b0ca00a5775848429c0779e2b41b500a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:51.650972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:51.819804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role b0ca00a5775848429c0779e2b41b500a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:51.820111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:51.828649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:51.832180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2586/5147] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:51 2022] DELETE /identity/v3/roles/b0ca00a5775848429c0779e2b41b500a => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:51.837160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:51.869976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b71b-2efd-4847-a7c1-9135406cb0d0 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:52.157001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:52.157740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:52.158026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:52.158309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:52.158996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:52.160632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:52.236107 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2562/5148] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:51 2022] POST /identity/v3/roles => generated 239 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:52.236615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:52.242132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:52.264947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa0c1-24c5-4f9d-bcd1-1dd88116575d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:52.297572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:52.299065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:52.299357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:52.299637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:52.311731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=ad28e3f2b7e243b2b37f72651677b770)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:52.315099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:52.382896 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2587/5149] 10.222.0.16 () {60 vars in 1579 bytes} [Sun Sep 25 01:20:52 2022] PUT /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:52.396197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:52.422115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c700-f764-48e6-bfa3-1c729b92688e tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:52.627393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:52.629790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:52.634173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:52.634836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:52.644503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:52.670944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:52.748102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:52.764520 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2563/5150] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Sep 25 01:20:52 2022] GET /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/inherited_to_projects => generated 446 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:52.769633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d081dc-8b46-4b68-82a4-bb65eed6a36d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:52.804151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:52.811647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:52.815747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:52.816324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:52.829980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=ad28e3f2b7e243b2b37f72651677b770)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:52.847259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:52.889601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2588/5151] 10.222.0.16 () {58 vars in 1561 bytes} [Sun Sep 25 01:20:52 2022] HEAD /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:20:52.894229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:52.915664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531da4f-0bdd-4568-845f-92d3899e1a2f tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:52.942252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:52.944135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:52.947041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:52.948984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:52.968209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=ad28e3f2b7e243b2b37f72651677b770)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:52.976381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:53.011698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role ad28e3f2b7e243b2b37f72651677b770 was removed from user 857c14e56eee45879ba90bc75fb9194f on domain cfe70e3435d7438081a89dd350f97fc6. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:53.013739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:53.018434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:53.086671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2564/5152] 10.222.0.16 () {58 vars in 1563 bytes} [Sun Sep 25 01:20:52 2022] DELETE /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/ad28e3f2b7e243b2b37f72651677b770/inherited_to_projects => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:53.090613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:53.092374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:53.150353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d666-c536-4243-925b-bc8ef3de0301 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:53.272427 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:53.320382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:53.321048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:53.321350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:53.321829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/ad28e3f2b7e243b2b37f72651677b770` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:53.323522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad28e3f2b7e243b2b37f72651677b770)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:53.325366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:53.433920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role ad28e3f2b7e243b2b37f72651677b770 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:53.434319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:53.435438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:53.445199 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2589/5153] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:53 2022] DELETE /identity/v3/roles/ad28e3f2b7e243b2b37f72651677b770 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:53.446680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:53.462803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389266ff-1909-4077-a307-aeec68a5c502 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:53.484615 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:53.791290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:53.791945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:53.792236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:53.792516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:53.793205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:53.809925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:53.855466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2565/5154] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:53 2022] POST /identity/v3/roles => generated 240 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:53.859206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:53.863215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:53.912206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb12be-f156-473c-a306-3387dc654ee0 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:53.938755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:53.939402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:53.939714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:53.945795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:53.946569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:53.963451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:54.095967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2590/5155] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:53 2022] POST /identity/v3/projects => generated 410 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:54.100384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:54.125637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3060-9d35-416a-99e9-9cf6cd29c435 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:54.351977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:54.353044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:54.353556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:54.354006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/075e24cc800745fcb07653d920e52a6a/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:54.358475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=075e24cc800745fcb07653d920e52a6a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:54.364324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:54.405046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2566/5156] 10.222.0.16 () {60 vars in 1579 bytes} [Sun Sep 25 01:20:54 2022] PUT /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/075e24cc800745fcb07653d920e52a6a/inherited_to_projects => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:54.412345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:54.437876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbca02-659c-4e73-b055-5f6f17953302 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:54.586294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:54.590011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:54.590438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:54.591803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:54.593087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=24a1e12b094540a4b6925cdbfdaa2eba, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:54.595352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:54.601452 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:20:54.601452 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:20:54.601452 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:20:54.605240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:54.826450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:54.828019 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2591/5157] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:54 2022] GET /identity/v3/role_assignments?scope.project.id=24a1e12b094540a4b6925cdbfdaa2eba&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 648 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:54.843692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3f48-4a26-426c-8371-6545900c77fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:54.866655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:54.867437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:54.870791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:54.871413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:54.872542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=56a4896435d44e32949af5dd75ed05a1, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:54.872968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:54.881956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:55.049742 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2567/5158] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:54 2022] GET /identity/v3/role_assignments?scope.project.id=56a4896435d44e32949af5dd75ed05a1&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 648 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:55.057431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:55.089377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86156-7a1d-43cc-8fe0-df61ff09d57a tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:55.109826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:55.110862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:55.111193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:55.120854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/075e24cc800745fcb07653d920e52a6a/inherited_to_projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:55.130119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cfe70e3435d7438081a89dd350f97fc6, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=075e24cc800745fcb07653d920e52a6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:55.153938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:55.170567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 075e24cc800745fcb07653d920e52a6a was removed from user 857c14e56eee45879ba90bc75fb9194f on domain cfe70e3435d7438081a89dd350f97fc6. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:55.170872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:55.175266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:55.217082 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2592/5159] 10.222.0.16 () {58 vars in 1563 bytes} [Sun Sep 25 01:20:55 2022] DELETE /identity/v3/OS-INHERIT/domains/cfe70e3435d7438081a89dd350f97fc6/users/857c14e56eee45879ba90bc75fb9194f/roles/075e24cc800745fcb07653d920e52a6a/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:55.222272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:55.224766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:55.258165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85252-ec23-49b2-aaf9-f23cdbaf0755 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:55.389991 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:55.460687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:55.461318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:55.461633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:55.461913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:55.462653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=24a1e12b094540a4b6925cdbfdaa2eba, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:55.462963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:55.467443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:55.617496 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2568/5160] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:55 2022] GET /identity/v3/role_assignments?scope.project.id=24a1e12b094540a4b6925cdbfdaa2eba&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 228 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:55.619257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:55.640851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478378-bd4e-4f61-8bb8-b93a11e4acd1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:55.665916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:55.666526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:55.666807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:55.667082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:55.669852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=56a4896435d44e32949af5dd75ed05a1, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:55.669852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:55.695247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:55.720541 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:55.960985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2593/5161] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:55 2022] GET /identity/v3/role_assignments?scope.project.id=56a4896435d44e32949af5dd75ed05a1&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 228 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:55.965124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:55.984736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57992b-55a9-4164-ba9f-cb99803ce584 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:56.008185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:56.009107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:56.009584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:56.010025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects/56a4896435d44e32949af5dd75ed05a1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:56.015437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56a4896435d44e32949af5dd75ed05a1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:56.019678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:56.150836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a4896435d44e32949af5dd75ed05a1', 'request_id': 'req-ad392361-07b8-4c48-b662-892dbf35aa8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.171488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a4896435d44e32949af5dd75ed05a1', 'request_id': 'req-ad392361-07b8-4c48-b662-892dbf35aa8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.191718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a4896435d44e32949af5dd75ed05a1', 'request_id': 'req-ad392361-07b8-4c48-b662-892dbf35aa8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.222098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] The token cache is being invalidate because project 56a4896435d44e32949af5dd75ed05a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:56.222514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.232401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.238607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2569/5162] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:55 2022] DELETE /identity/v3/projects/56a4896435d44e32949af5dd75ed05a1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:56.242485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:56.244252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:56.280399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60807b11-e758-41ce-84ae-1e85ae932667 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:56.545188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:56.545884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:56.546208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:56.546449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/075e24cc800745fcb07653d920e52a6a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:56.550633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=075e24cc800745fcb07653d920e52a6a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:56.552256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:56.665056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role 075e24cc800745fcb07653d920e52a6a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:56.665365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.675267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:56.679310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2594/5163] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:56 2022] DELETE /identity/v3/roles/075e24cc800745fcb07653d920e52a6a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:56.685229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:56.697545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392361-07b8-4c48-b662-892dbf35aa8d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:56.889658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:56.892541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:56.892831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:56.893120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:56.893847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:56.898361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:56.983098 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2570/5164] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:20:56 2022] POST /identity/v3/roles => generated 239 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:56.984277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:56.988531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:57.030219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba23333-3c9b-4aa8-a608-19de9fc426ee tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:57.068014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:57.068667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:57.068968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:57.069240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:57.070032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:57.072812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:57.160915 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2595/5165] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:20:56 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:20:57.164915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:57.181475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9fc5-640b-44f3-85f8-6addccfdc1a1 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:57.240916 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:57.389601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:57.390586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:57.391047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:57.392103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/ccbaee747d0145f3af49b56ee4831104/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:57.401000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:create_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=ccbaee747d0145f3af49b56ee4831104)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:57.430061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:57.457791 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2571/5166] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 25 01:20:57 2022] PUT /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/ccbaee747d0145f3af49b56ee4831104/inherited_to_projects => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:57.462184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:57.483475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466ac9-8927-496e-b197-35824bd9ca5d tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:57.647514 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:57.666321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:57.666884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:57.667172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:57.667451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:57.668203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=12bec187a21e478c83e6cae92670c2ec, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:57.668512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:57.670443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:57.831369 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2596/5167] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:57 2022] GET /identity/v3/role_assignments?scope.project.id=12bec187a21e478c83e6cae92670c2ec&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 649 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:57.832760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:57.848196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f17d0-60f5-497a-be69-e33da909b170 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:57.876929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:57.879622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:57.885421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:57.886357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/ccbaee747d0145f3af49b56ee4831104/inherited_to_projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:57.893211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=24a1e12b094540a4b6925cdbfdaa2eba, user_id=857c14e56eee45879ba90bc75fb9194f, role_id=ccbaee747d0145f3af49b56ee4831104)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:57.897862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:57.932432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role ccbaee747d0145f3af49b56ee4831104 was removed from user 857c14e56eee45879ba90bc75fb9194f on project 24a1e12b094540a4b6925cdbfdaa2eba. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:57.936597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:57.939728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:57.979706 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2572/5168] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 25 01:20:57 2022] DELETE /identity/v3/OS-INHERIT/projects/24a1e12b094540a4b6925cdbfdaa2eba/users/857c14e56eee45879ba90bc75fb9194f/roles/ccbaee747d0145f3af49b56ee4831104/inherited_to_projects => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:57.983966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:57.986056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:58.015094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955af20-7838-4c8d-b39a-c76257ff45fe tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:58.122762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:58.123854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:58.124249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:58.124641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:58.125524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Adding query filter params (scope.project.id=12bec187a21e478c83e6cae92670c2ec, user.id=857c14e56eee45879ba90bc75fb9194f) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:20:58.126526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:58.129272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:58.288530 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2597/5169] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 25 01:20:57 2022] GET /identity/v3/role_assignments?scope.project.id=12bec187a21e478c83e6cae92670c2ec&user.id=857c14e56eee45879ba90bc75fb9194f&effective => generated 228 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:20:58.292895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:58.311814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bceb67-2878-43ef-9ffa-d87270f39529 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:58.338579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:58.339247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:58.342464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:58.343296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects/12bec187a21e478c83e6cae92670c2ec` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:58.345306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12bec187a21e478c83e6cae92670c2ec)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:58.352005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:58.572221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bec187a21e478c83e6cae92670c2ec', 'request_id': 'req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.586215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bec187a21e478c83e6cae92670c2ec', 'request_id': 'req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.601070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bec187a21e478c83e6cae92670c2ec', 'request_id': 'req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.625486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] The token cache is being invalidate because project 12bec187a21e478c83e6cae92670c2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:58.626382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.628885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.634825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2573/5170] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:58 2022] DELETE /identity/v3/projects/12bec187a21e478c83e6cae92670c2ec => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:58.636093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:58.638224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:58.690874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde7a3d-eb76-4f94-accc-6d1eecfaf536 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:58.872998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:58.874100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:58.874602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:58.875122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/roles/ccbaee747d0145f3af49b56ee4831104` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:58.879861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ccbaee747d0145f3af49b56ee4831104)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:58.881958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:58.900444 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:58.967069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invalidating the token cache because role ccbaee747d0145f3af49b56ee4831104 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:20:58.967369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.969120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:58.977073 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2598/5171] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:58 2022] DELETE /identity/v3/roles/ccbaee747d0145f3af49b56ee4831104 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:58.978622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:58.991810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c40ab-8fb6-4a4f-873a-1ea7ccd6cf24 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:59.187606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:59.188345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:59.188844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:59.189216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/users/857c14e56eee45879ba90bc75fb9194f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:59.191363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_user(user_id=857c14e56eee45879ba90bc75fb9194f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:59.193443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:59.270866 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:59.314537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857c14e56eee45879ba90bc75fb9194f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:59.315911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857c14e56eee45879ba90bc75fb9194f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:59.329340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857c14e56eee45879ba90bc75fb9194f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:59.369180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857c14e56eee45879ba90bc75fb9194f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:59.371103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857c14e56eee45879ba90bc75fb9194f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:20:59.406108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2574/5172] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:20:58 2022] DELETE /identity/v3/users/857c14e56eee45879ba90bc75fb9194f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:59.410743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:59.414314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:59.437919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef38a-8b78-48ac-8930-50d581ff6730 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:59.610923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:59.611596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:59.611880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:59.612157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/groups/c7e4b4af36954869b8b169aa6cd04845` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:59.613373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c7e4b4af36954869b8b169aa6cd04845)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:59.614448 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:20:59.614448 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:20:59.614448 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:20:59.615659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:20:59.753621 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2599/5173] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:20:59 2022] DELETE /identity/v3/groups/c7e4b4af36954869b8b169aa6cd04845 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:20:59.754930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:59.757112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:59.783348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a5fc-4f9f-4678-8d06-72fb61545928 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:20:59.832973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:20:59.834785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:20:59.939226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:20:59.939908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:20:59.940192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:20:59.940469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/projects/24a1e12b094540a4b6925cdbfdaa2eba` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:20:59.944005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24a1e12b094540a4b6925cdbfdaa2eba)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:20:59.946045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:00.020273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706256a-294d-4770-b1fe-ef3dc2bce220 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:00.028421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:00.031383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:00.031587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:00.031869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:00.060387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a1e12b094540a4b6925cdbfdaa2eba', 'request_id': 'req-75c1608d-3a71-40e0-acb1-e26d2c700208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.067064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:00.137353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a1e12b094540a4b6925cdbfdaa2eba', 'request_id': 'req-75c1608d-3a71-40e0-acb1-e26d2c700208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.137353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a1e12b094540a4b6925cdbfdaa2eba', 'request_id': 'req-75c1608d-3a71-40e0-acb1-e26d2c700208'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.210007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] The token cache is being invalidate because project 24a1e12b094540a4b6925cdbfdaa2eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:00.210569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.211601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.214954 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2575/5174] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:59 2022] DELETE /identity/v3/projects/24a1e12b094540a4b6925cdbfdaa2eba => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:00.218781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:00.220756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:00.233114 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:00.290770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:00.292784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:00.320311 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:00.320924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2600/5175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:00.393586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1608d-3a71-40e0-acb1-e26d2c700208 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:00.399830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:00.400777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:00.401714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:00.402402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/domains/cfe70e3435d7438081a89dd350f97fc6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:00.404089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cfe70e3435d7438081a89dd350f97fc6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:00.406048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:00.459047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.462626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.529007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.530733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.539214 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2576/5176] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:21:00 2022] PATCH /identity/v3/domains/cfe70e3435d7438081a89dd350f97fc6 => generated 278 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:00.540357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:00.565834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810158-3ed8-4f8f-9fb8-693d7189793d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:00.804777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd8802513453e9660e88a074b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d179f20f86f400ba7de719273b92d62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:00.805478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:00.805796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:00.806100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] PATH_INFO: `/v3/domains/cfe70e3435d7438081a89dd350f97fc6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:00.846249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cfe70e3435d7438081a89dd350f97fc6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:00.848051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:00.947628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:00.954338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.159422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.178141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.215897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.251534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] The token cache is being invalidate because project cfe70e3435d7438081a89dd350f97fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:01.253134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.255977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.294142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.302961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.304935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7 tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cfe70e3435d7438081a89dd350f97fc6', 'request_id': 'req-56c8a606-5e0f-4d82-b9bf-87eb7dc262e7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.323700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2601/5177] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:21:00 2022] DELETE /identity/v3/domains/cfe70e3435d7438081a89dd350f97fc6 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:01.325124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:01.326699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:01.510431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb639-74d3-404e-b94d-3e461cdc9bfc tempest-InheritsV3TestJSON-240808454 tempest-InheritsV3TestJSON-240808454-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:01.731918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:01.733438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:01.733438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:01.734231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] PATH_INFO: `/v3/users/e82a56e2ae524bda889e28eacde25706` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:01.753101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82a56e2ae524bda889e28eacde25706)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:01.763931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:01.913732 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:01.922197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82a56e2ae524bda889e28eacde25706'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.923717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82a56e2ae524bda889e28eacde25706'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.933659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82a56e2ae524bda889e28eacde25706'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.994404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82a56e2ae524bda889e28eacde25706'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:01.999773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82a56e2ae524bda889e28eacde25706'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:02.057667 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2577/5178] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:01 2022] DELETE /identity/v3/users/e82a56e2ae524bda889e28eacde25706 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:02.059462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:02.059922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:02.060249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:02.117143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:02.118430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:02.171232 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:02.379127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2602/5179] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:02.404601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:02.407844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:02.618739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37fc5-09cd-4cb4-8ac3-7a0cd2a37d21 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:02.630837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:02.632921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:02.638734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:02.639259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:02.668360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:02.670597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:02.701847 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2578/5180] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:03.379205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:03.381481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:03.424565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8795-2b58-4759-9fbb-1a408a10490e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:03.452717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:03.454319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:03.454773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:03.455211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] PATH_INFO: `/v3/projects/70b0d587ac2240a39651432b1c369f99` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:03.462223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b0d587ac2240a39651432b1c369f99)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:03.464263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:03.517875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:03.519847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:03.717798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b0d587ac2240a39651432b1c369f99', 'request_id': 'req-07455fee-d58e-4b24-a570-c4576613e211'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:03.746615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b0d587ac2240a39651432b1c369f99', 'request_id': 'req-07455fee-d58e-4b24-a570-c4576613e211'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:03.776671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b0d587ac2240a39651432b1c369f99', 'request_id': 'req-07455fee-d58e-4b24-a570-c4576613e211'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:03.787986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969ac6-42f9-487c-88c7-2a6a1812c901 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:03.825554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] The token cache is being invalidate because project 70b0d587ac2240a39651432b1c369f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:03.826062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:03.827183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:03.833212 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2603/5181] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:03 2022] DELETE /identity/v3/projects/70b0d587ac2240a39651432b1c369f99 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:03.836351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:03.849553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:03.964202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:03.977776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:03.978908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:03.979449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:03.998627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:04.137190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455fee-d58e-4b24-a570-c4576613e211 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:04.152339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:04.153008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:04.153285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:04.153589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] PATH_INFO: `/v3/users/b2ffd8802513453e9660e88a074b7b42` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:04.154902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ffd8802513453e9660e88a074b7b42)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:04.157114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:04.185173 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:04.281726 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:04.287042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ffd8802513453e9660e88a074b7b42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:04.304678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:04.306744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:04.324525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2579/5182] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:04.331209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ffd8802513453e9660e88a074b7b42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:04.352934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ffd8802513453e9660e88a074b7b42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:04.353990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ffd8802513453e9660e88a074b7b42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:04.365672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ffd8802513453e9660e88a074b7b42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:04.434883 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2604/5183] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:03 2022] DELETE /identity/v3/users/b2ffd8802513453e9660e88a074b7b42 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:04.976443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:04.979190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:05.102433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65353af-aab8-4537-b41d-c0e50fe86d5a service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:05.229831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:05.232624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:05.428562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:05.429195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:05.429492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:05.429761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:05.445295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:05.609350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eca61-83e4-42fa-8599-ff459547d0d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:05.643390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:05.644064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:05.644371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:05.644992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] PATH_INFO: `/v3/projects/5d179f20f86f400ba7de719273b92d62` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:05.653471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d179f20f86f400ba7de719273b92d62)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:05.662184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:05.782474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:05.783995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fa89a-f128-494e-8075-352d8d08a269 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:05.826983 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2580/5184] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 850 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:05.982409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d179f20f86f400ba7de719273b92d62', 'request_id': 'req-b09a366f-ce3a-4482-81a1-ee219d6eb02f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:06.025614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d179f20f86f400ba7de719273b92d62', 'request_id': 'req-b09a366f-ce3a-4482-81a1-ee219d6eb02f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:06.052752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d179f20f86f400ba7de719273b92d62', 'request_id': 'req-b09a366f-ce3a-4482-81a1-ee219d6eb02f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:06.094925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] The token cache is being invalidate because project 5d179f20f86f400ba7de719273b92d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:06.095478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:06.097898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b09a366f-ce3a-4482-81a1-ee219d6eb02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:06.112925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:06.113951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:06.114401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:06.122219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2605/5185] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:05 2022] DELETE /identity/v3/projects/5d179f20f86f400ba7de719273b92d62 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:06.170920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:06.172291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:06.242404 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:06.439502 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2581/5186] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:06.447524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:06.447808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:06.448248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:06.519507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:06.521267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:06.549396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:06.554706 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2606/5187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:06.565661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f61ebe-ce7e-4aee-8a79-259300ac5662 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:06.602205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:06.605354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:06.605832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:06.606258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:06.612645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:06.613276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:06.632189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:06.693893 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2582/5188] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:06.698447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:06.713545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f74bf-15cc-4826-a19d-23c45ccc9122 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:06.732543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:06.733183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:06.743504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:06.743908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:06.744618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:06.752680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:06.891886 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2607/5189] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:06 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:06.894787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:06.914592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8b99-1061-4257-974b-eca31569dc58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:06.965915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:06.967827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:07.077057 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:07.231874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:07.246224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.248992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.249287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.249969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:07.251999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:07.351609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e90b2-fa3f-4704-9d07-e46cb7f40815 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:07.362987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2583/5190] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:06 2022] POST /identity/v3/users => generated 284 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:07.367960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:07.394068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa12-a9c9-4a6d-834b-f6b1343da94f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:07.403609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:07.407651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.407975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.408459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.408864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:07.409796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.413024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.413541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.414543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:07.416347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:07.434329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:07.448609 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2584/5191] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:07.452626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:07.477626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda34ae-129c-4253-8754-3ef03a567fb0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:07.509527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:07.510182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.510468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.510742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.511325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:07.511444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:07.512991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:07.523199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83abdd-46b0-4480-b9d7-b5b706251451 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:07.551563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2585/5192] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:07.552466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:07.576489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e821eba-2f11-4d8d-97bb-f5c01e9b994a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:07.588954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2608/5193] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:21:07.591379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:07.592075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.592347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.592621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] PATH_INFO: `/v3/projects/d11c9f8db3c8445499698d99b1e02f11/users/5f6cfcbba30b4737ba6592ff4c107e8e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.624523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11c9f8db3c8445499698d99b1e02f11, user_id=5f6cfcbba30b4737ba6592ff4c107e8e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:07.627883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:07.658936 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2586/5194] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:07 2022] PUT /identity/v3/projects/d11c9f8db3c8445499698d99b1e02f11/users/5f6cfcbba30b4737ba6592ff4c107e8e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:07.675547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:07.675839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:07.676307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:07.804163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] MFA Rules not processed for user `5f6cfcbba30b4737ba6592ff4c107e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:07.805480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:08.168866 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2609/5195] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:08.174561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:08.379880 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:08.408662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b568-5a3f-4cd9-a371-4f38c3eda841 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:08.427604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:08.429364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:08.431585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:08.445437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:08.451615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:08.461445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:08.536283 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2587/5196] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:08 2022] POST /identity/v3/projects => generated 367 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:08.582788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:08.582788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc81eb-b5dd-4447-9812-a0db42ed951e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:08.755548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:08.763801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:08.765027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:08.767343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:08.770507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:08.777195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:08.822076 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2610/5197] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:08 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:08.825961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:08.847764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e5c9c-e8b6-4f93-ab33-62b7ded7b738 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:08.861324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:08.874835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:08.876457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:08.878730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:08.882080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:08.886089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:08.910084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2588/5198] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:08.914115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:08.929278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1e12e-1bd0-4153-b865-53b36e8cd534 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:08.947176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:08.948107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:08.948529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:08.948926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] PATH_INFO: `/v3/projects/be7d93215c7c4dedb40713c8de286f44/users/60c25c387aab413c925e7f9e43426a56/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:08.991619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7d93215c7c4dedb40713c8de286f44, user_id=60c25c387aab413c925e7f9e43426a56, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:08.997936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:09.029920 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2611/5199] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:08 2022] PUT /identity/v3/projects/be7d93215c7c4dedb40713c8de286f44/users/60c25c387aab413c925e7f9e43426a56/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:09.034822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:09.052745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd50b7-8a5b-4083-b5c0-a2fd63a44a74 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:09.320085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:09.320727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:09.321011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:09.321285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:09.321972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:09.329813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7fd9-b693-4b90-9b6e-054b12e75e26 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:09.372923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:09.373353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2589/5200] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:09.390445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac40e1-1d4e-4171-8cc0-46d201429ded admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:09.410170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:09.411183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:09.411630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:09.412063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] PATH_INFO: `/v3/projects/be7d93215c7c4dedb40713c8de286f44/users/60c25c387aab413c925e7f9e43426a56/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:09.417820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7d93215c7c4dedb40713c8de286f44, user_id=60c25c387aab413c925e7f9e43426a56, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:09.420862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:09.425688 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:09.458854 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2612/5201] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:09 2022] PUT /identity/v3/projects/be7d93215c7c4dedb40713c8de286f44/users/60c25c387aab413c925e7f9e43426a56/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:09.469068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:09.469672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:09.469672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:09.541951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:09.541951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:09.542473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] MFA Rules not processed for user `60c25c387aab413c925e7f9e43426a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:09.547212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:09.731631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ddb9-d70d-431e-8f17-f727ea7979ca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:09.755214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:09.755869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:09.756156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:09.756437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:09.758678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:09.760362 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2590/5202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:09.765217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:09.784666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:09.786344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:09.786760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159990c-dfeb-4f5e-9b9d-054b20d22060 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:09.795282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:09.801056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:09.801056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:09.801056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:09.801056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:09.806350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:09.808996 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2613/5203] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:21:09.844188 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2591/5204] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:21:09 2022] POST /identity/v3/domains => generated 277 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:09.848089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:09.871222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442e72-c362-45e9-869a-9401948edb24 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.005435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.006407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.006694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.007029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.007690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.012882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.102446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2614/5205] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:09 2022] POST /identity/v3/users => generated 348 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:10.103578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.119383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1def8-735c-4b87-91af-ddcb026f5200 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.137021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.137705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.138037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.138323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.138980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.145353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.202916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2592/5206] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:10 2022] POST /identity/v3/users => generated 323 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:10.204166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.215887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689f1f-5b08-45d4-a1d3-575f495dc372 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.240900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.241615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.241904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.242185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users/49d845699b724a0492648cc77fb1199b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.275300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:get_user(user_id=49d845699b724a0492648cc77fb1199b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.277828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.284281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2615/5207] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:21:10 2022] GET /identity/v3/users/49d845699b724a0492648cc77fb1199b => generated 348 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:10.286002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.301935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f132-d30e-431b-9ca6-3dbb2ad80a8a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.308323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.310238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.310877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.311382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.312500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Adding query filter params (domain_id=b48df6df6e474c40a8a4fc7983dee6d4) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:10.313147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.315617 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:21:10.315617 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:21:10.315617 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:21:10.318306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.359211 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2593/5208] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 25 01:21:10 2022] GET /identity/v3/users?domain_id=b48df6df6e474c40a8a4fc7983dee6d4 => generated 485 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:10.360886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.375491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391952c-3276-4ac6-8370-5094f3ec4abc tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.391992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.392641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.392931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.393214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.394008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.394972 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:21:10.394972 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:21:10.394972 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:21:10.396389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.502044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.502839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2616/5209] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:10 2022] GET /identity/v3/users => generated 8873 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:10.511181 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:10.515495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ecec-7db6-46c7-8b68-02619635333e tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.530529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.532427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.533501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.533954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.534862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1878738155) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:10.535359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.539906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.616397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2594/5210] 10.222.0.16 () {58 vars in 1189 bytes} [Sun Sep 25 01:21:10 2022] GET /identity/v3/users?name=tempest-test_user-1878738155 => generated 476 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:10.621373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.643987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f6c2-1083-4351-9327-8c6d7f8726de tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.670137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.670775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.671062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.671342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.672066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:10.672515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.685027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:10.777300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2617/5211] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:21:10 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:10.781937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:10.796272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400e93-f8a1-4113-abd8-49b975ecc918 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:10.810820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:10.814193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:10.814794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:10.815272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users/2f17a293cd6f4ff4a6ae380c212a87d9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:10.863928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2f17a293cd6f4ff4a6ae380c212a87d9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:10.868642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:11.003326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f17a293cd6f4ff4a6ae380c212a87d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.004721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f17a293cd6f4ff4a6ae380c212a87d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.031645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f17a293cd6f4ff4a6ae380c212a87d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.066480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f17a293cd6f4ff4a6ae380c212a87d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.067269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f17a293cd6f4ff4a6ae380c212a87d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.098048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2595/5212] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:10 2022] DELETE /identity/v3/users/2f17a293cd6f4ff4a6ae380c212a87d9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:11.103513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:11.114168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:11.155929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10429525-5c77-46b7-b8ae-f549f348250f tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:11.247969 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:11.300891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:11.301757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:11.301950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:11.302126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/users/49d845699b724a0492648cc77fb1199b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:11.303392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49d845699b724a0492648cc77fb1199b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:11.305447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:11.401751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d845699b724a0492648cc77fb1199b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.422798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d845699b724a0492648cc77fb1199b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.446949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d845699b724a0492648cc77fb1199b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.447727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d845699b724a0492648cc77fb1199b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.448358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d845699b724a0492648cc77fb1199b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.476518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2618/5213] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:11 2022] DELETE /identity/v3/users/49d845699b724a0492648cc77fb1199b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:11.477866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:11.490872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d407-a641-4583-ba12-c60b053c7b7a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:11.522570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:11.524047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:11.616973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:11.619548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:11.620098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:11.620590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/domains/b48df6df6e474c40a8a4fc7983dee6d4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:11.622955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b48df6df6e474c40a8a4fc7983dee6d4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:11.626933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:11.660489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad63-a8d5-42e9-9d73-bc24045ae270 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:11.682582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:11.683621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:11.683931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:11.684182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] PATH_INFO: `/v3/users/8c4d799cd1354609a8604a2db0fc12f1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:11.685816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c4d799cd1354609a8604a2db0fc12f1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:11.687430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:11.702026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.705497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.836191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.841817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.845332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2596/5214] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:21:11 2022] PATCH /identity/v3/domains/b48df6df6e474c40a8a4fc7983dee6d4 => generated 278 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:11.850430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:11.852442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:11.854665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c4d799cd1354609a8604a2db0fc12f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.876493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c4d799cd1354609a8604a2db0fc12f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.893694 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:11.929064 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:11.929477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c4d799cd1354609a8604a2db0fc12f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.930316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c4d799cd1354609a8604a2db0fc12f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.931038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c4d799cd1354609a8604a2db0fc12f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:11.981837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2619/5215] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:11 2022] DELETE /identity/v3/users/8c4d799cd1354609a8604a2db0fc12f1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:12.041762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a844c83-4bd1-4869-a30a-bb21d6730374 tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:12.131255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c25c387aab413c925e7f9e43426a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d93215c7c4dedb40713c8de286f44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:12.131938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:12.132313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:12.132838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] PATH_INFO: `/v3/domains/b48df6df6e474c40a8a4fc7983dee6d4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:12.154768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b48df6df6e474c40a8a4fc7983dee6d4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:12.157595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:12.194944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.199307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.272943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.281098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.288315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.315652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] The token cache is being invalidate because project b48df6df6e474c40a8a4fc7983dee6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:12.316008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.316738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.331702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.336932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.337727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b48df6df6e474c40a8a4fc7983dee6d4', 'request_id': 'req-20922f01-1388-4952-9a5c-f0ce3629622a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.340053 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:12.350595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2597/5216] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:21:11 2022] DELETE /identity/v3/domains/b48df6df6e474c40a8a4fc7983dee6d4 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:12.351866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:12.353513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:12.417791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:12.419447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:12.497156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0592-8cd2-4b79-9763-00e4a5366ba5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:12.535908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922f01-1388-4952-9a5c-f0ce3629622a tempest-UsersV3TestJSON-1144013717 tempest-UsersV3TestJSON-1144013717-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:12.544761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:12.545687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:12.546113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:12.546549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] PATH_INFO: `/v3/projects/714fdb4cc705469688b389dab75ce03e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:12.549207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714fdb4cc705469688b389dab75ce03e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:12.552509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:12.592934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:12.593747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:12.594458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:12.594856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] PATH_INFO: `/v3/users/5f6cfcbba30b4737ba6592ff4c107e8e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:12.596254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6cfcbba30b4737ba6592ff4c107e8e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:12.601675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:12.660061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714fdb4cc705469688b389dab75ce03e', 'request_id': 'req-5ed6abdd-fa36-4b87-a300-28615ad98492'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.678391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714fdb4cc705469688b389dab75ce03e', 'request_id': 'req-5ed6abdd-fa36-4b87-a300-28615ad98492'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.706773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6cfcbba30b4737ba6592ff4c107e8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.715316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714fdb4cc705469688b389dab75ce03e', 'request_id': 'req-5ed6abdd-fa36-4b87-a300-28615ad98492'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.723663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6cfcbba30b4737ba6592ff4c107e8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.741679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] The token cache is being invalidate because project 714fdb4cc705469688b389dab75ce03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:12.742947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.744058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.746257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2598/5217] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:12 2022] DELETE /identity/v3/projects/714fdb4cc705469688b389dab75ce03e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:12.747499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:12.749586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:12.804496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6cfcbba30b4737ba6592ff4c107e8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.806292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6cfcbba30b4737ba6592ff4c107e8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.807225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95b3806e-9184-458a-9686-61f4939291e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6cfcbba30b4737ba6592ff4c107e8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:12.835181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2620/5218] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:12 2022] DELETE /identity/v3/users/5f6cfcbba30b4737ba6592ff4c107e8e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:12.836926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5015b-b708-4b18-82f1-e7083b72eee4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:12.838513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5015b-b708-4b18-82f1-e7083b72eee4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:12.839426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5015b-b708-4b18-82f1-e7083b72eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:12.858462 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:12.870676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b0d5015b-b708-4b18-82f1-e7083b72eee4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:12.872959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b0d5015b-b708-4b18-82f1-e7083b72eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:12.907275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6abdd-fa36-4b87-a300-28615ad98492 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:12.995952 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2621/5219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:12.998222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.003081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.006353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.014595 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:13.019217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.020136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.021040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.021852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.026469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.039402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.042919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0bc17-9a4b-4e8d-b6e7-4aba4239f132 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.057452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:13.059720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.077126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2599/5220] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:13.079989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.080295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.080578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.089992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2622/5221] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:13.091261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.092794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.105113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:13.106928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.114587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e1ad2-9dbb-4428-b2c3-b2d31442dd25 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.119774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2600/5222] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:13.120995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.124534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.124534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.124534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.124823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.140530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.143235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.148427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ab9bd-a791-4739-84bd-9eba7d4dc06c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.154711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.155343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.155676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.156184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2623/5223] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:13.161587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.162519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:13.162908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.165397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.204233 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2601/5224] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:13.205979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.225993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642649-7bfb-48ef-bdc4-fdabd2f246d0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.236953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.237663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.237953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.238227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.238929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.241170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.283646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2624/5225] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:13 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:13.285238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.299029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5f45-b211-45d7-80fe-96ea082eb9cf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.458639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.459714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.460008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.460709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.461011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.462983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.510038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2602/5226] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:13 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:13.511311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.537358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce033b-457a-447a-9b8c-17b73900bcb7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.556489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.557298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.558934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.559879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.561645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.571778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.618484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2625/5227] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:13.619711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.645385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.655403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.664845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e8b0-7afc-4514-9d1e-d7d070814291 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.687343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.690017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.690379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.694269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.698063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.702325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.737190 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2603/5228] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:13.737190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.742291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.805532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c7133-d9d5-4b61-aac3-5c39c132ce36 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.824154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.825984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.826282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.826571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] PATH_INFO: `/v3/projects/d11c9f8db3c8445499698d99b1e02f11` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.832211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11c9f8db3c8445499698d99b1e02f11)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.837625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.871697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5376e9-3570-479b-a21a-e46e12fcb037 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:13.914643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:13.915596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:13.916164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:13.917202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:13.923254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:13.939800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:13.940603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11c9f8db3c8445499698d99b1e02f11', 'request_id': 'req-212c43a2-0fd4-4009-b9e5-bc9c18584713'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:13.941543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:13.949165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11c9f8db3c8445499698d99b1e02f11', 'request_id': 'req-212c43a2-0fd4-4009-b9e5-bc9c18584713'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:13.957545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11c9f8db3c8445499698d99b1e02f11', 'request_id': 'req-212c43a2-0fd4-4009-b9e5-bc9c18584713'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:13.969898 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2626/5229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:13.972240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:13.988402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] The token cache is being invalidate because project d11c9f8db3c8445499698d99b1e02f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:13.988402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:13.993793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:13.996068 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2604/5230] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:13 2022] DELETE /identity/v3/projects/d11c9f8db3c8445499698d99b1e02f11 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:14.000520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:14.004016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.005856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a401a-9d6d-4441-b2f3-b47c7b4aaf4b service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:14.084836 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:14.095576 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:14.158164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:14.158870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.159244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.159548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] PATH_INFO: `/v3/projects/cc36a1f6ad32416e93ab335e5dcef9a6/users/d37e243ab8cf43ffae620d23215d496b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.193283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc36a1f6ad32416e93ab335e5dcef9a6, user_id=d37e243ab8cf43ffae620d23215d496b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:14.195928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2b5d3-40c9-423d-b29e-8eb63bd27ef5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:14.202549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c43a2-0fd4-4009-b9e5-bc9c18584713 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:14.214598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:14.215336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.215623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.215913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] PATH_INFO: `/v3/users/60c25c387aab413c925e7f9e43426a56` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.221073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c25c387aab413c925e7f9e43426a56)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:14.223195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:14.224785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2627/5231] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:13 2022] PUT /identity/v3/projects/cc36a1f6ad32416e93ab335e5dcef9a6/users/d37e243ab8cf43ffae620d23215d496b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:14.226111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.226416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.226676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.292861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:14.297999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.325206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c25c387aab413c925e7f9e43426a56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.325960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c25c387aab413c925e7f9e43426a56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.345800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c25c387aab413c925e7f9e43426a56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.370080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c25c387aab413c925e7f9e43426a56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.370419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-01f1e8e8-acb5-4728-b9ee-ecc7f42c995f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c25c387aab413c925e7f9e43426a56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.417476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2605/5232] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:13 2022] DELETE /identity/v3/users/60c25c387aab413c925e7f9e43426a56 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:14.419078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da723-ffb5-4083-8d11-7f23bff73fe4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.419373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da723-ffb5-4083-8d11-7f23bff73fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.419655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da723-ffb5-4083-8d11-7f23bff73fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.423255 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2628/5233] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:14.424162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:14.426189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.515708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-070da723-ffb5-4083-8d11-7f23bff73fe4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:14.521766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-070da723-ffb5-4083-8d11-7f23bff73fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.521984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98e61-d84a-4061-b5f3-b167639f689d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:14.701973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:14.704662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.704814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.705023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] PATH_INFO: `/v3/users/749e75692e7f4a04b9e54f0fa131e337` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.708991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] RBAC: Authorizing `identity:delete_user(user_id=749e75692e7f4a04b9e54f0fa131e337)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:14.714526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:14.738653 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2606/5234] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:14.740191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:14.740581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:14.741074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:14.746783 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:14.774822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:14.776180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.855048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749e75692e7f4a04b9e54f0fa131e337'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.857676 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:14.877100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749e75692e7f4a04b9e54f0fa131e337'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.899134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749e75692e7f4a04b9e54f0fa131e337'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.914479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749e75692e7f4a04b9e54f0fa131e337'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.916845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749e75692e7f4a04b9e54f0fa131e337'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:14.931807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2607/5235] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:14.936038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:14.948604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:14.973570 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2629/5236] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:14 2022] DELETE /identity/v3/users/749e75692e7f4a04b9e54f0fa131e337 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:14.976279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:14.978277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.162514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd78d-400f-4c76-8a92-7e50e3996e0a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:15.244480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:15.246486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.246983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.247449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.250777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.267204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c81eb-4d77-4bb6-84bb-7aac519b323b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:15.285939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:15.291118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.292383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.293016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.298505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.346404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:15.348785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:15.392055 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2608/5237] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:15.399137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:15.470091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:15.483355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b68e-f6c3-4921-ac2f-22b4ee4ee412 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:15.487925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c9a0-198b-4c3e-809f-cd0d3724166a service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:15.512192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:15.513906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.517905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.518197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.521844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2630/5238] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:15.523484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.524436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.524953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.552431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:15.555665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:15.571964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:15.575828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.585329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2609/5239] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:15.588822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:15.592929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.599035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2631/5240] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:15.600668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:15.637397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1ffb0-61dd-41d4-bf36-2bdc93c0a789 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:15.638071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153b87-0f15-4e2c-8e4d-91fd41a59f05 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:15.654981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:15.657827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.662317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.662317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] PATH_INFO: `/v3/projects/be7d93215c7c4dedb40713c8de286f44` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.664848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:15.666555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7d93215c7c4dedb40713c8de286f44)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:15.666796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:15.667193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:15.668682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:15.670689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:15.674738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.817072 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:15.858364 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:15.903656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7d93215c7c4dedb40713c8de286f44', 'request_id': 'req-71199a48-6a00-4c0c-9256-d8aa6af842f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:15.926432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7d93215c7c4dedb40713c8de286f44', 'request_id': 'req-71199a48-6a00-4c0c-9256-d8aa6af842f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:15.955327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7d93215c7c4dedb40713c8de286f44', 'request_id': 'req-71199a48-6a00-4c0c-9256-d8aa6af842f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:15.965358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:15.968016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:15.984427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] The token cache is being invalidate because project be7d93215c7c4dedb40713c8de286f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:15.984522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:15.986622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2632/5241] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:15.987699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:15.989454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:15.990559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-71199a48-6a00-4c0c-9256-d8aa6af842f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:15.994537 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2610/5242] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:15 2022] DELETE /identity/v3/projects/be7d93215c7c4dedb40713c8de286f44 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:16.000876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc28f3-9b40-4e9b-98eb-c54650044b59 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.001170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc28f3-9b40-4e9b-98eb-c54650044b59 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.001436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc28f3-9b40-4e9b-98eb-c54650044b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.017894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5814-3763-4bcf-b572-eb82fdd543c1 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.061240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-43cc28f3-9b40-4e9b-98eb-c54650044b59 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:16.063266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-43cc28f3-9b40-4e9b-98eb-c54650044b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:16.166557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.172539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.174048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.175469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.185446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:16.253601 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2611/5243] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:16.261001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.261366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.261726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.304100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:16.306629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:16.327802 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2612/5244] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:16.331833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:16.358776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc454af3-c035-45c4-b2b1-2f7dc4eb497f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.367154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.368629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:16.379170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.380069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.381689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.383531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.384893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:16.391978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.397748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:16.404127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2633/5245] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:16.440236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2613/5246] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:16.445689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:16.464303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a91808-90e2-401c-839a-0af82563cc7b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.479804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.481341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.482111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.483683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.485163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.491637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:16.572178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2634/5247] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:16 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:16.576271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:16.596679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24ece-7d25-4c5e-bf0f-a93d06a470e0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.743763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.744407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.744894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.745097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.745846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.766700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:16.833807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2614/5248] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:16 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:16.836791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:16.880249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9e98-548d-45d9-bc8a-e51f1c6f73cc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.885826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.886827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.887176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.887480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.889354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.891707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:16.920856 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2635/5249] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:16.922883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:16.941642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaeb23-8966-4146-ae27-983fb4e477bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:16.959130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:16.960518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:16.960899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:16.961317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:16.964086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:16.974063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ac072-a6ce-4d6b-bbca-26c1a51fee53 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:17.010860 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2615/5250] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:17.012397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:17.035395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551c48-2b13-4c6e-896d-eeccfd6080d3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.035702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551c48-2b13-4c6e-896d-eeccfd6080d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.036102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551c48-2b13-4c6e-896d-eeccfd6080d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.041596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f873d8-7e4d-416b-90b3-a527c16d4848 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:17.070713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:17.072811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.078826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.079593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] PATH_INFO: `/v3/projects/bc6b36b8c83146ed92255fab78c48222/users/d124460fde2f4b9d89b8b66544cfc4ed/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.099961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-80551c48-2b13-4c6e-896d-eeccfd6080d3 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:17.101331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-80551c48-2b13-4c6e-896d-eeccfd6080d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.119518 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:17.161800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6b36b8c83146ed92255fab78c48222, user_id=d124460fde2f4b9d89b8b66544cfc4ed, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:17.164658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:17.207850 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2636/5251] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:17 2022] PUT /identity/v3/projects/bc6b36b8c83146ed92255fab78c48222/users/d124460fde2f4b9d89b8b66544cfc4ed/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:17.208091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:17.220638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.279076 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2616/5252] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:17.280912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.281216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.283109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.316380 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:17.354668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] MFA Rules not processed for user `d124460fde2f4b9d89b8b66544cfc4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:17.358299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.382829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824888-9846-4068-ac39-8fe650b4b173 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:17.400451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:17.401121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.401452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.401725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] PATH_INFO: `/v3/projects/cb98775f30874f7e809e9d0f3565fc57` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.406320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb98775f30874f7e809e9d0f3565fc57)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:17.409033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:17.496913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2617/5253] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:17.497813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:17.502009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.601511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb98775f30874f7e809e9d0f3565fc57', 'request_id': 'req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:17.616459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb98775f30874f7e809e9d0f3565fc57', 'request_id': 'req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:17.643167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb98775f30874f7e809e9d0f3565fc57', 'request_id': 'req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:17.671281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] The token cache is being invalidate because project cb98775f30874f7e809e9d0f3565fc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:17.671635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:17.673448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:17.675319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2637/5254] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:17 2022] DELETE /identity/v3/projects/cb98775f30874f7e809e9d0f3565fc57 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:17.676151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:17.682983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.722799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817830dd-94e3-432c-afc4-fc468cde7553 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:17.818520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e245fd-6a68-4f40-b899-17ceb5f7dfd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:17.826397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:17.827064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.827351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.827624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.828346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:create_application_credential(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:17.830036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:17.860848 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:17.908287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:17.909296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:17.909872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:17.910414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:17.912587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:17.997395 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:18.042723 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2638/5255] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:21:17 2022] POST /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials => generated 921 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:18.043737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.051784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:18.135437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.137685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.163968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2618/5256] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:18.165096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.202509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748d9b8-8929-4568-9f80-65921bf66ba2 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.225134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.225834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.226116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.226389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/406623c99388416aa1893129eec4974c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.230093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d124460fde2f4b9d89b8b66544cfc4ed, access_rule_id=406623c99388416aa1893129eec4974c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.232099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.247262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49949b-59ad-4357-ab1b-cb35b4ca418d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.253054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.254111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.254639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.255126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] PATH_INFO: `/v3/users/e04b489b6c81455da3d3ffea9decd1b5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.256617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04b489b6c81455da3d3ffea9decd1b5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.259272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.delete(ref) Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application yield resource Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:21:18.312839 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise self.value Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.commit() Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.flush() Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:21:18.314678 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application compat.raise_( Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._synchronize( Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise AssertionError( Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Sep 25 01:21:18.315642 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:18.316518 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 25 01:21:18.317456 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:21:18.318542 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2619/5257] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 25 01:21:18 2022] DELETE /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/406623c99388416aa1893129eec4974c => generated 89 bytes in 153 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:21:18.319632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.354332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b017c9-0705-4d9b-9e8d-9a926e3a5269 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.371629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.374189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04b489b6c81455da3d3ffea9decd1b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:18.375882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.377846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.379696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials/a9c0370a41804d4eb7152ef52b423163` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.429442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04b489b6c81455da3d3ffea9decd1b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:18.467145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04b489b6c81455da3d3ffea9decd1b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:18.468248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04b489b6c81455da3d3ffea9decd1b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:18.470950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d124460fde2f4b9d89b8b66544cfc4ed, application_credential_id=a9c0370a41804d4eb7152ef52b423163)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.472503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.474917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04b489b6c81455da3d3ffea9decd1b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:18.504623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2639/5258] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:18 2022] DELETE /identity/v3/users/e04b489b6c81455da3d3ffea9decd1b5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:18.543963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2620/5259] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:21:18 2022] DELETE /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials/a9c0370a41804d4eb7152ef52b423163 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:18.545304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.547028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:18.699668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365239-3b94-4aad-97a3-cfbc3fa18978 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.712982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.713725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.714017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.714298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.717780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:list_access_rules(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.723981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.744902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.755605 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2640/5260] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:21:18 2022] GET /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules => generated 369 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:18.762351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea915f-d81c-4015-8a63-dd810e9981ba tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.776863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.778278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.779458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.779748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/406623c99388416aa1893129eec4974c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.788858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d124460fde2f4b9d89b8b66544cfc4ed, access_rule_id=406623c99388416aa1893129eec4974c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.795647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.855870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2621/5261] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 25 01:21:18 2022] DELETE /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/406623c99388416aa1893129eec4974c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:18.860730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.884058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742a8f-98ba-4c66-a422-d2d56d60a56a tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.908265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.908980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.909282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.909598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.917254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:list_access_rules(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.923415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:18.949523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2641/5262] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:21:18 2022] GET /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules => generated 158 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:18.958667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:18.975608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fb46-5c28-4642-acf4-24eef921224d tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:18.980503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:18.981439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:18.982039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:18.982522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:18.983465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:create_application_credential(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:18.986995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.196633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2622/5263] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:21:18 2022] POST /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials => generated 921 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:19.200880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:19.216442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5242-59aa-4864-acfe-a8d479ca5a35 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:19.241933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:19.248022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:19.248408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:19.252042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:19.257079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:list_access_rules(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:19.263424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.271678 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:19.298374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2642/5264] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:21:19 2022] GET /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules => generated 369 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:19.300194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:19.319142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990b57-9635-4ea6-abe6-ca52baf7a579 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:19.339761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:19.340511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:19.340915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:19.341203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:19.347151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:create_application_credential(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:19.351677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.373191 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:19.524115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2623/5265] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:21:19 2022] POST /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/application_credentials => generated 920 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:21:19.528238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:19.553941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd57e8f-05bc-4e06-8f54-1aaa63499a13 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:19.560472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd124460fde2f4b9d89b8b66544cfc4ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc6b36b8c83146ed92255fab78c48222', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:19.561220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:19.561609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:19.562038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/14a7a20305904194942db42886a65ceb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:19.569064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorizing `identity:get_access_rule(user_id=d124460fde2f4b9d89b8b66544cfc4ed, access_rule_id=14a7a20305904194942db42886a65ceb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:19.570748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.589207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2643/5266] 10.222.0.16 () {58 vars in 1359 bytes} [Sun Sep 25 01:21:19 2022] GET /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed/access_rules/14a7a20305904194942db42886a65ceb => generated 229 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:19.590136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:19.592420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:19.788834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:19.791159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:19.796765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e1db-41fe-4ad2-8ffd-e6179bd45859 tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:19.815340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:19.817189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ab2db-b60d-4e06-bc2f-7dddb4eee9ff tempest-AccessRulesV3Test-412106873 tempest-AccessRulesV3Test-412106873-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:19.817790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:19.818292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:19.818818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] PATH_INFO: `/v3/users/d124460fde2f4b9d89b8b66544cfc4ed` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:19.821681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d124460fde2f4b9d89b8b66544cfc4ed)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:19.824650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.830897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:19.831315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:19.831548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:19.831731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] PATH_INFO: `/v3/projects/c95bc2327c62463c9ff7d84fad929d2d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:19.833129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95bc2327c62463c9ff7d84fad929d2d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:19.835756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:19.928715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd124460fde2f4b9d89b8b66544cfc4ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:19.930348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd124460fde2f4b9d89b8b66544cfc4ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:19.947238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd124460fde2f4b9d89b8b66544cfc4ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:19.957412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95bc2327c62463c9ff7d84fad929d2d', 'request_id': 'req-11e65599-a5dc-4b45-8a61-8b472bc20549'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:19.969989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95bc2327c62463c9ff7d84fad929d2d', 'request_id': 'req-11e65599-a5dc-4b45-8a61-8b472bc20549'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:19.996726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95bc2327c62463c9ff7d84fad929d2d', 'request_id': 'req-11e65599-a5dc-4b45-8a61-8b472bc20549'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:20.028632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] The token cache is being invalidate because project c95bc2327c62463c9ff7d84fad929d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:20.028989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:20.031196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e65599-a5dc-4b45-8a61-8b472bc20549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:20.034449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd124460fde2f4b9d89b8b66544cfc4ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:20.035249 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2644/5267] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:19 2022] DELETE /identity/v3/projects/c95bc2327c62463c9ff7d84fad929d2d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:20.035672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-358d8137-17ea-404e-838f-d96f202ec99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd124460fde2f4b9d89b8b66544cfc4ed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:20.037841 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:20.040110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada011c-8cfd-45a6-8b54-92930f438fa8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.040511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada011c-8cfd-45a6-8b54-92930f438fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.040809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada011c-8cfd-45a6-8b54-92930f438fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.077015 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2624/5268] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:19 2022] DELETE /identity/v3/users/d124460fde2f4b9d89b8b66544cfc4ed => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:20.085829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.086174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.086476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.113474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7ada011c-8cfd-45a6-8b54-92930f438fa8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:20.119407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ada011c-8cfd-45a6-8b54-92930f438fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:20.146681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:20.148063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:20.301308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2645/5269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:20.310506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.310804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.311086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.370166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:20.378271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:20.388289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2625/5270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:20.401524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:20.414967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2646/5271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:20.419374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:20.423599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:20.456130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08ba2-a85c-4255-bf95-92de562cba75 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:20.482362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:20.483442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.483442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.483735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.484451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:20.485302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:20.486978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:20.532916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2647/5272] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:20.537223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:20.576159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848e51-5a7b-4e5e-b3b0-878f91c6320e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:20.593751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5b01-3d8e-4b89-ac2b-357d07a3b96b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:20.597714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:20.598394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.598684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.598960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.599617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:20.600055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:20.601631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.601755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:20.603503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.604018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.623303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:20.625146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:20.640946 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2626/5273] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:21:20.699451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2648/5274] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:20 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:20.700987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:20.718151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcacbe0-a308-4bd1-9137-23e7077f7f8c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:20.950226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:20.950866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:20.951154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:20.951433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:20.952077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:20.957785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.027203 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2627/5275] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:20 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:21.031172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.047576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc06c2-1bb1-4dbd-b88e-4b9ce6591af9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:21.071876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:21.072793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.073237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.073735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.076104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:21.082133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.120931 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2649/5276] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:21.124947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.144955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b13c-b901-44a8-92cf-9d6a4e2b29cc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:21.176510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:21.177433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.177690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.178146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.179121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:21.180867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff0ef0-ef4a-4a41-a060-30b73b96bf21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.205595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2628/5277] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:21.211293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.224227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e688-4894-4477-964d-7253ce36f4fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:21.237254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:21.238263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.238825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.239306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] PATH_INFO: `/v3/projects/1e2e18bdde764c9d854ee73ea37642f0/users/e2f3d749ca2c40a7b62055ab85415fa5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.275813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2e18bdde764c9d854ee73ea37642f0, user_id=e2f3d749ca2c40a7b62055ab85415fa5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:21.278873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.295645 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:21.320290 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2650/5278] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:21 2022] PUT /identity/v3/projects/1e2e18bdde764c9d854ee73ea37642f0/users/e2f3d749ca2c40a7b62055ab85415fa5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:21.322454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.323095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.323609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.382283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.384983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:21.420921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] MFA Rules not processed for user `e2f3d749ca2c40a7b62055ab85415fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:21.429004 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:21.442681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:21.560492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556425d-c303-40bc-a121-aa80fcebe90c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:21.611688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:21.614142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.614746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.617900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] PATH_INFO: `/v3/projects/bc6b36b8c83146ed92255fab78c48222` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.624918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6b36b8c83146ed92255fab78c48222)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:21.628691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.690413 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2629/5279] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:21.696135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.758448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce0f5b-ddc6-4d70-903f-26272683ffa2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:21.773974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:21.774722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.775106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.775503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.776806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:21.781171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:21.802857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6b36b8c83146ed92255fab78c48222', 'request_id': 'req-6762db90-0edb-4e18-b07d-6187391dd06e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:21.828870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6b36b8c83146ed92255fab78c48222', 'request_id': 'req-6762db90-0edb-4e18-b07d-6187391dd06e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:21.842472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6b36b8c83146ed92255fab78c48222', 'request_id': 'req-6762db90-0edb-4e18-b07d-6187391dd06e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:21.862998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2630/5280] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:21 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:21.868203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:21.880997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] The token cache is being invalidate because project bc6b36b8c83146ed92255fab78c48222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:21.882398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:21.884559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6762db90-0edb-4e18-b07d-6187391dd06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:21.893359 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2651/5281] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:21 2022] DELETE /identity/v3/projects/bc6b36b8c83146ed92255fab78c48222 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:21.895024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe64f-9597-485c-9789-ea26cf9fd699 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:21.895955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe64f-9597-485c-9789-ea26cf9fd699 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:21.898964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe64f-9597-485c-9789-ea26cf9fd699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:21.945825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e18fe64f-9597-485c-9789-ea26cf9fd699 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:21.947228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e18fe64f-9597-485c-9789-ea26cf9fd699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:22.068129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a39bc-03be-42ca-8b45-af20a13edda7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.074827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:22.084107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.084626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.085119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.087722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:22.090470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:22.139134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2631/5282] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:21 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:22.148874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.151110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:22.170262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2518a4-8b48-4365-bf77-b76e64ac9e6c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.183714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:22.184350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.184633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.185113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.186582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:22.194195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:22.208115 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2652/5283] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:22.216839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.217156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.217418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.224939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2632/5284] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:22.230388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.263048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636348cf-58df-4edf-aeae-f66283b806c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.308825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:22.310073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:22.320650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:22.321353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.321665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.321976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] PATH_INFO: `/v3/projects/63a34262f96b4ff299078dfe048be70e/users/c9876cd97c634d3c97e555df0d1da149/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.368110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2653/5285] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:22.374479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.399990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a34262f96b4ff299078dfe048be70e, user_id=c9876cd97c634d3c97e555df0d1da149, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:22.402850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:22.421043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5479b-a897-40ac-a745-1ea6f66bded3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.452880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:22.462361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.462666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.462951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.467374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2633/5286] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:22 2022] PUT /identity/v3/projects/63a34262f96b4ff299078dfe048be70e/users/c9876cd97c634d3c97e555df0d1da149/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:22.474013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.481976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:22.482307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:22.496209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:22.555837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2654/5287] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:22.564451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.621576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b246858-2ee8-4088-a77c-17862b668aeb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.735945 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:22.752410 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:22.854782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee18901-e95b-4c36-983b-dc60911e0c17 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:22.876408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:22.877099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:22.877446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:22.877730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:22.878390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:22.880072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:22.962132 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2634/5288] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:22.967191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:22.998219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb36933-2e53-4fcc-804d-4b55e7d14081 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.007988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.008686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.008959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.009271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] PATH_INFO: `/v3/projects/63a34262f96b4ff299078dfe048be70e/users/c9876cd97c634d3c97e555df0d1da149/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.014753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a34262f96b4ff299078dfe048be70e, user_id=c9876cd97c634d3c97e555df0d1da149, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.019848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.019848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.019848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.019848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.020545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.023040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f7fb7-e244-471a-bb24-cae7aebd03ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.028668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.044544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2635/5289] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:22 2022] PUT /identity/v3/projects/63a34262f96b4ff299078dfe048be70e/users/c9876cd97c634d3c97e555df0d1da149/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:23.055652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.056094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.056269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.121129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] MFA Rules not processed for user `c9876cd97c634d3c97e555df0d1da149`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:23.122445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:23.216961 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2655/5290] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:23.221886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:23.291758 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2636/5291] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:23.306263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:23.308803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:23.500771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89806d-8ec6-44f1-a658-c5d6c5f80519 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.520556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.521488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.521779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.522058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.522700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.529838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.580184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2656/5292] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:23 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:23.583412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:23.606229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2026b4-f417-416c-a599-42d5ec559572 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.616688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f680-ed22-4f44-b5a2-bbc3a0c581df admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.647240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.647240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.647240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.647240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.648245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.648856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.685518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2657/5293] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:23.690444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:23.725099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234395b2-5b58-4cc4-90eb-271549c4833c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.748233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.748874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.749159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.750123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.750123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.751970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.776397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2658/5294] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:23.777440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:23.797986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaef86-96e1-402e-ac83-cece3b7a6cd9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:23.804323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.805302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.805302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.805511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.810128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:23.810785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.811070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.811344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] PATH_INFO: `/v3/projects/2d32b1efb142406aaeda39651300d3e3/users/f2058037e53246f790f73163ca731063/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.824099 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:23.855068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d32b1efb142406aaeda39651300d3e3, user_id=f2058037e53246f790f73163ca731063, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.857803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43e6b5-adc8-41e1-9b0b-e3ec6b33894b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.882631 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2659/5295] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:23 2022] PUT /identity/v3/projects/2d32b1efb142406aaeda39651300d3e3/users/f2058037e53246f790f73163ca731063/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:23.898084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbbf3f-250f-4048-bb67-beb17e24ee18 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:23.898429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbbf3f-250f-4048-bb67-beb17e24ee18 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:23.898667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbbf3f-250f-4048-bb67-beb17e24ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:23.937046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:23.939039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:23.962465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-afbbbf3f-250f-4048-bb67-beb17e24ee18 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:23.965097 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2637/5296] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:23.966277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afbbbf3f-250f-4048-bb67-beb17e24ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:24.033049 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:24.203307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:24.206776 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2660/5297] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:24.354602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ef87-99b3-4913-af5f-d5b8e92a0ff5 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:24.361279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353800-2102-4eef-ac18-9078b8fac4b5 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:24.362011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353800-2102-4eef-ac18-9078b8fac4b5 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:24.362297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353800-2102-4eef-ac18-9078b8fac4b5 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:24.362573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353800-2102-4eef-ac18-9078b8fac4b5 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:24.453164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8e353800-2102-4eef-ac18-9078b8fac4b5 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:24.480260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2638/5298] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:24 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:25.483174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:25.483637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:25.483741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:25.529760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:25.533350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:25.543849 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2661/5299] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:25 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:25.551109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:25.551568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:25.551781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:25.617189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:25.618749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:25.647904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:25.667965 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2639/5300] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:25.678867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9375-f95f-4e78-96e3-65c14960c8af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:25.683438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:25.684293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:25.684713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:25.685137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:21:25.800291 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 25 01:21:25.801295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:21:25.806479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:25.810841 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2662/5301] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:25 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 188 bytes in 163 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:21:25.828040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abc41d-97ae-4ad1-bf1c-8564183e9830 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:25.847365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a613c-044f-4b99-960a-5138898a699d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:25.848030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a613c-044f-4b99-960a-5138898a699d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:25.848311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a613c-044f-4b99-960a-5138898a699d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:25.848586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a613c-044f-4b99-960a-5138898a699d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-090a613c-044f-4b99-960a-5138898a699d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:21:25.941814 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 25 01:21:25.942585 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:21:25.944116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2640/5302] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:25 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 188 bytes in 137 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:21:25.948879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:25.966623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faec48-ba86-4334-a121-c821a7c6a00a tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:25.989478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:25.990307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:25.990631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:25.990863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:26.077700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:26.095715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2663/5303] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:25 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:27.099420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73224cc-1991-423a-bea3-abca5d78a389 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.099917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73224cc-1991-423a-bea3-abca5d78a389 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.099917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73224cc-1991-423a-bea3-abca5d78a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.138764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:27.155732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f73224cc-1991-423a-bea3-abca5d78a389 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:27.166915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f73224cc-1991-423a-bea3-abca5d78a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:27.182183 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2641/5304] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:27 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:27.186095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.186569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.186999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.232921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274d39-f991-4570-aa70-49ef7d4603ce tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:27.238406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:27.239097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.239326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.239604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] PATH_INFO: `/v3/users/e2f3d749ca2c40a7b62055ab85415fa5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.240316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:27.240813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f3d749ca2c40a7b62055ab85415fa5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:27.243878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:27.244248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:27.273650 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2642/5305] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:27.275242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:27.300994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372541-6ef9-47a7-b0df-54a793e090da None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:27.319156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a6e5-32d7-4770-ba8a-07b2a1240f87 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:27.320513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6e5-32d7-4770-ba8a-07b2a1240f87 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.321035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6e5-32d7-4770-ba8a-07b2a1240f87 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.321566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6e5-32d7-4770-ba8a-07b2a1240f87 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.360374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f3d749ca2c40a7b62055ab85415fa5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.386471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f3d749ca2c40a7b62055ab85415fa5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.412893 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:27.427085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f3d749ca2c40a7b62055ab85415fa5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.429596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f3d749ca2c40a7b62055ab85415fa5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.432626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f3d749ca2c40a7b62055ab85415fa5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.452073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80c8a6e5-32d7-4770-ba8a-07b2a1240f87 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:27.473702 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2643/5306] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:27 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:27.484879 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2664/5307] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:27 2022] DELETE /identity/v3/users/e2f3d749ca2c40a7b62055ab85415fa5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:27.486902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf277d1-414b-458a-8b2f-44737f8efbf9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.487376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf277d1-414b-458a-8b2f-44737f8efbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.487809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf277d1-414b-458a-8b2f-44737f8efbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.515191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ecf277d1-414b-458a-8b2f-44737f8efbf9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:27.517749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ecf277d1-414b-458a-8b2f-44737f8efbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:27.532560 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:27.662335 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2644/5308] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:27.675493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:27.677133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:27.762728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8d7cb-49af-4a8b-ae74-3ebb225d24b1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:27.769346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:27.770241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:27.770957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:27.771247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:27.783242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:27.788580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e895-847c-459f-a68c-7ee64ed3b20b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:27.800088 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2665/5309] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:28.289227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68486826-6e7b-4392-afc5-b14d00a2645c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.290035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68486826-6e7b-4392-afc5-b14d00a2645c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.290035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68486826-6e7b-4392-afc5-b14d00a2645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.436695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68486826-6e7b-4392-afc5-b14d00a2645c None None] MFA Rules not processed for user `d37e243ab8cf43ffae620d23215d496b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:28.439431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68486826-6e7b-4392-afc5-b14d00a2645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:28.480531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578321f9-22ac-4f94-b4e3-14798aec17d5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.481454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578321f9-22ac-4f94-b4e3-14798aec17d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.481881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578321f9-22ac-4f94-b4e3-14798aec17d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.647750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-578321f9-22ac-4f94-b4e3-14798aec17d5 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:28.648651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-578321f9-22ac-4f94-b4e3-14798aec17d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:28.652721 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2666/5310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:28 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 01:21:28.657869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.658151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.658414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.684983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:28.686219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:28.801050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2645/5311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:28.804739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.804739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.804739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.863704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] MFA Rules not processed for user `d37e243ab8cf43ffae620d23215d496b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:28.871859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:28.876164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2667/5312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:28.877467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:28.880653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:28.897493 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2646/5313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:28.898119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:28.936834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89a1d-5747-4fbe-bee5-6aa7a911526f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:28.942199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1864c1-26e0-408a-af02-45b1806dc49b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:28.958650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:28.959237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:28.959894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.960166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.960440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] PATH_INFO: `/v3/projects/1e2e18bdde764c9d854ee73ea37642f0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.961486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:28.961768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:28.962035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:28.966442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2e18bdde764c9d854ee73ea37642f0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:28.968402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:29.046621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.076382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2647/5314] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:28 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:29.117645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2e18bdde764c9d854ee73ea37642f0', 'request_id': 'req-281bb275-6186-445a-b3f7-0870c92e0c05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.137271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2e18bdde764c9d854ee73ea37642f0', 'request_id': 'req-281bb275-6186-445a-b3f7-0870c92e0c05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.156724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2e18bdde764c9d854ee73ea37642f0', 'request_id': 'req-281bb275-6186-445a-b3f7-0870c92e0c05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.176378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] The token cache is being invalidate because project 1e2e18bdde764c9d854ee73ea37642f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:29.176721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.177561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-281bb275-6186-445a-b3f7-0870c92e0c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.180986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2668/5315] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:28 2022] DELETE /identity/v3/projects/1e2e18bdde764c9d854ee73ea37642f0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:29.185628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:29.188554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:29.222389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6532-04c3-4f15-9ea6-37e2bce69862 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:29.412614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:29.413359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:29.413617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:29.413858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] PATH_INFO: `/v3/users/c9876cd97c634d3c97e555df0d1da149` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:29.415046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9876cd97c634d3c97e555df0d1da149)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:29.417148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:29.430420 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:29.704829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9876cd97c634d3c97e555df0d1da149'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.705872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9876cd97c634d3c97e555df0d1da149'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.716045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9876cd97c634d3c97e555df0d1da149'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.730891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9876cd97c634d3c97e555df0d1da149'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.731969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-768e6ec6-5d54-4d9a-8bd0-d75dc6b0fdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9876cd97c634d3c97e555df0d1da149'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:29.749846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2648/5316] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:29 2022] DELETE /identity/v3/users/c9876cd97c634d3c97e555df0d1da149 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:30.082183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:30.082827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:30.082827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:30.129853 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:30.166222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:30.167693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:30.183835 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2669/5317] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:30 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:30.189106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:30.189413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:30.189690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:30.257632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:30.258880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:30.449766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2649/5318] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:30.450962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:30.468703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e4d4-90b5-4c2a-a238-501ab885748b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:30.488053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeeac2-bdce-4f4a-a186-11d27868d15d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:30.488766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeeac2-bdce-4f4a-a186-11d27868d15d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:30.489053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeeac2-bdce-4f4a-a186-11d27868d15d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:30.489332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeeac2-bdce-4f4a-a186-11d27868d15d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:30.634482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:30.636062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:30.667988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0afeeac2-bdce-4f4a-a186-11d27868d15d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:30.695783 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2670/5319] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:30 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:30.860995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703dd9-3d90-4edd-915a-5d062e92ad45 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:30.871194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:30.873439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:30.874184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:30.876893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] PATH_INFO: `/v3/projects/63a34262f96b4ff299078dfe048be70e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:30.881254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a34262f96b4ff299078dfe048be70e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:30.883309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:30.980726 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:31.015276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a34262f96b4ff299078dfe048be70e', 'request_id': 'req-108ae144-b821-4005-b9b4-9753e69b9898'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:31.051000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a34262f96b4ff299078dfe048be70e', 'request_id': 'req-108ae144-b821-4005-b9b4-9753e69b9898'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:31.094422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a34262f96b4ff299078dfe048be70e', 'request_id': 'req-108ae144-b821-4005-b9b4-9753e69b9898'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:31.159449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] The token cache is being invalidate because project 63a34262f96b4ff299078dfe048be70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:31.159804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:31.165052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-108ae144-b821-4005-b9b4-9753e69b9898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:31.166745 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2650/5320] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:30 2022] DELETE /identity/v3/projects/63a34262f96b4ff299078dfe048be70e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:31.180812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.182372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.182982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.235719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:31.240040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:31.426934 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2671/5321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:31.436264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.436881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.438159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.507633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:31.511389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:31.559472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2651/5322] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:31.564594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:31.579586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1377-f10f-4efc-b8dc-dba1add807e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:31.605758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:31.606441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.614897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.615756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.616742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:31.617254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:31.621006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3dc5e-5676-42c4-a436-cd0a7ce7c62b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:31.671479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2672/5323] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:21:31.676565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:31.688329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be751046-b4f8-4f17-8f29-344152f177ae None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:31.696278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:31.697756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.698270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.698727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.710053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.710702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.711204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.717151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:31.728111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:31.762923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:31.771975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:31.784401 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2673/5324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:31 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:31.785785 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2652/5325] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:31 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:31.789733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:31.958902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd18694-5a14-4de8-a724-1bceee3f7d8c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:31.986678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:31.987328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:31.987763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:31.988055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:31.988870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:31.990847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:32.061310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2674/5326] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:31 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:32.066003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:32.089362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621418a-9d9a-4b22-99f5-f4ccbb0e29c2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:32.108017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:32.108711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.109002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.109320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.110064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:32.111687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:32.131790 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2653/5327] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:32.138523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:32.150887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d983a8-4945-432b-9b5d-ff4b5f07ed6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:32.173998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:32.174678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.174967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.175245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.175924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:32.177743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b1c9-b0f5-485d-9395-b06a51c340e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:32.196145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2675/5328] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:32.200464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:32.214080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ca8b-4815-46e9-a6c2-34ca8367e3ec admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:32.222361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:32.223147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.223435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.223714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] PATH_INFO: `/v3/projects/f6aa2e9d05f74492abb0824e53e36a13/users/189aacc7d7834944b299d3d7a4670a82/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.255956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6aa2e9d05f74492abb0824e53e36a13, user_id=189aacc7d7834944b299d3d7a4670a82, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:32.260837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:32.296001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2654/5329] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:32 2022] PUT /identity/v3/projects/f6aa2e9d05f74492abb0824e53e36a13/users/189aacc7d7834944b299d3d7a4670a82/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:32.306710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.307096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.307378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.387422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] MFA Rules not processed for user `189aacc7d7834944b299d3d7a4670a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:32.389098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:32.414993 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:32.505897 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2676/5330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:32.510305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:32.693228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f0b4f-9609-42ab-892f-c41ecea014b5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:32.704842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:32.706074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.706413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.706972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.709730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:32.712883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74636ddd-6c26-415e-8c1a-c2b0d1d57c2a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:32.781655 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2655/5331] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:32 2022] POST /identity/v3/projects => generated 377 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:21:32.785569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:32.789348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c078-d207-4fad-9214-0c0bad89b6a0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.789662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c078-d207-4fad-9214-0c0bad89b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.789938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c078-d207-4fad-9214-0c0bad89b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.813062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61ab5e-aa4e-4cad-b961-e260b962468f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:32.837034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b3b1c078-d207-4fad-9214-0c0bad89b6a0 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:32.838550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3b1c078-d207-4fad-9214-0c0bad89b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:32.950023 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:32.968167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:32.969710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:32.970159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:32.970590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:32.971389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:32.980534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:33.035471 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2656/5332] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:33.038687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4fd1-abcd-4d4b-9406-2f5b8da71663 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.038687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4fd1-abcd-4d4b-9406-2f5b8da71663 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.039124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4fd1-abcd-4d4b-9406-2f5b8da71663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.067577 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2677/5333] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:32 2022] POST /identity/v3/users => generated 295 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:33.072144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:33.079183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4dcb4fd1-abcd-4d4b-9406-2f5b8da71663 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:33.082527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4dcb4fd1-abcd-4d4b-9406-2f5b8da71663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:33.093164 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2657/5334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:33.095265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2092-caf5-4833-83a7-d89a5df12e1c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.095654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2092-caf5-4833-83a7-d89a5df12e1c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.096028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2092-caf5-4833-83a7-d89a5df12e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.118350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d33fa0-280d-4418-a4ef-bffc2bb5e84b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:33.142218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:33.143121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.143588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.144023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.147152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:33.149099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:33.182821 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.application [None req-1acb2092-caf5-4833-83a7-d89a5df12e1c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:21:33.186258 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2658/5335] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:21:33.187799 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2678/5336] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:33.192275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41e09-9f4e-4660-98e6-85b5d8d8f002 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.192474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41e09-9f4e-4660-98e6-85b5d8d8f002 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.192843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41e09-9f4e-4660-98e6-85b5d8d8f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.196408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:33.227826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba881b5-ece8-46a7-83d2-e0a45a51b8f9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:33.243980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:33.244801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.245144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.245520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] PATH_INFO: `/v3/projects/080757cbc5bc42f08c7ca52da6cc2710/users/3908a340c6b645a89320d6364cb6e8de/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.287706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080757cbc5bc42f08c7ca52da6cc2710, user_id=3908a340c6b645a89320d6364cb6e8de, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:33.290726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:33.316459 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2679/5337] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:33 2022] PUT /identity/v3/projects/080757cbc5bc42f08c7ca52da6cc2710/users/3908a340c6b645a89320d6364cb6e8de/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:33.317573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:33.321047 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.application [None req-96b41e09-9f4e-4660-98e6-85b5d8d8f002 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:21:33.329431 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2659/5338] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 138 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:21:33.337539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.339199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.341536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.436332 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.application [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:21:33.441428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2660/5339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 108 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:21:33.479995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fb12-b4a6-4ad0-aed6-89c851ee18c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:33.490846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:33.491483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.491770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.492049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.492974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:33.494372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035626e-7551-4ab4-8e3d-ea1fb9bfc182 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:33.538827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2680/5340] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:33.542742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:33.577702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75022a8-1cd4-4009-aa00-38c482d78c40 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:33.599878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:33.601349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.601890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.602384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] PATH_INFO: `/v3/projects/080757cbc5bc42f08c7ca52da6cc2710/users/3908a340c6b645a89320d6364cb6e8de/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.607000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080757cbc5bc42f08c7ca52da6cc2710, user_id=3908a340c6b645a89320d6364cb6e8de, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:33.625503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:33.671127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2661/5341] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:33 2022] PUT /identity/v3/projects/080757cbc5bc42f08c7ca52da6cc2710/users/3908a340c6b645a89320d6364cb6e8de/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:33.681652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:33.681961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:33.682216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:33.709284 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:33.747273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] MFA Rules not processed for user `3908a340c6b645a89320d6364cb6e8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:33.748501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:33.935074 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2681/5342] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:33.949343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:33.951467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:34.160717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfd8c8-b6ee-44cc-832a-a07564698e41 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:34.167222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:34.167850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:34.168196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:34.168600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:34.261090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:34.262975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465061-77b0-4f41-baf6-87cf0589c349 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:34.282169 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2662/5343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:21:36.090166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:36.091819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:36.323782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b16a5-fda7-4091-9a86-4fbbdabbab77 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:36.334537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:36.335212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:36.335494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:36.335764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:36.337628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:36.474042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:36.481565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:36.538823 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2682/5344] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:36.718179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05787f-e640-4057-8748-91f9873cd743 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:36.719387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05787f-e640-4057-8748-91f9873cd743 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:36.719803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05787f-e640-4057-8748-91f9873cd743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:36.756199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3f05787f-e640-4057-8748-91f9873cd743 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:36.757296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3f05787f-e640-4057-8748-91f9873cd743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:36.815759 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:36.915625 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2663/5345] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:36.954480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:36.960776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:37.067608 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:37.155383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d437d5-c2e9-4bf6-95ef-1054b235112a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:37.168551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:37.170199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:37.170662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:37.171106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:37.218551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:37.220185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:37.242576 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2683/5346] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:21:38.545943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f8194-0e44-4436-820f-d5e519202492 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:38.548171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f8194-0e44-4436-820f-d5e519202492 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:38.548442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f8194-0e44-4436-820f-d5e519202492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:38.589991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-779f8194-0e44-4436-820f-d5e519202492 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:38.591271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-779f8194-0e44-4436-820f-d5e519202492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:38.610021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2664/5347] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:38.624888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:38.646514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f09a1-12e0-4a78-8eb3-a65688c88988 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:38.652316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:38.653370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:38.653797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:38.654178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:38.667882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:38.669733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:38.688065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2684/5348] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:39.246559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:39.247259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:39.247713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:39.291896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:39.294019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:39.316684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2665/5349] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:39.329756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:39.347530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd6fef-529e-4257-8e2b-b7f1b4941f90 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:39.370775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:39.371418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:39.371705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:39.371983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:39.401109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:39.403803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:39.408997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:39.411127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:39.437286 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2685/5350] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:21:39.440899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c274be-47dc-478c-96fd-c10f7f0768d0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:39.464565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:39.465889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:39.466162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:39.466427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:39.475425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:39.502243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:39.504732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:39.522116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2666/5351] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:21:40.845219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:40.847285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:40.878252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c9cd-6135-4007-81c2-4892a1d4a64c service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:40.896555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:40.897505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:40.897927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:40.898356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:40.921055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:40.923754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:40.941778 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2686/5352] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:44.072355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:44.078869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:44.252597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f976-1a6f-4451-b261-7ccb05cb33f1 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:44.271190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:44.271190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:44.271190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:44.271190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] PATH_INFO: `/v3/users/ab3394e2971741d7aa5956de0d4afba8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:44.271643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3394e2971741d7aa5956de0d4afba8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:44.271643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:44.333993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3394e2971741d7aa5956de0d4afba8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:44.335007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3394e2971741d7aa5956de0d4afba8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:44.344480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3394e2971741d7aa5956de0d4afba8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:44.360608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3394e2971741d7aa5956de0d4afba8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:44.361769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-04ba10d6-4da0-4412-bd38-648bf7b05e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3394e2971741d7aa5956de0d4afba8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:44.389592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2667/5353] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:44 2022] DELETE /identity/v3/users/ab3394e2971741d7aa5956de0d4afba8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:44.397064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:44.400218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:44.457893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:44.458602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:44.459060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:44.588554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d59a3-850f-48ff-b6b7-6b03b38f7d44 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:44.591305 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:44.606343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:44.607612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:44.628684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2668/5354] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:44.639973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:44.647304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:44.796793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:44.800017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:44.801431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:44.801890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:44.807181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:44.821611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231ef7-e059-4976-bcf8-86db7f6fd15c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:44.829610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead7d9c-bcda-442a-9e6d-e75848cc746b tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:44.832326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead7d9c-bcda-442a-9e6d-e75848cc746b tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:44.832729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead7d9c-bcda-442a-9e6d-e75848cc746b tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:44.833286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead7d9c-bcda-442a-9e6d-e75848cc746b tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:44.939369 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:44.976339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ead7d9c-bcda-442a-9e6d-e75848cc746b tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.026220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:45.031252 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2669/5355] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:44 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:45.032594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:45.042270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:45.042557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:45.042834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:45.059301 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2687/5356] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:45.072939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:45.074368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:45.225309 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2670/5357] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:45.242491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:45.244135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:45.377157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:45.379223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:45.438878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4cfaa-fe83-4f84-826f-9a47de1e5c8d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:45.442719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e41464-eb07-467d-b60b-0f3b87bf29bc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:45.455608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:45.458507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:45.458833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:45.459118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] PATH_INFO: `/v3/projects/c9172549e19145c5b2201cfa5ef4eddd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:45.459362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:45.460653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:45.461040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:45.461570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:45.463378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9172549e19145c5b2201cfa5ef4eddd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:45.466842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:45.492457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:45.494313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612caa-9c23-4273-8e9b-144b9b068b5b service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:45.518355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2688/5358] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:45.620496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9172549e19145c5b2201cfa5ef4eddd', 'request_id': 'req-9f872113-3703-4aab-85f2-6228ddd0f688'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.644755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9172549e19145c5b2201cfa5ef4eddd', 'request_id': 'req-9f872113-3703-4aab-85f2-6228ddd0f688'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.654631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9172549e19145c5b2201cfa5ef4eddd', 'request_id': 'req-9f872113-3703-4aab-85f2-6228ddd0f688'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.681275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] The token cache is being invalidate because project c9172549e19145c5b2201cfa5ef4eddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:45.681605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.684468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9f872113-3703-4aab-85f2-6228ddd0f688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:45.686262 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2671/5359] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:45 2022] DELETE /identity/v3/projects/c9172549e19145c5b2201cfa5ef4eddd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:45.691562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:45.691814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:45.692307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:45.727006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:45.728689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:45.918243 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2689/5360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:45.919658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050b6-bbf9-485e-bf16-1bdf17b9993b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:45.919959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050b6-bbf9-485e-bf16-1bdf17b9993b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:45.920244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050b6-bbf9-485e-bf16-1bdf17b9993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:45.936668 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:45.963305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1c8050b6-bbf9-485e-bf16-1bdf17b9993b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:45.966388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c8050b6-bbf9-485e-bf16-1bdf17b9993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:45.991783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2672/5361] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:45.992996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.006158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241cff3-0b5a-4e73-aeae-73f4888585f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.021980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.023666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.024120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.024546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.026076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:46.026565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.028350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:46.036758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d22b36-9661-4f6e-a4e9-37159c13bdb8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.037260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d22b36-9661-4f6e-a4e9-37159c13bdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.037716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d22b36-9661-4f6e-a4e9-37159c13bdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.088084 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2690/5362] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:46.088287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c3d22b36-9661-4f6e-a4e9-37159c13bdb8 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:46.088287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c3d22b36-9661-4f6e-a4e9-37159c13bdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:46.090107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.101684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2673/5363] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:46.111778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6c7d-f652-4edf-9e85-208ca98503a6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.112101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6c7d-f652-4edf-9e85-208ca98503a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.112362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6c7d-f652-4edf-9e85-208ca98503a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.127731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b81fc-0ffe-4d0f-aac1-3be9271c30dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.131161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ccb6c7d-f652-4edf-9e85-208ca98503a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:46.146783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.147421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.154244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.154634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.157960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.166695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:46.237770 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2691/5364] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/projects => generated 395 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:46.242018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-2ccb6c7d-f652-4edf-9e85-208ca98503a6 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 25 01:21:46.352746 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:46.354003 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:21:46.355149 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:21:46.361662 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2674/5365] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:21:46.366800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c7169-268a-4ae5-a483-4ee3ce0b1d70 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.370241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c7169-268a-4ae5-a483-4ee3ce0b1d70 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.370673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c7169-268a-4ae5-a483-4ee3ce0b1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.407904 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:46.513685 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.application [None req-f32c7169-268a-4ae5-a483-4ee3ce0b1d70 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:21:46.513685 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2675/5366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 135 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:21:46.513685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.513685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.513685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.541097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13766d-56a8-4e86-9cc7-cb17651077f6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.585957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.586912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.588050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.588659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.599484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.627242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:46.668788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:46.673098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:46.695781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2692/5367] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/users => generated 298 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:46.700402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.740382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8199df1-0679-4332-bede-c5d0706c1d37 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.774152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.780424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.781802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.782285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.783290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.787552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:46.816469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2693/5368] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:46.824355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.848315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f54b9-0600-4dca-a7ec-1bb46bf6d73e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.854271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.855189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.855756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.856249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.857112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.859102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2676/5369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:46.863509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.864902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:46.879583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582d41-ea02-4de8-a8b4-a83288c0a055 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.886190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2694/5370] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:46.890056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:46.891674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.892337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.892623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.892905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.917639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637ed1-1ace-48a2-9602-1a8e67283b30 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:46.942266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:46.942915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:46.943196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:46.943469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] PATH_INFO: `/v3/projects/21cecfd3059f4397b34b26fa4b3f3769/users/520c748cec88405a86547a86faf10247/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:46.989946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cecfd3059f4397b34b26fa4b3f3769, user_id=520c748cec88405a86547a86faf10247, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:46.992702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024db21-0103-486d-9c41-3cbfda89a3cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:47.039473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:47.048756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2695/5371] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:46 2022] PUT /identity/v3/projects/21cecfd3059f4397b34b26fa4b3f3769/users/520c748cec88405a86547a86faf10247/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:47.055443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4a07-cb77-4d81-92ab-3671fc72ce21 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:47.055988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4a07-cb77-4d81-92ab-3671fc72ce21 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:47.056484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4a07-cb77-4d81-92ab-3671fc72ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:47.063608 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2677/5372] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:46 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:47.106570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-383e4a07-cb77-4d81-92ab-3671fc72ce21 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:47.107816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-383e4a07-cb77-4d81-92ab-3671fc72ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:47.239652 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2696/5373] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:21:47.246991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:47.251566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:47.409279 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:47.458516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc474-f1ce-4182-aac9-505103e782fa tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:47.593645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:47.594293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:47.594583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:47.594857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:47.629060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:47.630587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221c3d-c002-439d-9214-5d6bf0546f09 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:47.665866 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2678/5374] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:48.069515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:48.070750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:48.071520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:48.119448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:48.120762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:48.133592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2697/5375] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:48 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:48.136511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f31e75-6e94-4b71-a074-c41a1be3e93a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:48.137020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f31e75-6e94-4b71-a074-c41a1be3e93a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:48.137631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f31e75-6e94-4b71-a074-c41a1be3e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:48.254424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-28f31e75-6e94-4b71-a074-c41a1be3e93a None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:48.261427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-28f31e75-6e94-4b71-a074-c41a1be3e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:48.446091 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2679/5376] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:48.450156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:48.470066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1457-089a-44bc-80e8-fbf5e279e9d2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:48.483377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:48.485059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:48.488159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:48.488690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:48.583050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:48.607435 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2698/5377] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:48 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:48.723775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cba33-11bc-4699-89dc-05710758f562 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:48.724213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cba33-11bc-4699-89dc-05710758f562 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:48.724568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cba33-11bc-4699-89dc-05710758f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:48.785423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c15cba33-11bc-4699-89dc-05710758f562 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:48.788665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c15cba33-11bc-4699-89dc-05710758f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:48.920326 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2680/5378] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:48.970280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:48.972179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:49.063904 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:49.144828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2510c86-e513-4c61-86b8-74bccece5c22 tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:49.158733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:49.159669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:49.160183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:49.160533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:49.183230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:49.184937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941e9c8-0c07-4b8e-9ada-fb20b37d4ff1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:49.209684 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2699/5379] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:49.244944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517171-443d-4cfc-9656-6676378641b7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:49.245597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517171-443d-4cfc-9656-6676378641b7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:49.245898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517171-443d-4cfc-9656-6676378641b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:49.295502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-47517171-443d-4cfc-9656-6676378641b7 None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:49.300405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-47517171-443d-4cfc-9656-6676378641b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:49.487786 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:49.561323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2681/5380] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:49.612488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:49.612793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:49.613075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:49.676775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:49.690436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:49.706015 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2700/5381] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:49 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:49.711645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031296-2835-4aa8-955a-3aec069f5724 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:49.714762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031296-2835-4aa8-955a-3aec069f5724 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:49.715433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031296-2835-4aa8-955a-3aec069f5724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:49.781552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-36031296-2835-4aa8-955a-3aec069f5724 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:49.786543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-36031296-2835-4aa8-955a-3aec069f5724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:49.813677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2682/5382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:49.818156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:49.835606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c586fe-7286-40f8-9f10-ab60db311983 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:49.867556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf4639-d299-4c61-ad8a-808ad287ba9d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2058037e53246f790f73163ca731063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d32b1efb142406aaeda39651300d3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:49.868283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf4639-d299-4c61-ad8a-808ad287ba9d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:49.870974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf4639-d299-4c61-ad8a-808ad287ba9d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:49.873129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf4639-d299-4c61-ad8a-808ad287ba9d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063/password` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:50.032723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a4cf4639-d299-4c61-ad8a-808ad287ba9d tempest-IdentityV3UsersTest-542965372 tempest-IdentityV3UsersTest-542965372-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:50.063682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2701/5383] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:21:49 2022] POST /identity/v3/users/f2058037e53246f790f73163ca731063/password => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:51.071534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:51.072295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:51.072295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:51.126771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:51.129241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:51.164105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2683/5384] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:52.175409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269001e0-cd52-4898-adb9-01f5303e36f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:52.175409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269001e0-cd52-4898-adb9-01f5303e36f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:52.175409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269001e0-cd52-4898-adb9-01f5303e36f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:52.230899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-269001e0-cd52-4898-adb9-01f5303e36f2 None None] MFA Rules not processed for user `f2058037e53246f790f73163ca731063`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:52.232150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-269001e0-cd52-4898-adb9-01f5303e36f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:52.250795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2702/5385] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:52.256792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:52.258794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:52.292779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a37c1-b818-4c4e-9c73-0c7b30e14d1c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:52.316714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:52.317671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:52.318114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:52.318532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] PATH_INFO: `/v3/users/f2058037e53246f790f73163ca731063` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:52.322426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2058037e53246f790f73163ca731063)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:52.326615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:52.530009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:52.530967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:52.570179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:52.614084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:52.621885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2058037e53246f790f73163ca731063'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:52.664207 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2684/5386] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:21:52 2022] DELETE /identity/v3/users/f2058037e53246f790f73163ca731063 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:52.669031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:52.675941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:52.676462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:52.728248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:52.729518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:53.032436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2703/5387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:53.073698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:53.081495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:53.574169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3b5e-31b4-445a-9223-353816cd83ca admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:53.590869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:53.591504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:53.591782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:53.592053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:53.628216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:53.630747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b2d43-2c86-461e-b4cc-0da5a8aded98 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:53.673597 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2685/5388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:21:56.053088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:56.054692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:56.082854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824fc0b-049a-4a1c-83f2-6a98d88f15aa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:56.116996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:56.123837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:56.124428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:56.124823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] PATH_INFO: `/v3/projects/2d32b1efb142406aaeda39651300d3e3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:56.127153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d32b1efb142406aaeda39651300d3e3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:56.135564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:56.306181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d32b1efb142406aaeda39651300d3e3', 'request_id': 'req-49571f29-f7b7-418a-92cf-80b77a84e5b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:56.333775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d32b1efb142406aaeda39651300d3e3', 'request_id': 'req-49571f29-f7b7-418a-92cf-80b77a84e5b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:56.351870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d32b1efb142406aaeda39651300d3e3', 'request_id': 'req-49571f29-f7b7-418a-92cf-80b77a84e5b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:56.374195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] The token cache is being invalidate because project 2d32b1efb142406aaeda39651300d3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:21:56.374750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:56.375720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49571f29-f7b7-418a-92cf-80b77a84e5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:21:56.382925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2704/5389] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:56 2022] DELETE /identity/v3/projects/2d32b1efb142406aaeda39651300d3e3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:56.384532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:56.385341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:56.386418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:56.523456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:56.526801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:56.713247 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:56.754255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:56.755443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:56.755953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:56.759170 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2686/5390] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:56.790001 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:56.814783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:56.816591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:56.844269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:56.851214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2705/5391] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:56.859550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ced7-09a6-471d-ba27-ca19b85347ef None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:56.876837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:56.878383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:56.878981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:56.879475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:56.880349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:21:56.880879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:56.886572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:56.932509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:56.940909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2687/5392] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:21:56.948998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3436a7a-62c3-4878-a6c6-80ea180ca60e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:56.976060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:56.977349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:56.977756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:56.978133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:56.978880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:56.981845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.052206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:57.065858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2706/5393] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:56 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:21:57.069043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5652-2b24-4c61-af8d-ecc156b48c52 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:57.259101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:57.259893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.260313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.260687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:57.261594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:57.263655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.318259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:57.319172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2688/5394] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:57 2022] POST /identity/v3/users => generated 305 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:21:57.332413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04711a-3f6b-4afb-81e8-d880a9c06c5f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:57.344760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:57.345789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.348666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.349185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:57.350132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:57.356371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.378921 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2707/5395] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:21:57.383205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:57.408637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14a90-cd58-4926-a21e-617d94bb6ea4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:57.425082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:57.426541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.426822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.427294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] PATH_INFO: `/v3/projects/983dba99732e43bfb9d7ca782e2de979/users/cc8ae2a24ca14679a976a624bdf96232/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:57.471481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] RBAC: Authorizing `identity:create_grant(project_id=983dba99732e43bfb9d7ca782e2de979, user_id=cc8ae2a24ca14679a976a624bdf96232, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:57.474851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.503920 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2689/5396] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:57 2022] PUT /identity/v3/projects/983dba99732e43bfb9d7ca782e2de979/users/cc8ae2a24ca14679a976a624bdf96232/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:57.505162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:57.543809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961e332-27b9-4c9e-91f7-9660ef52a0b0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:57.838764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:57.839379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.839665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.839945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:57.840645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:57.842391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a835-9fa3-4334-8641-21d5c3bb070a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.873078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2708/5397] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:21:57.878027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:57.893932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a82fa3-4549-45d3-9d61-ec385cf7993a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:57.908907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:57.910162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.910606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.911029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] PATH_INFO: `/v3/projects/983dba99732e43bfb9d7ca782e2de979/users/cc8ae2a24ca14679a976a624bdf96232/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:57.917171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983dba99732e43bfb9d7ca782e2de979, user_id=cc8ae2a24ca14679a976a624bdf96232, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:57.921383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:57.958272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2690/5398] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:57 2022] PUT /identity/v3/projects/983dba99732e43bfb9d7ca782e2de979/users/cc8ae2a24ca14679a976a624bdf96232/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:21:57.973667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:57.974198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:57.974714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:58.088370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] MFA Rules not processed for user `cc8ae2a24ca14679a976a624bdf96232`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:58.096377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:21:58.441963 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2709/5399] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:21:58.446093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:58.641852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253014-c397-41e8-9004-626dc802f257 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:58.666668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:58.667485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:58.667916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:58.668345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:58.669287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:58.687912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:58.801982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2691/5400] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:21:58 2022] POST /identity/v3/projects => generated 397 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:58.806245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:58.834928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bef7-e646-450d-9809-01f70a684223 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:59.161983 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:59.242561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:59.243210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:59.243494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:59.243775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:59.244440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:59.257186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:59.370024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:59.370833 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2710/5401] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:21:58 2022] POST /identity/v3/users => generated 299 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:21:59.395104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f7d1a-62d6-4214-8083-6a9967fd6319 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:59.417464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:59.418284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:59.418702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:59.419091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:59.419908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:59.431358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:59.471666 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2692/5402] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:21:59.473560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:59.487055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad799-b6f7-41c2-864a-539f263ca993 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:59.506121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:59.506994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:59.507501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:59.507994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:59.508896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:59.514177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295726d-878d-4181-9680-da8a6cf34284 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:59.553341 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2711/5403] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:21:59.559854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:21:59.579272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace6af6-1f9b-4624-9384-3c2a405ec1b0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:21:59.599042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:21:59.604715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:59.605244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:59.607014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] PATH_INFO: `/v3/projects/61a9bf26bfe545199ef0a83dae66ad1f/users/3311e2b772964cfe9ad355f3e639755e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:59.624017 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:59.643319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a9bf26bfe545199ef0a83dae66ad1f, user_id=3311e2b772964cfe9ad355f3e639755e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:21:59.646922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:21:59.697086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2693/5404] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:21:59 2022] PUT /identity/v3/projects/61a9bf26bfe545199ef0a83dae66ad1f/users/3311e2b772964cfe9ad355f3e639755e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:21:59.718620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cbc4-bba4-4085-9a7d-57a3925e5fcc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:21:59.719160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cbc4-bba4-4085-9a7d-57a3925e5fcc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:21:59.719621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cbc4-bba4-4085-9a7d-57a3925e5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:21:59.818916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4957cbc4-bba4-4085-9a7d-57a3925e5fcc None None] MFA Rules not processed for user `3311e2b772964cfe9ad355f3e639755e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:21:59.820360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4957cbc4-bba4-4085-9a7d-57a3925e5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:00.015699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2712/5405] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:21:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:00.029373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:00.032274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:00.090296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:00.090583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:00.090860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:00.158340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] MFA Rules not processed for user `520c748cec88405a86547a86faf10247`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:00.158798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:00.226253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2e20-9a62-4009-b5cf-bc1e88e40642 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:00.242130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:00.243042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:00.243485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:00.244024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:00.405984 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2713/5406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:00.466722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:00.468688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:00.487477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2694/5407] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:01.440125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:01.441715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:01.548720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:01.594368 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:01.719341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5586-746f-4d54-9dc4-4bdfbb4d4638 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:01.742165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:01.743112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:01.743224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:01.743474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:01.771436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:01.773050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f9894-a040-41f1-90ae-e0f41e4253b4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:01.778030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f704b-1708-4a45-bc2c-fe1cfe2e6eed service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:01.800838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:01.800838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:01.800838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:01.800838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] PATH_INFO: `/v3/users/cc8ae2a24ca14679a976a624bdf96232` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:01.803347 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2714/5408] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:22:01.816635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8ae2a24ca14679a976a624bdf96232)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:01.820575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:01.911479 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:01.927364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8ae2a24ca14679a976a624bdf96232'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:01.928102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8ae2a24ca14679a976a624bdf96232'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:01.942794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8ae2a24ca14679a976a624bdf96232'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:01.965562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8ae2a24ca14679a976a624bdf96232'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:01.966303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8ae2a24ca14679a976a624bdf96232'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:01.991766 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2695/5409] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:01 2022] DELETE /identity/v3/users/cc8ae2a24ca14679a976a624bdf96232 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:01.996305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c0d-045a-486f-8648-94946933eeef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:01.996808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c0d-045a-486f-8648-94946933eeef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:01.997286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c0d-045a-486f-8648-94946933eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:02.039610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-364c6c0d-045a-486f-8648-94946933eeef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:02.041135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-364c6c0d-045a-486f-8648-94946933eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:02.132741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2715/5410] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:02.143897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:02.145763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:02.268794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d982-17bb-4d20-b778-72882de36f03 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:02.277979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:02.278882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:02.279387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:02.279878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:02.310634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:02.316602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:02.366689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2696/5411] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:03.069988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6c0d-045a-486f-8648-94946933eeef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:03.072041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-364c6c0d-045a-486f-8648-94946933eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:03.091908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6c0d-045a-486f-8648-94946933eeef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:03.146994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:03.147664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:03.147947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:03.148220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] PATH_INFO: `/v3/projects/983dba99732e43bfb9d7ca782e2de979` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:03.160863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=983dba99732e43bfb9d7ca782e2de979)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:03.172128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:03.363573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983dba99732e43bfb9d7ca782e2de979', 'request_id': 'req-7553c579-6fd2-434b-bd50-25b28990ebfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.377516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983dba99732e43bfb9d7ca782e2de979', 'request_id': 'req-7553c579-6fd2-434b-bd50-25b28990ebfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.390760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983dba99732e43bfb9d7ca782e2de979', 'request_id': 'req-7553c579-6fd2-434b-bd50-25b28990ebfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.427627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] The token cache is being invalidate because project 983dba99732e43bfb9d7ca782e2de979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:03.428889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.429814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.439146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:03.440538 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2716/5412] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:03 2022] DELETE /identity/v3/projects/983dba99732e43bfb9d7ca782e2de979 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:03.454539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76df61d-de58-4a9b-bb43-d7f6a5acb25c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:03.671814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:03.672565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:03.672860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:03.673136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] PATH_INFO: `/v3/users/3311e2b772964cfe9ad355f3e639755e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:03.677600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3311e2b772964cfe9ad355f3e639755e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:03.690536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:03.942399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3311e2b772964cfe9ad355f3e639755e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.942399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3311e2b772964cfe9ad355f3e639755e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.949309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3311e2b772964cfe9ad355f3e639755e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.963082 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:03.990070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3311e2b772964cfe9ad355f3e639755e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:03.991159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-66f06c18-0789-4933-9477-486adbd24ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3311e2b772964cfe9ad355f3e639755e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:04.034283 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2697/5413] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:03 2022] DELETE /identity/v3/users/3311e2b772964cfe9ad355f3e639755e => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:04.695676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:04.703590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:04.770200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c579-6fd2-434b-bd50-25b28990ebfb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:04.893798 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:04.926427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:04.935385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:04.936885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:04.937568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] PATH_INFO: `/v3/projects/61a9bf26bfe545199ef0a83dae66ad1f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:04.946597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a9bf26bfe545199ef0a83dae66ad1f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:04.948794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:05.064207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a9bf26bfe545199ef0a83dae66ad1f', 'request_id': 'req-501d69d0-79ec-42ae-811a-0e39fb52173e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:05.082421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a9bf26bfe545199ef0a83dae66ad1f', 'request_id': 'req-501d69d0-79ec-42ae-811a-0e39fb52173e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:05.109397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a9bf26bfe545199ef0a83dae66ad1f', 'request_id': 'req-501d69d0-79ec-42ae-811a-0e39fb52173e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:05.152880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] The token cache is being invalidate because project 61a9bf26bfe545199ef0a83dae66ad1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:05.157363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:05.158225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-501d69d0-79ec-42ae-811a-0e39fb52173e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:05.175821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2717/5414] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:04 2022] DELETE /identity/v3/projects/61a9bf26bfe545199ef0a83dae66ad1f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:05.279561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:05.280151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:05.280382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:05.348482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:05.350071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:05.552596 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2698/5415] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:05.560185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:05.560558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:05.560915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:05.609925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:05.615674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:05.639195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2718/5416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:05.640647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:05.656730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30ac21-344d-4fd8-8925-d54806c596d0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:05.678026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:05.678882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:05.679452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:05.679801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:05.681560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:05.682859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:05.693590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:05.748230 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2699/5417] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:22:05.752718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:05.792522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ec7c-5161-49e5-a810-16e113da8fa2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:05.824871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:05.825541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:05.825823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:05.826101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:05.827667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:05.854024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:05.942330 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2719/5418] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:05 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:05.943810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:05.955895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008377fe-c358-46a0-8702-b40f95ff9e82 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:06.147220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:06.147864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:06.148846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:06.149130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:06.149847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:06.152074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:06.266143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2700/5419] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:05 2022] POST /identity/v3/users => generated 286 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:06.270459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:06.288806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b869-03cd-4a29-9cc0-9850eaa62389 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:06.314454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:06.316706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:06.317201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:06.317728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:06.331408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:06.339505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:06.374546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:06.393549 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2720/5420] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:06.395381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad501d8-500b-4242-b716-a93bcb84cd9c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:06.420216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:06.421458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:06.421750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:06.422031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:06.422695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:06.424342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d41366-72e9-4b96-af25-ed02a0e34eec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:06.484822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:06.485444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2701/5421] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:06.498009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd4c-b325-4abb-899b-02727fcc1248 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:06.515078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:06.515783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:06.516172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:06.521311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] PATH_INFO: `/v3/projects/e428bee88ea54191afe19afe7bc5b710/users/ed011a892bb2444fb5f11ae168219df2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:06.559807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e428bee88ea54191afe19afe7bc5b710, user_id=ed011a892bb2444fb5f11ae168219df2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:06.564604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:06.598548 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2721/5422] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:06 2022] PUT /identity/v3/projects/e428bee88ea54191afe19afe7bc5b710/users/ed011a892bb2444fb5f11ae168219df2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:06.608956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:06.609250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:06.610966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:06.706743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] MFA Rules not processed for user `ed011a892bb2444fb5f11ae168219df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:06.718730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:06.864799 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:07.018936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:07.022757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:07.030941 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2702/5423] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:07.216460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da618b-2b97-4cc5-8a65-fa2740bda4c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:07.234608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:07.238886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:07.241114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:07.241587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:07.277837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:07.281084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3641605-cb10-4772-bf72-dc5cca40be6d service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:07.309234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2722/5424] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:22:09.492799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:09.700655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c915a-799e-4dd1-8f2e-273d91523792 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:09.711816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:09.712529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:09.712808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:09.715048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] PATH_INFO: `/v3/users/ed011a892bb2444fb5f11ae168219df2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:09.719006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed011a892bb2444fb5f11ae168219df2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:09.724302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:09.834747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed011a892bb2444fb5f11ae168219df2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:09.835459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed011a892bb2444fb5f11ae168219df2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:09.854532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed011a892bb2444fb5f11ae168219df2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:09.885067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed011a892bb2444fb5f11ae168219df2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:09.885844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed011a892bb2444fb5f11ae168219df2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:09.924112 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2703/5425] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:09 2022] DELETE /identity/v3/users/ed011a892bb2444fb5f11ae168219df2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:09.928607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:09.932792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:09.933349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:10.001686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:10.006802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:10.066142 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:10.176468 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2723/5426] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:10.200971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:10.202819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:10.392639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0614b73-527b-4abc-95a3-dc5d23c17401 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:10.405570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:10.406217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:10.406554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:10.406837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:10.422689 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:10.426296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:10.429376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009961-1b6b-49d6-9f7b-bec30370998e service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:10.463504 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2704/5427] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:12.720827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:12.723164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:12.774871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3fd7c-8655-4eba-94fa-ddd6f1a1b87f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:12.813698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:12.816837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:12.819391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:12.822547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] PATH_INFO: `/v3/projects/e428bee88ea54191afe19afe7bc5b710` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:12.831814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e428bee88ea54191afe19afe7bc5b710)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:12.859634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:13.051187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e428bee88ea54191afe19afe7bc5b710', 'request_id': 'req-47532a01-67eb-4656-9510-13acddacbc31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:13.105560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e428bee88ea54191afe19afe7bc5b710', 'request_id': 'req-47532a01-67eb-4656-9510-13acddacbc31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:13.146317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e428bee88ea54191afe19afe7bc5b710', 'request_id': 'req-47532a01-67eb-4656-9510-13acddacbc31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:13.214455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] The token cache is being invalidate because project e428bee88ea54191afe19afe7bc5b710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:13.214760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:13.220757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47532a01-67eb-4656-9510-13acddacbc31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:13.230730 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2724/5428] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:12 2022] DELETE /identity/v3/projects/e428bee88ea54191afe19afe7bc5b710 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:13.236083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:13.237284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:13.237760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:13.315907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:13.319083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:13.501672 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2705/5429] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:13.503365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:13.503652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:13.503923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:13.595623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:13.596845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:13.635492 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2725/5430] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:13.639714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:13.659432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f3705-0825-4298-9a95-cff05af2264e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:13.679066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:13.679370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:13.679606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:13.679883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:13.688085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:13.688409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:13.696548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:13.741089 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2706/5431] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:22:13.742239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:13.755419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0fa2-a5d1-424d-8553-1f086c3c7593 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:13.770775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:13.772069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:13.772669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:13.773160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:13.775238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:13.778037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:13.859754 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2726/5432] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:13 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:22:13.864115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:13.882544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e746-80ef-491c-b739-3cabfb9710d9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:14.091999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:14.093287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:14.094597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:14.095008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:14.095964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:14.103259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:14.250067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2707/5433] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:13 2022] POST /identity/v3/users => generated 305 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:14.257314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:14.290497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe81b-a5ad-408f-9f05-8840bbd0e96b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:14.323747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:14.325256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:14.325922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:14.327110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:14.330609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:14.336299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:14.384446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2727/5434] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:14.386798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:14.427914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8104e7-cbfd-4d9a-8224-0f9fe0ffb91a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:14.457046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:14.460405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:14.461743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:14.462686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:14.463483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:14.474524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e51ea-7444-44ca-8fb7-9e5c53681572 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:14.507454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2708/5435] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:14.515707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:14.546935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6c25-8891-4d47-8e22-b2aacffdf079 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:14.563145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:14.564612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:14.565889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:14.566773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] PATH_INFO: `/v3/projects/073892eaf52c485783cd37e526d1a757/users/39ba6fc79af84b0b8c95acde0d206491/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:14.588639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073892eaf52c485783cd37e526d1a757, user_id=39ba6fc79af84b0b8c95acde0d206491, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:14.592932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:14.617341 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2728/5436] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:14 2022] PUT /identity/v3/projects/073892eaf52c485783cd37e526d1a757/users/39ba6fc79af84b0b8c95acde0d206491/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:14.633483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:14.633941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:14.634331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:14.826215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] MFA Rules not processed for user `39ba6fc79af84b0b8c95acde0d206491`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:14.828845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:15.018370 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:15.082938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2709/5437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:14 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:15.086240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:15.186940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:15.188571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:15.270518 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:15.323533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe8425-4441-4b11-a9d8-961c19ca67d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:15.329468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:15.330962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:15.330962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:15.330962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:15.331545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:15.333936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:15.346806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990bfbd-5b5a-451e-989e-f9031d9d81d4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:15.362766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:15.363527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:15.363924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:15.364251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] PATH_INFO: `/v3/users/520c748cec88405a86547a86faf10247` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:15.365747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] RBAC: Authorizing `identity:delete_user(user_id=520c748cec88405a86547a86faf10247)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:15.367805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:15.380558 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2729/5438] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:15 2022] POST /identity/v3/projects => generated 409 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:22:15.388153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:15.460879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520c748cec88405a86547a86faf10247'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:15.463465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520c748cec88405a86547a86faf10247'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:15.488460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520c748cec88405a86547a86faf10247'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:15.546713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eedbe-bcf0-499b-a709-2cefa320857e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:15.555389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520c748cec88405a86547a86faf10247'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:15.556727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:15.558045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:15.558437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:15.558818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:15.559849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:15.560696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520c748cec88405a86547a86faf10247'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:15.563046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:15.618720 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2730/5439] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:15 2022] POST /identity/v3/users => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:15.619961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:15.629785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:15.632435 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2710/5440] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:15 2022] DELETE /identity/v3/users/520c748cec88405a86547a86faf10247 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:15.678929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca917-1732-49e7-b93b-f943d4973f0d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:15.882170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:15.883086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:15.883466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:15.883844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:15.884663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:15.887620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:15.927135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:15.927595 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2731/5441] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:15.941637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77c2c-8582-43d4-a9cd-c5d09026406d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:15.980918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:15.985859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:15.986369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:15.986802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] PATH_INFO: `/v3/projects/77a942d164d04f2194bf4e0d01a1f768/users/e459b8d81fa14816b913d834def70f8e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:16.056039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a942d164d04f2194bf4e0d01a1f768, user_id=e459b8d81fa14816b913d834def70f8e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:16.058799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:16.136665 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2711/5442] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:15 2022] PUT /identity/v3/projects/77a942d164d04f2194bf4e0d01a1f768/users/e459b8d81fa14816b913d834def70f8e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:16.141609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:16.159794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109584d-1991-42e7-a4a5-83ee73f16f17 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:16.292829 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:16.331083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:16.331728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:16.332011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:16.332286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:16.332938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:16.345889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ea9bb-6e07-417f-9efd-313d5dd2392f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:16.380568 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2732/5443] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:16.381432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:16.426684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790f500-2092-49c7-86d5-8b9f43ec6f7e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:16.456152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:16.456767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:16.459565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:16.463051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] PATH_INFO: `/v3/projects/77a942d164d04f2194bf4e0d01a1f768/users/e459b8d81fa14816b913d834def70f8e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:16.470611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a942d164d04f2194bf4e0d01a1f768, user_id=e459b8d81fa14816b913d834def70f8e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:16.489055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:16.562535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2712/5444] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:16 2022] PUT /identity/v3/projects/77a942d164d04f2194bf4e0d01a1f768/users/e459b8d81fa14816b913d834def70f8e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:16.573939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:16.574234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:16.574876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:16.581081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:16.585585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:16.666990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] MFA Rules not processed for user `e459b8d81fa14816b913d834def70f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:16.668297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:16.703793 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:16.822861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75a7ff-d0b5-49ad-95cb-18c86478dcd1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:16.846032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:16.846677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:16.846956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:16.847225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] PATH_INFO: `/v3/projects/21cecfd3059f4397b34b26fa4b3f3769` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:16.848590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cecfd3059f4397b34b26fa4b3f3769)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:16.850534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:16.958369 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2733/5445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:16.990027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:16.991566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:17.038993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cecfd3059f4397b34b26fa4b3f3769', 'request_id': 'req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:17.072581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cecfd3059f4397b34b26fa4b3f3769', 'request_id': 'req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:17.106012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cecfd3059f4397b34b26fa4b3f3769', 'request_id': 'req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:17.140585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] The token cache is being invalidate because project 21cecfd3059f4397b34b26fa4b3f3769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:17.140585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:17.140585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-206ea9aa-f2ff-4f0f-9b13-8478955e97bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:17.142193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2713/5446] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:16 2022] DELETE /identity/v3/projects/21cecfd3059f4397b34b26fa4b3f3769 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:17.148501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f166-6dbf-4ad1-af04-d15d1b4d8b33 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.149316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f166-6dbf-4ad1-af04-d15d1b4d8b33 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.149846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f166-6dbf-4ad1-af04-d15d1b4d8b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.163457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb2f1-60e2-4663-81eb-715787fc9a7b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:17.196897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ef03f166-6dbf-4ad1-af04-d15d1b4d8b33 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:17.202638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef03f166-6dbf-4ad1-af04-d15d1b4d8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:17.248192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:17.249724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.250007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.250276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.253650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:17.351668 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:17.398525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2714/5447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:17.407792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720625-d682-43ee-841e-523d81161a81 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.410253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720625-d682-43ee-841e-523d81161a81 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.410744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720625-d682-43ee-841e-523d81161a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.434581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:17.436266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:17.470222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2734/5448] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:16 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:22:17.479190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-33720625-d682-43ee-841e-523d81161a81 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:17.480572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33720625-d682-43ee-841e-523d81161a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:17.516771 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2715/5449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:17.517231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:17.539497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3b217-6841-4df3-b365-400e74a41053 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:17.551705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:17.552515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.552972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.553604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.554655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:17.555277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:17.558047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:17.587470 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2735/5450] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:22:17.592958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33720625-d682-43ee-841e-523d81161a81 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:17.605158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33720625-d682-43ee-841e-523d81161a81 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:17.616799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:17.617497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.618110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.618392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.622415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:17.624961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:17.702872 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2716/5451] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:17 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:17.708087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:17.723674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce32b2-73f4-4bc4-b24f-10c9beee8152 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:17.876204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:17.876842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.877128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.877441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.883108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:17.885639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:17.948375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2736/5452] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:17 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:17.953263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:17.974055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51318-9495-463c-ad29-ff956507c79c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:17.986484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:17.986484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:17.986484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:17.986484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:17.986888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:17.988378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:18.013198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2717/5453] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:18.018010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:18.038219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48dd65-21ac-42a7-9623-63b4e28be9e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:18.047045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:18.047548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:18.047828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:18.048100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:18.048748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:18.050419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961ea2d-1f00-46bd-b553-815ba7f572dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:18.073795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2737/5454] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:18.078240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:18.091350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9e312-2545-4572-91b7-49c94f70435d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:18.105987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:18.106660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:18.106936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:18.107211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] PATH_INFO: `/v3/projects/f975dd85a90549e99f53ea92c21fb41f/users/023415a906544acea2a4d54b1717010e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:18.142407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f975dd85a90549e99f53ea92c21fb41f, user_id=023415a906544acea2a4d54b1717010e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:18.145138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:18.158231 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:18.164210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2718/5455] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:18 2022] PUT /identity/v3/projects/f975dd85a90549e99f53ea92c21fb41f/users/023415a906544acea2a4d54b1717010e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:18.172859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:18.173324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:18.173487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:18.211932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:18.212871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:18.339579 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2738/5456] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:18.350957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:18.352692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:18.536056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cda8a-9a95-4aa5-a9cd-ca4119f4dafe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:18.544467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:18.545257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:18.545688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:18.546781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:18.582422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:18.583997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:18.617371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2719/5457] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:21.451838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:21.454078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:21.478986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352cb37-adcf-42b1-bca2-c71373246b21 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:21.495236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:21.496166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:21.496600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:21.497054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:21.500174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:21.535670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:21.535670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7e67-3ba6-4aee-9a4d-bfffed3ee23e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:21.552679 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2739/5458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:24.040992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:24.042581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:24.070779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a194ed3-90de-461c-af31-e9a5f36a9ee8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:24.084321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:24.084975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:24.085255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:24.085556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] PATH_INFO: `/v3/users/39ba6fc79af84b0b8c95acde0d206491` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:24.087739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ba6fc79af84b0b8c95acde0d206491)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:24.091646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:24.221939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ba6fc79af84b0b8c95acde0d206491'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:24.223092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ba6fc79af84b0b8c95acde0d206491'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:24.243329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ba6fc79af84b0b8c95acde0d206491'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:24.280626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ba6fc79af84b0b8c95acde0d206491'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:24.281447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ba6fc79af84b0b8c95acde0d206491'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:24.308627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2720/5459] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:24 2022] DELETE /identity/v3/users/39ba6fc79af84b0b8c95acde0d206491 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:24.314780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a69e-984c-4a07-a5eb-c1fae3324fca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:24.315945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a69e-984c-4a07-a5eb-c1fae3324fca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:24.316548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a69e-984c-4a07-a5eb-c1fae3324fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:24.358929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-58a1a69e-984c-4a07-a5eb-c1fae3324fca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:24.368907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58a1a69e-984c-4a07-a5eb-c1fae3324fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:24.475504 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:24.550778 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2740/5460] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:24.563064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:24.565087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:24.629715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:24.630204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:24.631428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:24.688745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:24.690035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:24.705173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedd5-8a87-4dc3-92e0-2488973c6bbf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:24.746953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:24.753597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:24.754321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:24.754321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:24.809579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:24.817698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:24.858306 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2721/5461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:24.916512 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2741/5462] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:24.931687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:24.935969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:24.979241 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:25.071815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1d2c-bb5c-4e6d-a13d-b28bc978fd8a service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:25.098638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:25.099364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:25.099730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:25.100101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:25.126616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:25.131676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:25.160604 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2722/5463] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:26.186851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:26.188886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:26.222267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ba4bf-2103-4dd2-b9da-548f0e22ad08 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:26.252436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:26.254479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:26.257529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:26.265656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] PATH_INFO: `/v3/projects/073892eaf52c485783cd37e526d1a757` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:26.269778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=073892eaf52c485783cd37e526d1a757)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:26.280243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:26.476253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073892eaf52c485783cd37e526d1a757', 'request_id': 'req-85ed46eb-11e2-48e8-8a61-11e773f45f3d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:26.510158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073892eaf52c485783cd37e526d1a757', 'request_id': 'req-85ed46eb-11e2-48e8-8a61-11e773f45f3d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:26.530244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073892eaf52c485783cd37e526d1a757', 'request_id': 'req-85ed46eb-11e2-48e8-8a61-11e773f45f3d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:26.556764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] The token cache is being invalidate because project 073892eaf52c485783cd37e526d1a757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:26.557324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:26.559778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:26.565118 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2742/5464] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:26 2022] DELETE /identity/v3/projects/073892eaf52c485783cd37e526d1a757 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:26.569073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:26.593624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8944a-7a3b-481c-8345-faf22fcfa5a3 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:26.822534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:26.823075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:26.823452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:26.823628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] PATH_INFO: `/v3/users/e459b8d81fa14816b913d834def70f8e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:26.850208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e459b8d81fa14816b913d834def70f8e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:26.855541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:27.029393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e459b8d81fa14816b913d834def70f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.030726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e459b8d81fa14816b913d834def70f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.066205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e459b8d81fa14816b913d834def70f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.109749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e459b8d81fa14816b913d834def70f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.112012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e459b8d81fa14816b913d834def70f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.152890 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2723/5465] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:26 2022] DELETE /identity/v3/users/e459b8d81fa14816b913d834def70f8e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:27.550788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:27.554018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:27.566354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:27.568094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:27.616213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed46eb-11e2-48e8-8a61-11e773f45f3d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:27.651641 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:27.810084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:27.811439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:27.811818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:27.812120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] PATH_INFO: `/v3/users/d37e243ab8cf43ffae620d23215d496b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:27.813694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37e243ab8cf43ffae620d23215d496b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:27.816362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf7713-7814-4dde-96c3-ad337be6be31 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:27.817061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:27.825424 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:27.849091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:27.850193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:27.850717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:27.851230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] PATH_INFO: `/v3/projects/77a942d164d04f2194bf4e0d01a1f768` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:27.854946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a942d164d04f2194bf4e0d01a1f768)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:27.863335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:27.971373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37e243ab8cf43ffae620d23215d496b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.989468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a942d164d04f2194bf4e0d01a1f768', 'request_id': 'req-a4bac595-48d8-4569-b424-b2ff7d60a792'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:27.991500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37e243ab8cf43ffae620d23215d496b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.001096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a942d164d04f2194bf4e0d01a1f768', 'request_id': 'req-a4bac595-48d8-4569-b424-b2ff7d60a792'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.034570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37e243ab8cf43ffae620d23215d496b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.035353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37e243ab8cf43ffae620d23215d496b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.036201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-713d46f4-64a4-4327-89be-e49bc3cc4ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37e243ab8cf43ffae620d23215d496b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.074032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a942d164d04f2194bf4e0d01a1f768', 'request_id': 'req-a4bac595-48d8-4569-b424-b2ff7d60a792'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.075269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2743/5466] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:27 2022] DELETE /identity/v3/users/d37e243ab8cf43ffae620d23215d496b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:28.138263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] The token cache is being invalidate because project 77a942d164d04f2194bf4e0d01a1f768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:28.139635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.145156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4bac595-48d8-4569-b424-b2ff7d60a792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:28.159732 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2724/5467] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:27 2022] DELETE /identity/v3/projects/77a942d164d04f2194bf4e0d01a1f768 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:28.164514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.164815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.165117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.223588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:28.224763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:28.402511 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2744/5468] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:28.413590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.413882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.414159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.461931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:28.463217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:28.476300 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2725/5469] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:28.483206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:28.505896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7cfe-f60d-476e-8d93-65f7a5b826fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:28.525307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:28.526127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.526309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.526543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.527234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:28.527540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:28.530141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:28.564919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:28.570166 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2745/5470] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:22:28.577848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60ce27-3ee6-458a-abcb-a3f12307eeb2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:28.593890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:28.594533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.594815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.595087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.595734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:28.614721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:28.727905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2726/5471] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:28 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:28.729066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:28.744062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ed54-e063-4d10-8cb4-186a11e1a9fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:28.908210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:28.910861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:28.922149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:28.923045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.923618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.924072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.924888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:28.929527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:28.946130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fcca0-987c-4bb5-b313-8f64ac893b65 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:28.975124 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:28.975359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:28.976171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:28.976643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:28.977085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] PATH_INFO: `/v3/projects/cc36a1f6ad32416e93ab335e5dcef9a6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:28.981025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc36a1f6ad32416e93ab335e5dcef9a6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:28.984462 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2746/5472] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:28 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:28.988737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:28.988937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.012546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0730132-8eaa-46f5-a44e-2197eeb1de95 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:29.027747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:29.028645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.029087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.029781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.030828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:29.032648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:29.051302 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2747/5473] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:29.056373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.078422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e565-1606-4747-a2cf-cd96d4a46a8c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:29.098031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:29.099154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.100407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.100984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.102019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:29.104100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:29.130911 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2748/5474] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:29.132481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.157190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350dd66-7970-49bb-9ffb-6582c20e8d89 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:29.182616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'request_id': 'req-210cb890-da80-4cd5-b5fe-e479048e9e08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:29.211220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'request_id': 'req-210cb890-da80-4cd5-b5fe-e479048e9e08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:29.238513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'request_id': 'req-210cb890-da80-4cd5-b5fe-e479048e9e08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:29.285309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] The token cache is being invalidate because project cc36a1f6ad32416e93ab335e5dcef9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:29.286555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:29.288446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-210cb890-da80-4cd5-b5fe-e479048e9e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:29.299468 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2727/5475] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:28 2022] DELETE /identity/v3/projects/cc36a1f6ad32416e93ab335e5dcef9a6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:29.301890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf23f-684e-48fd-9c43-ac0a72c79167 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.302185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf23f-684e-48fd-9c43-ac0a72c79167 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.302535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf23f-684e-48fd-9c43-ac0a72c79167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.307026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:29.308036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.308557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.309046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] PATH_INFO: `/v3/projects/953bbd3878e74add83dd281bea3d6a93/users/dda33440a14f49d1847ca7c7c37ce78e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.365933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=953bbd3878e74add83dd281bea3d6a93, user_id=dda33440a14f49d1847ca7c7c37ce78e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:29.368330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-40bdf23f-684e-48fd-9c43-ac0a72c79167 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:29.371940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-40bdf23f-684e-48fd-9c43-ac0a72c79167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:29.373988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803129fb-98cf-4bb2-8e36-b5099ce78f0e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:29.394729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2749/5476] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:29 2022] PUT /identity/v3/projects/953bbd3878e74add83dd281bea3d6a93/users/dda33440a14f49d1847ca7c7c37ce78e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:29.397544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2728/5477] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:29.422996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.423341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.423600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.503319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.503629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.503909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.513036 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:29.552117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:29.553976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:29.623490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] MFA Rules not processed for user `dda33440a14f49d1847ca7c7c37ce78e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:29.630193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:29.839352 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2729/5478] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:29.845248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.873710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f821b-c3ac-4f4b-9065-56b1ee97afef None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:29.901221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:29.902361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:29.902748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:29.903216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:29.903980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:29.905241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:29.907294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:29.915272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2750/5479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:29.917773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.925954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:29.959082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2730/5480] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:22:29.964456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:29.978566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6e08-c9db-44ea-82c5-4a6a42475bb4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:29.998968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4948-89aa-4ea6-a961-832603e5ec0f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.006282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.007091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.007480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.008592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.010888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.022087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.041215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.042032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.042414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.045223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.046096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.049458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.129907 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2751/5481] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:29 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:30.130106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.170905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2731/5482] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:29 2022] POST /identity/v3/projects => generated 389 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:30.180643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.292976 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:30.402218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a9b4-d285-4bc2-a497-77ad1c50c036 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.421502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064671a-302e-4c45-b89c-6c2864fd6db5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.424806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.425618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.426010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.429568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.431149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.435649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.447612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.448422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.449640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.450055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.454210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.456485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.503875 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2752/5483] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:30 2022] POST /identity/v3/users => generated 291 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:30.510095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.521436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2732/5484] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:30 2022] POST /identity/v3/users => generated 295 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:30.528013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.544537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a2bf1-7eae-451b-bffc-b78a5dee6c7a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.561075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c421ccb-8b02-44e3-8564-1ad20a169daf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.561976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.563324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.567022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.567612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.569481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.572504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.578783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.582161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.585076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.586421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.587430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.594426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.617965 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2753/5485] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:22:30.620252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.637041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2733/5486] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:30.638359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.654069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754bb5-160f-459c-8f96-d3cabf99ef6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.673350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3147-f97a-4fca-8471-4389afb0e76a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.676595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.677748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.679956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.682479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.682479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.684323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.692321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.693089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.693525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.694002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.695686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.706126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.733061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2754/5487] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:30.737255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.759986 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2734/5488] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:30.762827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:30.784131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16c30-a857-4dd6-920e-a6c2c99639f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.794007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16a8a-ec05-4f50-8d25-6577d6dff8ea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:30.802390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.804788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.805553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.806455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] PATH_INFO: `/v3/projects/bc253022917447a3a00237b476ff9838/users/9ec441bd9de9458cae98269a6deccf96/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.813868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:30.821533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.822256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.823394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] PATH_INFO: `/v3/projects/d0c73d4bbb354b0fafd5f5a714f6d4a0/users/0b6b3f79b49c4c13a2fdceba3b60d09f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.860406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc253022917447a3a00237b476ff9838, user_id=9ec441bd9de9458cae98269a6deccf96, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.870132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77bd3c-f28b-4cfe-aeab-2ae229a7b8f9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.883737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c73d4bbb354b0fafd5f5a714f6d4a0, user_id=0b6b3f79b49c4c13a2fdceba3b60d09f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:30.891562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3d9f-4bb5-45fa-9590-2a30907cf1d7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:30.922667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2755/5489] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:30 2022] PUT /identity/v3/projects/bc253022917447a3a00237b476ff9838/users/9ec441bd9de9458cae98269a6deccf96/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:30.933955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.935233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.938324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:30.953901 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2735/5490] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:30 2022] PUT /identity/v3/projects/d0c73d4bbb354b0fafd5f5a714f6d4a0/users/0b6b3f79b49c4c13a2fdceba3b60d09f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:30.955865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:30.956784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:30.957713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:31.020130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:31.026568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:31.043498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] MFA Rules not processed for user `9ec441bd9de9458cae98269a6deccf96`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:31.045124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:31.046885 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:31.276532 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2736/5491] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:31.289617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:31.296254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:31.339542 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2756/5492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:31.344581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:31.409931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d584-3379-4390-a7cb-83f1944140c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:31.450252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:31.451059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:31.451480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:31.451873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:31.452897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:31.459171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:31.588231 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2757/5493] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:31 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:22:31.592419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:31.613784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a721a-dbd1-4015-a5c3-42e80a6872d2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:31.743578 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:31.817030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:31.821225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:31.825393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:31.826007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:31.826218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361a25-13c7-4daf-8043-1f345dc546bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:31.864692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:31.866736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:31.870830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:31.871903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:31.872197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:31.872476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:31.878009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:31.884527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:31.913155 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2737/5494] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:32.008891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2758/5495] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:31 2022] POST /identity/v3/users => generated 298 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:22:32.017586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:32.037360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a159af-6be7-4150-a650-b3390776825a service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:32.063989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:32.064620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:32.065197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:32.065635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:32.066562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:32.068416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:32.119584 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2738/5496] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:32.123691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:32.145060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47370846-4d04-4a95-80bd-fb70efaf0eac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:32.164261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:32.167480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:32.167775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:32.168063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] PATH_INFO: `/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53/users/2d57ebf9d332468e90da1661e2d5f212/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:32.236226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] RBAC: Authorizing `identity:create_grant(project_id=265d1d3834a54f6bb6deaffa13d6fa53, user_id=2d57ebf9d332468e90da1661e2d5f212, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:32.249316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:32.292585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2759/5497] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:32 2022] PUT /identity/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53/users/2d57ebf9d332468e90da1661e2d5f212/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:32.296466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:32.314360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578958b-7d8b-4163-8dcc-9589b32eb2c5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:32.506883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:32.507791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:32.508236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:32.508957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:32.509864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:32.511665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39fee-2e3c-4e24-8934-f79eaaaedd8d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:32.523832 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:32.559789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2739/5498] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:22:32.563725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:32.582221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd1d3-324d-480b-9d7f-eeed487c515c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:32.595113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:32.596144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:32.596738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:32.597089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] PATH_INFO: `/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53/users/2d57ebf9d332468e90da1661e2d5f212/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:32.600782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=265d1d3834a54f6bb6deaffa13d6fa53, user_id=2d57ebf9d332468e90da1661e2d5f212, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:32.609386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:32.654046 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2760/5499] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:32 2022] PUT /identity/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53/users/2d57ebf9d332468e90da1661e2d5f212/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:32.656385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:32.656679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:32.656959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:32.832852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] MFA Rules not processed for user `2d57ebf9d332468e90da1661e2d5f212`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:32.834530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:32.889258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:32.891239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:33.090847 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2740/5500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:33.130299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:33.261100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3256-e0fa-47d4-babc-a9ea7d7e45bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:33.280468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:33.281467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:33.282058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:33.282518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] PATH_INFO: `/v3/users/189aacc7d7834944b299d3d7a4670a82` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:33.286185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] RBAC: Authorizing `identity:delete_user(user_id=189aacc7d7834944b299d3d7a4670a82)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:33.288593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:33.314171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daccab-d0d2-491c-97a6-da1062126049 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:33.327123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:33.327769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:33.328047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:33.328321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:33.532084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189aacc7d7834944b299d3d7a4670a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:33.562445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189aacc7d7834944b299d3d7a4670a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:33.610153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189aacc7d7834944b299d3d7a4670a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:33.620425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189aacc7d7834944b299d3d7a4670a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:33.627000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-655c467d-06a6-4658-93af-3723f5ff566a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189aacc7d7834944b299d3d7a4670a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:33.727858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2761/5501] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:32 2022] DELETE /identity/v3/users/189aacc7d7834944b299d3d7a4670a82 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:33.736112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:33.737719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:33.746026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e96f-69fc-4301-b750-4dcbd9297227 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:33.749012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e96f-69fc-4301-b750-4dcbd9297227 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:33.749301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e96f-69fc-4301-b750-4dcbd9297227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:33.784786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2741/5502] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:22:33.875019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cda7e96f-69fc-4301-b750-4dcbd9297227 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:33.878381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cda7e96f-69fc-4301-b750-4dcbd9297227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:33.899987 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:34.141694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2762/5503] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:34.167531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:34.206092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891482-35f5-4a02-ad03-880e6d949577 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:34.394726 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:34.452468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:34.452886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:34.453188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:34.454887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:34.467832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:34.469653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c99adc-8307-4ad8-a17b-21f27a3533f6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:34.518094 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2742/5504] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:35.880075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:35.880611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:35.880874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:36.004934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] MFA Rules not processed for user `023415a906544acea2a4d54b1717010e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:36.006382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:36.198127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2763/5505] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:36.210230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:36.211137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:36.211676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:36.281473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:36.283122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:36.335531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] MFA Rules not processed for user `023415a906544acea2a4d54b1717010e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:36.337139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:36.345391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ab30-5bd5-408e-960b-f607dfd2d0f4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:36.364206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:36.365226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:36.369921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:36.370378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] PATH_INFO: `/v3/projects/f6aa2e9d05f74492abb0824e53e36a13` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:36.381089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6aa2e9d05f74492abb0824e53e36a13)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:36.381320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2743/5506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:36.381445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:36.395961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:36.397873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:36.630976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6aa2e9d05f74492abb0824e53e36a13', 'request_id': 'req-07ffa625-ac50-40a7-9267-3d6aaf689c96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:36.644884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6aa2e9d05f74492abb0824e53e36a13', 'request_id': 'req-07ffa625-ac50-40a7-9267-3d6aaf689c96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:36.666505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6aa2e9d05f74492abb0824e53e36a13', 'request_id': 'req-07ffa625-ac50-40a7-9267-3d6aaf689c96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:36.689376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] The token cache is being invalidate because project f6aa2e9d05f74492abb0824e53e36a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:36.689847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:36.691713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:36.697149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2764/5507] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:36 2022] DELETE /identity/v3/projects/f6aa2e9d05f74492abb0824e53e36a13 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:36.698291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:36.702382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:36.736774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308aff3-b29e-452f-978d-92836f3f2132 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:36.791287 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:36.905040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa625-ac50-40a7-9267-3d6aaf689c96 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:36.931689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:36.933047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:36.934628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:36.935825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] PATH_INFO: `/v3/users/3908a340c6b645a89320d6364cb6e8de` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:36.940365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3908a340c6b645a89320d6364cb6e8de)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:36.943265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:36.983683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:36.984571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:36.987265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:36.987733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:36.992937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:37.113922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3908a340c6b645a89320d6364cb6e8de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:37.174262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3908a340c6b645a89320d6364cb6e8de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:37.226726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3908a340c6b645a89320d6364cb6e8de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:37.233864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3908a340c6b645a89320d6364cb6e8de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:37.235379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3908a340c6b645a89320d6364cb6e8de'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:37.268914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:37.272721 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2765/5508] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:36 2022] DELETE /identity/v3/users/3908a340c6b645a89320d6364cb6e8de => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:37.295883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555bf77-c2ed-4101-86ce-22f1d8f1854b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:37.338110 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2744/5509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 942 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:38.102335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:38.104437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:38.401126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd733-2203-4aad-9cb5-3c1295c0e764 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:38.434015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:38.434687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:38.441431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:38.441863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] PATH_INFO: `/v3/projects/080757cbc5bc42f08c7ca52da6cc2710` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:38.453426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=080757cbc5bc42f08c7ca52da6cc2710)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:38.467933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:38.641611 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:38.653501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080757cbc5bc42f08c7ca52da6cc2710', 'request_id': 'req-072b1646-0092-4be3-9f39-6d263d80a9fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:38.673469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080757cbc5bc42f08c7ca52da6cc2710', 'request_id': 'req-072b1646-0092-4be3-9f39-6d263d80a9fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:38.683500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080757cbc5bc42f08c7ca52da6cc2710', 'request_id': 'req-072b1646-0092-4be3-9f39-6d263d80a9fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:38.708747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] The token cache is being invalidate because project 080757cbc5bc42f08c7ca52da6cc2710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:22:38.710017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:38.711454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-072b1646-0092-4be3-9f39-6d263d80a9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:22:38.714487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2766/5510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:22:38 2022] DELETE /identity/v3/projects/080757cbc5bc42f08c7ca52da6cc2710 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:38.722328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:38.723231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:38.723231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:38.766289 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:38.787174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:38.791300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:38.994850 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2745/5511] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:39.002442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.002891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.003271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.043589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:39.052731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:39.101999 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2767/5512] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:39.106328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.118153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd98db-fb1a-45dc-93b5-b5f7b6c56b12 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.130546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.131184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.131458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.131938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.132755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:22:39.133214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.135017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.169290 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2746/5513] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:22:39.174436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.196857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0c7f-e4d3-409b-81c4-9a8cf634a5c4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.211253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.212482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.212982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.214268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.218545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.221378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.316424 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2768/5514] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:39 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:39.320889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.342131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19dfb-dedb-4362-9808-ded81d4ddde6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.528338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.529798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.530573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.530956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.531716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.536589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.589054 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2747/5515] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:39 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:39.593696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.610917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59caf0-396e-4027-9943-eb78cbf427b8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.625095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.625884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.626271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.626752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.628006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.629915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.668231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.674751 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2769/5516] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:39.695415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a43b-9154-4fbb-b870-a39637d387e6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.711182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.712592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.712990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.713381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.714152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.716433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ccb70-44dd-42a9-b69a-3623c0a5dcc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.745885 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2748/5517] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:22:39.750504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:39.773574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644bdd-f649-4b44-ad70-b408985980ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:39.790262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:39.791534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.791833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.792105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] PATH_INFO: `/v3/projects/4fccbd1e1ede456bbb6a794b97d5ae5b/users/4d7862ce5b694f3eb4f0b9c6d7b9d11d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.829488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fccbd1e1ede456bbb6a794b97d5ae5b, user_id=4d7862ce5b694f3eb4f0b9c6d7b9d11d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:39.832622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:39.855028 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2770/5518] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:39 2022] PUT /identity/v3/projects/4fccbd1e1ede456bbb6a794b97d5ae5b/users/4d7862ce5b694f3eb4f0b9c6d7b9d11d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:39.867608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:39.867906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:39.868180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:39.936567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] MFA Rules not processed for user `4d7862ce5b694f3eb4f0b9c6d7b9d11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:39.937888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:40.142274 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2749/5519] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:22:40.147330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:40.338951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854039-469f-4e58-9988-fd96657b5feb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:40.351554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:40.352508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:40.353038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:40.356603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:40.359357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:40.362275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:40.451298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2771/5520] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:40 2022] POST /identity/v3/projects => generated 387 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:40.455916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:40.474378 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:40.497255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f43c1-0366-4f31-8128-74bfb01b53f1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:40.692087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:40.707049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:40.708048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:40.708332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:40.709039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:40.711133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:40.799226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2750/5521] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:40 2022] POST /identity/v3/users => generated 294 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:40.803618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:40.820550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d3a2-ac84-42a5-a3d1-a5e36bc1311e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:40.833185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:40.835470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:40.837636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:40.837990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:40.839073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:40.844676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:40.880308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2772/5522] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:40.882741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:40.895970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7178-4111-4d13-9554-93027fc4ed14 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:40.917973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:40.918607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:40.919138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:40.920495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:40.921364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:40.924594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f97217-0284-4be2-95f1-099e50f41407 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:40.955300 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2751/5523] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:40.956238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:40.980407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ecc3a-e629-4120-9cfa-db52188a2a7f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:41.004656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:41.006356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:41.008601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:41.009654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] PATH_INFO: `/v3/projects/acbfeb9f6d5747d9a427be1f5d6a0aa2/users/873cab605d694af2a5b025ad588060cc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:41.063622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbfeb9f6d5747d9a427be1f5d6a0aa2, user_id=873cab605d694af2a5b025ad588060cc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:41.072707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:41.120195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2773/5524] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:40 2022] PUT /identity/v3/projects/acbfeb9f6d5747d9a427be1f5d6a0aa2/users/873cab605d694af2a5b025ad588060cc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:41.130410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:41.131315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:41.132001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:41.240841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] MFA Rules not processed for user `873cab605d694af2a5b025ad588060cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:41.243907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:41.448360 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2752/5525] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:41.450319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:41.506697 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:41.663039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbc8d-9f6f-405b-b9ce-1f1d1190167f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:41.691522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:41.692061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:41.692346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:41.692619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:41.693268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:41.703397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:41.807131 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2774/5526] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:22:41 2022] POST /identity/v3/projects => generated 387 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:41.808280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:41.829921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421be075-d1e0-484a-adcf-b234ff28c2fa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:42.051264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:42.052050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:42.052485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:42.052867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:42.056233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:42.066468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:42.110815 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:42.132565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2753/5527] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:22:41 2022] POST /identity/v3/users => generated 300 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:22:42.137800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:42.184958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1f5a-71b3-4571-912f-912806cd5ad5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:42.201622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:42.202467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:42.206367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:42.207097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:42.208125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:42.211103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:42.273201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:42.284134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2775/5528] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:42.297026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9378-4d27-4d1d-9416-3673a99821f2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:42.310668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:42.311930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:42.312428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:42.313009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] PATH_INFO: `/v3/projects/37c094d17e1f4eaf816d972dd3df1d51/users/afd69307ebb445a89d5e2e63b60cb211/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:42.398514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c094d17e1f4eaf816d972dd3df1d51, user_id=afd69307ebb445a89d5e2e63b60cb211, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:42.429216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:42.485727 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2754/5529] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:42 2022] PUT /identity/v3/projects/37c094d17e1f4eaf816d972dd3df1d51/users/afd69307ebb445a89d5e2e63b60cb211/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:22:42.490296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:42.509818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d1b10-f8e1-4c77-996f-bc8907dcc42b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:42.842979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:42.843609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:42.843896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:42.844258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:42.844976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:42.846642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa4a7-100a-4b29-8211-7ea9ce1c593d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:42.889305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2776/5530] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:22:42.892204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:42.910581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e0e1-0df3-4208-bcd4-cab65c44d97b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:42.937615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:42.938469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:42.938791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:42.939194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] PATH_INFO: `/v3/projects/37c094d17e1f4eaf816d972dd3df1d51/users/afd69307ebb445a89d5e2e63b60cb211/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:42.950471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c094d17e1f4eaf816d972dd3df1d51, user_id=afd69307ebb445a89d5e2e63b60cb211, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:42.956147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:43.005315 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2755/5531] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:22:42 2022] PUT /identity/v3/projects/37c094d17e1f4eaf816d972dd3df1d51/users/afd69307ebb445a89d5e2e63b60cb211/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:22:43.016508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:43.017079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:43.017622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:43.198088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] MFA Rules not processed for user `afd69307ebb445a89d5e2e63b60cb211`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:43.199711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:43.553783 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2777/5532] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:43.565631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:43.567892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:43.752983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d3d6-fecd-4b34-9815-27ef39d483f7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:43.766108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:43.767211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:43.768664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:43.769065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:43.802646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:43.805856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:43.837543 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2756/5533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:22:45.658672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:45.660389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:45.681911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ad149-35eb-4009-abed-d567516f9dca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:45.697132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:45.697827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:45.698110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:45.698466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:45.728951 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:45.847328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:45.848819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf91583-61cd-4c70-b113-20cfc9caa28b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:45.882372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2778/5534] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:46.600157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:46.601915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:46.789141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef97c-4316-4fed-ba9b-02e97c789624 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:46.802537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:46.803981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:46.804272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:46.806781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:46.815419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:46.876491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed96c-cb25-431e-930e-04bb93f7a8e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:46.877066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed96c-cb25-431e-930e-04bb93f7a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:46.877066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed96c-cb25-431e-930e-04bb93f7a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:46.947183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-37aed96c-cb25-431e-930e-04bb93f7a8e1 None None] MFA Rules not processed for user `2f080bae0ec94a5b88128dd69c8a3e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:46.948464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-37aed96c-cb25-431e-930e-04bb93f7a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:47.010966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:47.013960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:47.053357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2779/5535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:47.066112 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2757/5536] 10.222.0.16 () {60 vars in 1396 bytes} [Sun Sep 25 01:22:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:50.848147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:50.848682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:50.848682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:50.878148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:50.879868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:51.112311 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2780/5537] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:51.135763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:51.135763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:51.176411 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:51.289995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacf43-82fc-4fa1-a946-8c725a2f1631 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:51.305891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:51.306875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:51.307346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:51.307805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:51.317937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:51.320017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:51.331878 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2758/5538] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:22:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:51.339112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:51.383945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207120a-df87-467d-832c-851f9fdc2b6b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:51.395078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:51.397938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:51.398480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:51.398953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:51.408949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:51.620124 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:51.634289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:51.635758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ee18-a920-418a-bbdc-6cdd97c7e9e7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:51.676928 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2781/5539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:52.874935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:52.876607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:52.906776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffaf-c2d0-46c6-ae01-73c0b18ca737 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:52.913933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:52.919694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:52.920387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:52.920778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:52.924683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:53.014566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:53.016767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:53.034116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2759/5540] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:54.778756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:54.779306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:54.779906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:54.828588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:22:54.846644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:54.961725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2782/5541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:22:55.239816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:55.251425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb5c2-5a4f-4db9-8f08-e6880da0db7a service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:55.255285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:55.255981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:55.256333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:55.256832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:55.327769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:55.329353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:55.340645 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2760/5542] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:59.284067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:59.302020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e95d-9211-420e-bdf5-665e62e31c50 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:22:59.308268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:22:59.310475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:22:59.311129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:22:59.311734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:22:59.313821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:22:59.411787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:22:59.413749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bffe4-99a2-4a22-aa10-f60aef8c4b45 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:22:59.441838 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2783/5543] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:22:59.971406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:22:59.978856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:00.009198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557d1b2-9d61-4f80-9464-e1449653ca79 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:00.026670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:00.027340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.027628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.027912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] PATH_INFO: `/v3/users/c9035edc30954d749d5c70f004a018b3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.032463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9035edc30954d749d5c70f004a018b3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:00.034757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:00.120878 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:00.144764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9035edc30954d749d5c70f004a018b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.145494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9035edc30954d749d5c70f004a018b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.167141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9035edc30954d749d5c70f004a018b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.237249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9035edc30954d749d5c70f004a018b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.238078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9035edc30954d749d5c70f004a018b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.261088 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2761/5544] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:22:59 2022] DELETE /identity/v3/users/c9035edc30954d749d5c70f004a018b3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:00.265887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.266249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.266613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.309058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:00.313551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:00.488660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2784/5545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:00.538161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:00.539559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:00.551838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:00.554176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:00.602494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8cdd4-c381-47f4-9ed9-f55e2171dfe5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:00.630840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:00.632824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.634023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.635096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] PATH_INFO: `/v3/users/4d7862ce5b694f3eb4f0b9c6d7b9d11d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.639422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7862ce5b694f3eb4f0b9c6d7b9d11d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:00.641692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:00.708424 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:00.744436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1fc2-6250-448a-aca7-e04d3981da43 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:00.750909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:00.751584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.751992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.752874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.765442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7862ce5b694f3eb4f0b9c6d7b9d11d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.765824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:00.766269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7862ce5b694f3eb4f0b9c6d7b9d11d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.767777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22445-a274-4856-9a76-6b0cd8fa5d51 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:00.782218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7862ce5b694f3eb4f0b9c6d7b9d11d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.800948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7862ce5b694f3eb4f0b9c6d7b9d11d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.802392 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2785/5546] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:00.802586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31f12b55-403d-433d-9422-628e8fc43a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7862ce5b694f3eb4f0b9c6d7b9d11d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:00.826226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2762/5547] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:00 2022] DELETE /identity/v3/users/4d7862ce5b694f3eb4f0b9c6d7b9d11d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:00.830703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.831091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.831458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.877543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:00.879510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:00.909069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6f99-44dc-46af-915e-de6c4fe14adf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:00.909848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6f99-44dc-46af-915e-de6c4fe14adf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:00.910366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6f99-44dc-46af-915e-de6c4fe14adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:00.953630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a8e6f99-44dc-46af-915e-de6c4fe14adf None None] MFA Rules not processed for user `0b6b3f79b49c4c13a2fdceba3b60d09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:00.959269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a8e6f99-44dc-46af-915e-de6c4fe14adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:01.054566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2786/5548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:01.067584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:01.069030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:01.081771 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2763/5549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:01.094614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:01.095160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:01.095499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:01.125768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] MFA Rules not processed for user `0b6b3f79b49c4c13a2fdceba3b60d09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:01.126797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:01.137913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2764/5550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:01.151345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:01.152822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:01.163259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442a6c7-5be9-4ccf-9847-05d3d8d6b2ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:01.167475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:01.168362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:01.168879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:01.170282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:01.170989 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:01.187383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:01.190322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:01.203840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2787/5551] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:01.262193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f1cf7-e368-42d6-b2f5-de54eb115ab2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:01.270282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:01.271253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:01.271801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:01.272070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:01.284853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:01.288529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:01.305328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2765/5552] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:01.922430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:01.923896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:01.939282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d529-479d-4a3d-8e8e-93d139855c45 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:01.944683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:01.945328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:01.945643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:01.945985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] PATH_INFO: `/v3/projects/4fccbd1e1ede456bbb6a794b97d5ae5b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:01.947058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fccbd1e1ede456bbb6a794b97d5ae5b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:01.949072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:02.013754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fccbd1e1ede456bbb6a794b97d5ae5b', 'request_id': 'req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.022016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fccbd1e1ede456bbb6a794b97d5ae5b', 'request_id': 'req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.034590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fccbd1e1ede456bbb6a794b97d5ae5b', 'request_id': 'req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.058653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] The token cache is being invalidate because project 4fccbd1e1ede456bbb6a794b97d5ae5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:02.058963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.059802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.062080 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2788/5553] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:01 2022] DELETE /identity/v3/projects/4fccbd1e1ede456bbb6a794b97d5ae5b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:02.065915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:02.088426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c575-5c35-43ee-9734-cf8bf8100119 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:02.282338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:02.284658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:02.297588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:02.298989 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:02.299686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:02.300314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:02.300743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] PATH_INFO: `/v3/users/873cab605d694af2a5b025ad588060cc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:02.302733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=873cab605d694af2a5b025ad588060cc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:02.306356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:02.446297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b591d-e7a4-43bc-9adb-fa20575b83e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:02.455388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873cab605d694af2a5b025ad588060cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.456496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873cab605d694af2a5b025ad588060cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.467280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873cab605d694af2a5b025ad588060cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.468888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:02.471486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:02.473791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:02.474079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] PATH_INFO: `/v3/projects/07da64bac2374cb198fd4fe19579fbfc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:02.476362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07da64bac2374cb198fd4fe19579fbfc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:02.484836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873cab605d694af2a5b025ad588060cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.485702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:02.486142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873cab605d694af2a5b025ad588060cc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.512084 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2766/5554] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:02 2022] DELETE /identity/v3/users/873cab605d694af2a5b025ad588060cc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:02.588047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07da64bac2374cb198fd4fe19579fbfc', 'request_id': 'req-379be447-4b06-47e9-89f8-878d9b0d75f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.598702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07da64bac2374cb198fd4fe19579fbfc', 'request_id': 'req-379be447-4b06-47e9-89f8-878d9b0d75f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.608286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07da64bac2374cb198fd4fe19579fbfc', 'request_id': 'req-379be447-4b06-47e9-89f8-878d9b0d75f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.649482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] The token cache is being invalidate because project 07da64bac2374cb198fd4fe19579fbfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:02.650042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.651230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.653464 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2789/5555] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:02 2022] DELETE /identity/v3/projects/07da64bac2374cb198fd4fe19579fbfc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:02.657842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:02.659619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:02.693217 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:02.772669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b455-dca7-47a8-8a5f-b23ef75cd95b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:02.847120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:02.848575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:02.849050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:02.849529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] PATH_INFO: `/v3/users/0146dcaa053046538ea351b3e0c6a186` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:02.850841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0146dcaa053046538ea351b3e0c6a186)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:02.853232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:02.953491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0146dcaa053046538ea351b3e0c6a186'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.954867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0146dcaa053046538ea351b3e0c6a186'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:02.973989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0146dcaa053046538ea351b3e0c6a186'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.016804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0146dcaa053046538ea351b3e0c6a186'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.018095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0146dcaa053046538ea351b3e0c6a186'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.042678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2767/5556] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:02 2022] DELETE /identity/v3/users/0146dcaa053046538ea351b3e0c6a186 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:03.049587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:03.052091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:03.095820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379be447-4b06-47e9-89f8-878d9b0d75f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:03.252127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:03.252926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:03.253218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:03.253842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] PATH_INFO: `/v3/projects/acbfeb9f6d5747d9a427be1f5d6a0aa2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:03.255194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbfeb9f6d5747d9a427be1f5d6a0aa2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:03.257722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:03.361651 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:03.374829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbfeb9f6d5747d9a427be1f5d6a0aa2', 'request_id': 'req-a13f1ee8-9ce3-4959-acac-24a84090d02c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.384290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbfeb9f6d5747d9a427be1f5d6a0aa2', 'request_id': 'req-a13f1ee8-9ce3-4959-acac-24a84090d02c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.416592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbfeb9f6d5747d9a427be1f5d6a0aa2', 'request_id': 'req-a13f1ee8-9ce3-4959-acac-24a84090d02c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.443771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] The token cache is being invalidate because project acbfeb9f6d5747d9a427be1f5d6a0aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:03.444089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.446636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.449467 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2790/5557] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:03 2022] DELETE /identity/v3/projects/acbfeb9f6d5747d9a427be1f5d6a0aa2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:03.454777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:03.457770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:03.483229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdc53-0826-4ce8-93b8-3ee1a715661c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:03.554275 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:03.597335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:03.598172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:03.598452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:03.598726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] PATH_INFO: `/v3/users/afd69307ebb445a89d5e2e63b60cb211` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:03.599885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd69307ebb445a89d5e2e63b60cb211)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:03.611564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:03.712230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd69307ebb445a89d5e2e63b60cb211'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.713769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd69307ebb445a89d5e2e63b60cb211'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.738001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd69307ebb445a89d5e2e63b60cb211'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.764857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd69307ebb445a89d5e2e63b60cb211'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.767233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-578ab326-038a-4561-b306-3c0e9863f74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd69307ebb445a89d5e2e63b60cb211'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:03.823838 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2768/5558] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:03 2022] DELETE /identity/v3/users/afd69307ebb445a89d5e2e63b60cb211 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:04.192341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:04.194034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:04.227635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f1ee8-9ce3-4959-acac-24a84090d02c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:04.370840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:04.371679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:04.372142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:04.374014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] PATH_INFO: `/v3/projects/7d804db97c174dee932a39d3b51cf60c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:04.377370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d804db97c174dee932a39d3b51cf60c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:04.379345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:04.496333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d804db97c174dee932a39d3b51cf60c', 'request_id': 'req-1f28b491-27ea-4d3c-9630-741f5cc8f427'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:04.516650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d804db97c174dee932a39d3b51cf60c', 'request_id': 'req-1f28b491-27ea-4d3c-9630-741f5cc8f427'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:04.542743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d804db97c174dee932a39d3b51cf60c', 'request_id': 'req-1f28b491-27ea-4d3c-9630-741f5cc8f427'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:04.577214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] The token cache is being invalidate because project 7d804db97c174dee932a39d3b51cf60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:04.577533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:04.579376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1f28b491-27ea-4d3c-9630-741f5cc8f427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:04.584939 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2791/5559] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:04 2022] DELETE /identity/v3/projects/7d804db97c174dee932a39d3b51cf60c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:04.590844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:04.591914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:04.592279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:04.646327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:04.649296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:04.849079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2769/5560] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:04.861776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:04.862398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:04.863408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:04.898834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:04.900686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:04.916094 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2792/5561] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:04.918096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:04.933363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489c1f2-6662-4896-8280-fcc1211a9d9d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:04.949717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:04.950899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:04.951384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:04.951848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:04.952514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:04.952817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:04.954462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:04.979174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2770/5562] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:04.984499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:05.000174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a60e-5761-40a5-976a-4ac4beccb472 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:05.010007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:05.010972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.011388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.013644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.013935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:05.019484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:05.087473 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2793/5563] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:04 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:05.088518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:05.101991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e6e3-c8eb-49ae-93c7-4e00d6dad719 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:05.198572 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:05.233112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:05.233802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.234153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.234558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.236379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:05.238960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:05.297103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2771/5564] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:05 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:05.300330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:05.336574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55f01-7e74-4407-8409-491200e558a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:05.365001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:05.365846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.366278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.367257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.369518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:05.376564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:05.406568 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2794/5565] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:05.410611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:05.436433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4bf7e-49a4-45b0-b44b-80829e72311c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:05.451961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:05.452656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.452941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.453668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.462254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:05.464478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46c9a-a1a8-45ce-bbb3-74d3a08ceeed admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:05.497651 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2772/5566] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:05.501345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:05.524690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff480394-1b54-4d8a-be31-305ce1614665 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:05.538470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:05.539439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.539703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.541199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] PATH_INFO: `/v3/projects/23809750555c4833995dcc11499fa523/users/f33ca9c1d1bd4d8dbc768c1746d42e25/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.586258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23809750555c4833995dcc11499fa523, user_id=f33ca9c1d1bd4d8dbc768c1746d42e25, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:05.593803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:05.601257 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:05.649793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2795/5567] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:05 2022] PUT /identity/v3/projects/23809750555c4833995dcc11499fa523/users/f33ca9c1d1bd4d8dbc768c1746d42e25/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:05.748882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:05.749490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:05.750089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:05.821001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] MFA Rules not processed for user `f33ca9c1d1bd4d8dbc768c1746d42e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:05.832598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:06.220060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2773/5568] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:06.222025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:06.466793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2266bd-ac02-4678-8a01-65de3213d1a8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:06.483237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:06.484116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:06.484631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:06.485095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:06.486987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:06.493658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:06.567060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2796/5569] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:06 2022] POST /identity/v3/projects => generated 375 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:06.569667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:06.589114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe110-4109-438c-b9e0-d06f20e06626 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:06.712459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:06.713221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:06.713654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:06.713991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:06.717783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:06.720511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:06.775565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2774/5570] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:06 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:06.778542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:06.790669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37067e-01fe-43f9-9858-bb820ccbe8dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:06.802549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:06.804093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:06.804664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:06.805148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:06.805989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:06.808923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:06.827450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2797/5571] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:06.836675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:06.849444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:06.853242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b02b9f-497e-43bb-9934-db52aa0551f4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:06.854704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:06.866985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:06.868225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:06.869439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:06.869875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] PATH_INFO: `/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e/users/bd65e7409e8340d2a5f2fd6b515a8909/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:06.892253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad111ca-82ee-4954-a939-0644deedef9a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:06.907160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:06.910200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:06.911200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:06.911505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] PATH_INFO: `/v3/projects/37c094d17e1f4eaf816d972dd3df1d51` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:06.916202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c094d17e1f4eaf816d972dd3df1d51)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:06.923491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7f4992b1bf407d9c0f68282a58e86e, user_id=bd65e7409e8340d2a5f2fd6b515a8909, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:06.926080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:06.930719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:06.966341 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2775/5572] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:06 2022] PUT /identity/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e/users/bd65e7409e8340d2a5f2fd6b515a8909/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:06.970717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:07.054772 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:07.090164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c094d17e1f4eaf816d972dd3df1d51', 'request_id': 'req-75a21ed2-ca07-49d6-adf5-d28ca615131d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:07.102414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c094d17e1f4eaf816d972dd3df1d51', 'request_id': 'req-75a21ed2-ca07-49d6-adf5-d28ca615131d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:07.114217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c094d17e1f4eaf816d972dd3df1d51', 'request_id': 'req-75a21ed2-ca07-49d6-adf5-d28ca615131d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:07.138697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] The token cache is being invalidate because project 37c094d17e1f4eaf816d972dd3df1d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:07.138938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:07.140386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-75a21ed2-ca07-49d6-adf5-d28ca615131d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:07.149599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2798/5573] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:06 2022] DELETE /identity/v3/projects/37c094d17e1f4eaf816d972dd3df1d51 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:07.151085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52a55-6dbf-4863-b689-5d0f603d7bd7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.152859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52a55-6dbf-4863-b689-5d0f603d7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.155194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52a55-6dbf-4863-b689-5d0f603d7bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.158107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6d213-fa1f-4bb9-9ed5-fc8c12d95bc8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:07.218291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bcc52a55-6dbf-4863-b689-5d0f603d7bd7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:07.219611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bcc52a55-6dbf-4863-b689-5d0f603d7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:07.339791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:07.342860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.344645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.344936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.347197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:07.352788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:07.376851 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:07.406772 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2776/5574] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:07.407810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:07.413742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:07.457422 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2799/5575] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:07.459031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.459310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.462136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.484194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413b3f-9b3b-4a68-9a19-3503b53a6080 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:07.499981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:07.500767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.501124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.501523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] PATH_INFO: `/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e/users/bd65e7409e8340d2a5f2fd6b515a8909/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.506161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7f4992b1bf407d9c0f68282a58e86e, user_id=bd65e7409e8340d2a5f2fd6b515a8909, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:07.517716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01fcb-da77-4e76-8f51-56a027154cac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:07.547565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:07.552016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:07.555827 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2777/5576] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:07 2022] PUT /identity/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e/users/bd65e7409e8340d2a5f2fd6b515a8909/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:07.567835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212866-3fef-4a68-8678-733b20a9e020 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.568335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212866-3fef-4a68-8678-733b20a9e020 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.568795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212866-3fef-4a68-8678-733b20a9e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.643748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-52212866-3fef-4a68-8678-733b20a9e020 None None] MFA Rules not processed for user `bd65e7409e8340d2a5f2fd6b515a8909`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:07.646923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-52212866-3fef-4a68-8678-733b20a9e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:07.697106 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2800/5577] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:07.706286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:07.733439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88e05b-c9ff-4024-8e2e-13860f4e871c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:07.767817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:07.768453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.768738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.769018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.772844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:07.773008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:07.774627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:07.807594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2801/5578] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:07.809104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:07.833998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f666-0ed4-4029-b7d9-a222f2a19d62 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:07.843114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:07.846218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.846522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.846806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.854373 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2778/5579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:07.860286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:07.862299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:07.867509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:07.868002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:07.868272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:07.905383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] MFA Rules not processed for user `f33ca9c1d1bd4d8dbc768c1746d42e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:07.906692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:07.950838 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2802/5580] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/projects => generated 401 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:07.954757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:07.967368 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:07.999469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2779/5581] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:08.183713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5e3f-097e-4a61-98c6-79941c8cd57e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:08.201321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:08.202210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.202331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.202535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.203927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:08.205948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:08.268261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2803/5582] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:07 2022] POST /identity/v3/users => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:08.273260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:08.307498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d0f0d-45f6-49de-a9f3-68e32c564f4e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:08.315505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:08.315769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.316108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.316378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.317026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:08.318762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:08.345370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2780/5583] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:08.345721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:08.346362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:08.347618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:08.377168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c868e1-cc0d-4fd5-b0ce-fb0be021986f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:08.396776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:08.397551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.397727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.398004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.410337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:08.414421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:08.456183 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2781/5584] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:08.464095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:08.492490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb27a-ae15-4a19-99d3-63c7db1cf8a9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:08.506301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:08.506913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.507465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.507465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] PATH_INFO: `/v3/projects/8dd36f321e414bb880624329223ddf1c/users/69a3eaf35e17453caf8150401a4b0775/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.518790 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:08.553758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd36f321e414bb880624329223ddf1c, user_id=69a3eaf35e17453caf8150401a4b0775, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:08.559741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95babfca-b5e5-4e8c-b913-c7de11b46cfb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:08.577587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7478a6-a934-4b0b-bc78-13cfed7143fc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:08.593127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2782/5585] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:08 2022] PUT /identity/v3/projects/8dd36f321e414bb880624329223ddf1c/users/69a3eaf35e17453caf8150401a4b0775/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:08.597906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:08.598615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.598900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.599177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.601662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:08.605144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:08.605452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:08.605738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:08.705769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] MFA Rules not processed for user `69a3eaf35e17453caf8150401a4b0775`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:08.710261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:08.719133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:08.721848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:08.751359 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2804/5586] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:08.880053 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2783/5587] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:08.884235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:08.897746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737375a-44e8-4924-84c7-74027c0627ed service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.058116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.058746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.059026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.059358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.060050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.062336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.107532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2805/5588] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:08 2022] POST /identity/v3/projects => generated 401 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:09.115045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.131910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b082ef9-0739-4cfd-9e94-7d25c02454b8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.264977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.265651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.265934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.266205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.267514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.270530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.312409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.313005 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2784/5589] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:09 2022] POST /identity/v3/users => generated 307 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:09.333442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f76270-fe28-4376-88b8-63c215708846 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.364450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.364450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.366433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.366730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.367959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.379273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.423469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2806/5590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:09.429218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.452186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711274-b054-43c5-adbf-ac3639e90576 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.467806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.468492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.468778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.469044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] PATH_INFO: `/v3/projects/a73745f227f949e7a9f58dbabd7eadc4/users/a6a3f432af934922a60fafc3a5c5aa00/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.488666 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:09.506857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73745f227f949e7a9f58dbabd7eadc4, user_id=a6a3f432af934922a60fafc3a5c5aa00, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.510480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.528875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2785/5591] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:09 2022] PUT /identity/v3/projects/a73745f227f949e7a9f58dbabd7eadc4/users/a6a3f432af934922a60fafc3a5c5aa00/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:09.532795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.549335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e752e-60d3-4fc1-a56b-d45b4d38da35 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.652008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.652722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.653148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.653747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.654545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.656185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2359ef-cffe-4d0c-9192-946d9b927bc7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.657664 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:09.671457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2807/5592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:09.675448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.699954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933478b-e96b-4bf4-80b6-99d265205211 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.713020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.713825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.715409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.715786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] PATH_INFO: `/v3/projects/a73745f227f949e7a9f58dbabd7eadc4/users/a6a3f432af934922a60fafc3a5c5aa00/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.719196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73745f227f949e7a9f58dbabd7eadc4, user_id=a6a3f432af934922a60fafc3a5c5aa00, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.721937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:09.755854 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2786/5593] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:09 2022] PUT /identity/v3/projects/a73745f227f949e7a9f58dbabd7eadc4/users/a6a3f432af934922a60fafc3a5c5aa00/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:09.768025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.768518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.768800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.800996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] MFA Rules not processed for user `a6a3f432af934922a60fafc3a5c5aa00`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:09.802362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:09.881759 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2808/5594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:09.893775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:09.896696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:09.978004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b8e2c-dcc8-4608-8d17-24a6952ad01b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:09.983833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:09.984168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:09.984540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:09.984857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:09.996333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:09.998069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:10.012032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2787/5595] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:10.134736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:10.155028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd722-1a46-4a7d-89a6-04111ea9202d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:10.182149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:10.183052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:10.183693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:10.184101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:10.292410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:10.295123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:10.331567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2809/5596] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:10.471971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:10.473387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:10.618022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99becf-fc95-4815-9143-10877c207d70 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:10.624365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:10.625162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:10.625545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:10.626501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] PATH_INFO: `/v3/users/67ce0396cdb949558664fac11b83aca1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:10.628642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ce0396cdb949558664fac11b83aca1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:10.631390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:10.763683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ce0396cdb949558664fac11b83aca1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:10.764540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ce0396cdb949558664fac11b83aca1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:10.799094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ce0396cdb949558664fac11b83aca1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:10.837793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ce0396cdb949558664fac11b83aca1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:10.838552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a177e492-df7d-4ab6-8fb2-21531e1a3cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ce0396cdb949558664fac11b83aca1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:10.863906 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:10.870157 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2788/5597] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:10 2022] DELETE /identity/v3/users/67ce0396cdb949558664fac11b83aca1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:12.060461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:12.081272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d76ed-787f-49e0-8265-6cc81b7717be service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:12.249443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:12.250162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.250453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.251117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] PATH_INFO: `/v3/projects/ba24a0d735e74e24aa2cabf4233d0e71` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.252588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba24a0d735e74e24aa2cabf4233d0e71)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:12.254488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:12.294738 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:12.340508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba24a0d735e74e24aa2cabf4233d0e71', 'request_id': 'req-db48a723-6192-41b0-9878-544b07758432'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:12.353877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba24a0d735e74e24aa2cabf4233d0e71', 'request_id': 'req-db48a723-6192-41b0-9878-544b07758432'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:12.365135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba24a0d735e74e24aa2cabf4233d0e71', 'request_id': 'req-db48a723-6192-41b0-9878-544b07758432'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:12.390777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] The token cache is being invalidate because project ba24a0d735e74e24aa2cabf4233d0e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:12.390777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:12.396050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db48a723-6192-41b0-9878-544b07758432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:12.408300 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2810/5598] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:12 2022] DELETE /identity/v3/projects/ba24a0d735e74e24aa2cabf4233d0e71 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:12.410367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.410926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.410926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.455002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:12.456512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:12.634094 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2789/5599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:12.636579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.637161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.638087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.662985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:12.664402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:12.673322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2811/5600] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:12.677776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:12.691531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96386463-995f-475e-be27-77f2d7df90f5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:12.699334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:12.700628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.701013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.701533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.702266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:12.702658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:12.704371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:12.721469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2790/5601] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:12.723017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:12.734360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8907b-3eb6-4fc3-a5f2-a0738bfdc271 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:12.739532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:12.740272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.740655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.741021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.741800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:12.745259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:12.808868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2812/5602] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:12.809588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:12.821054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0462789-1ed3-4e49-84ac-3cf9fd595b5b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:12.933225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:12.934013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:12.935200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:12.935493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:12.936154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:12.938188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.026942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2791/5603] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:12 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:13.033729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:13.053434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50fd3-2169-42e9-9dea-6e94f5df1127 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:13.063750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:13.065827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.066438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.066929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.067894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:13.070293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.087363 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2813/5604] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:13.091264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:13.103923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aae6f-0cbb-4070-ad0b-58c3507cc46d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:13.109047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:13.109726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.110014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.110291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.111060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:13.113372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c1362-7d93-4faf-bb5d-a6d26c1ca7e4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.133870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2792/5605] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:13.134820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:13.149994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f3c3-2063-4c76-97bd-536b83e4cd36 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:13.156894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:13.157861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.158290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.158719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] PATH_INFO: `/v3/projects/706bcde429e7433bac691f1d47a11e6f/users/b5607c09747d45d0aad30a25dddf4e5f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.177844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706bcde429e7433bac691f1d47a11e6f, user_id=b5607c09747d45d0aad30a25dddf4e5f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:13.181226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.216685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2814/5606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:13 2022] PUT /identity/v3/projects/706bcde429e7433bac691f1d47a11e6f/users/b5607c09747d45d0aad30a25dddf4e5f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:13.230028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.232015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.232469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.313320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] MFA Rules not processed for user `b5607c09747d45d0aad30a25dddf4e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:13.314311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:13.514797 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:13.550561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:13.552073 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2793/5607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:13.771940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82529122-beef-4062-8a64-1d4bedfcb4a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:13.782274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:13.782955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.783618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.784018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.784741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:13.787711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.840205 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2815/5608] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:13.846165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:13.863805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627351b-ed85-4137-afc2-9747786868c0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:13.947616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:13.948579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:13.949071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:13.950348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:13.951374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:13.953811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:13.986120 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2794/5609] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:13 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:13.990037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.008898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cce23-990c-4ada-8040-0af4c422d815 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.015500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.016132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.016418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.016761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.018418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.020186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.038601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2816/5610] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:14.042940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.058499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70d4b-39f9-4e01-a016-6fe8e772bfc1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.064946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.065804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.066147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.066481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] PATH_INFO: `/v3/projects/3c4cffd50f834de5a0a72be066cba1f6/users/bcc8b64780034fcf8953557eba5ea9ee/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.104669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4cffd50f834de5a0a72be066cba1f6, user_id=bcc8b64780034fcf8953557eba5ea9ee, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.110075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.145594 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2795/5611] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:14 2022] PUT /identity/v3/projects/3c4cffd50f834de5a0a72be066cba1f6/users/bcc8b64780034fcf8953557eba5ea9ee/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:14.150080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.197820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd506e7-d395-4601-8960-6c5d3093a5f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.255704 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:14.375327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.376216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.376594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.376966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.377892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.379677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4b69-a2e4-4ee2-a499-157061217598 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.399010 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2817/5612] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:14.400115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.417943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293b051-b9bb-4193-b7dd-7cdd34306d82 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.437161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.439827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.439827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.439827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] PATH_INFO: `/v3/projects/3c4cffd50f834de5a0a72be066cba1f6/users/bcc8b64780034fcf8953557eba5ea9ee/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.447244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4cffd50f834de5a0a72be066cba1f6, user_id=bcc8b64780034fcf8953557eba5ea9ee, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.451658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.479294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2796/5613] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:14 2022] PUT /identity/v3/projects/3c4cffd50f834de5a0a72be066cba1f6/users/bcc8b64780034fcf8953557eba5ea9ee/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:14.492646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.492935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.493215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.533555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] MFA Rules not processed for user `bcc8b64780034fcf8953557eba5ea9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:14.534778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:14.621588 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2818/5614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:14.626300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.639612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11403ddc-8dd2-4ec3-a26c-4f48a9128508 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.645825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.647702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.647702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.647702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.648350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.650632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.711840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:14.713442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2797/5615] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:14 2022] POST /identity/v3/projects => generated 350 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:14.725132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625167-9713-4bdb-91ba-d9010f521422 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:14.863590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:14.864230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:14.864532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:14.864795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:14.865490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:14.867647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:14.975742 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2819/5616] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:14 2022] POST /identity/v3/projects => generated 351 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:14.980283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.013874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79279-adfe-4063-9440-b37baf56131b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.121475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.123149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.123620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.123917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/users/b5607c09747d45d0aad30a25dddf4e5f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.126206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:get_user(user_id=b5607c09747d45d0aad30a25dddf4e5f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.132958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.142892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.151441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2798/5617] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:23:14 2022] GET /identity/v3/users/b5607c09747d45d0aad30a25dddf4e5f => generated 287 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:15.164506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd677-d341-4bb1-8890-20072fdb406b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.180930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.183867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.184194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.186043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.188550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.192262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.248136 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2820/5618] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 25 01:23:15 2022] POST /identity/v3/credentials => generated 431 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:15.249501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.262638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f77a99-3eef-4d48-bc8e-64085cca3f65 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.268910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.269677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.270024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.270423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.274307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.277120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.281861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.283886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.305453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2799/5619] 10.222.0.16 () {60 vars in 1358 bytes} [Sun Sep 25 01:23:15 2022] PATCH /identity/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d => generated 436 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:23:15.307465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.320580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2855-730b-4fd6-9f55-a2b9690aeff4 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.326364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.327077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.327366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.327717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.330771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.332552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.338464 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2821/5620] 10.222.0.16 () {58 vars in 1335 bytes} [Sun Sep 25 01:23:15 2022] GET /identity/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d => generated 436 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:23:15.341115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.364131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569aaab-effb-43d8-860b-87632fee95de tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.389747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.392899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.395410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:15.397343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.397729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.398010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.404690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.413825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.441011 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:15.468368 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:15.490362 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2800/5621] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 25 01:23:15 2022] DELETE /identity/v3/credentials/a217596451812ad59f06bed86e1fc6cf441141288cc90fd004f1b9cf8eb3100d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:15.498069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.525710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67709df4-cac8-46c2-8e79-2168cbfd6e28 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.555040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.557237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.557949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.561075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.562747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.581311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.620633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c073-e329-4aac-8339-944be7ee1728 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.629019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.629690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.629968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.630299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.638638 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2801/5622] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 25 01:23:15 2022] POST /identity/v3/credentials => generated 430 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:15.641924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.642592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:15.657065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415cd4e-2463-40e6-86a6-219ac486908c tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.666308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.667641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.668174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.670244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.672063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.673538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.676841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.677616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.733857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2822/5623] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:15.735225 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2802/5624] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 25 01:23:15 2022] POST /identity/v3/credentials => generated 430 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:15.739190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.776855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fcd4-b387-4dbe-a822-02348f4b8015 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.801117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.801791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.802078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.802356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.802961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.804562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.827336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.829137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.839236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.841833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.848184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.851020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2823/5625] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:23:15 2022] GET /identity/v3/credentials => generated 945 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:15.869653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26d0c-cdd2-4133-a672-83950e61c0c9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:15.895468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:15.898843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:15.900659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:15.901075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials/8bfbc4f70d1b769f628af314740ac68c0b49e6f9873fd0f643fcb8f8ee9aa5d8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:15.908932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8bfbc4f70d1b769f628af314740ac68c0b49e6f9873fd0f643fcb8f8ee9aa5d8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:15.917436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:15.969779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2803/5626] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 25 01:23:15 2022] DELETE /identity/v3/credentials/8bfbc4f70d1b769f628af314740ac68c0b49e6f9873fd0f643fcb8f8ee9aa5d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:15.973976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:15.997510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed064-f418-4c87-85a2-3cbbf8549a67 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:16.013028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:16.014003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:16.014450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:16.014880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/credentials/8d50a44ff69ef13f5d9ffae8572129c0342efee889687c894d6f6613ad9d4779` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:16.018959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8d50a44ff69ef13f5d9ffae8572129c0342efee889687c894d6f6613ad9d4779)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:16.023370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:16.075785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2824/5627] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 25 01:23:15 2022] DELETE /identity/v3/credentials/8d50a44ff69ef13f5d9ffae8572129c0342efee889687c894d6f6613ad9d4779 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:16.080531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:16.094134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6254-f013-4e83-aec5-6518cf18e0ed tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:16.100276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:16.101223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:16.101744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:16.102229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/projects/2176c0a021df40a6a82f6ce11e5d5e38` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:16.103643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2176c0a021df40a6a82f6ce11e5d5e38)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:16.105933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:16.251589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2176c0a021df40a6a82f6ce11e5d5e38', 'request_id': 'req-68592e35-c138-40bf-b3d4-9ca63d7466d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.283241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2176c0a021df40a6a82f6ce11e5d5e38', 'request_id': 'req-68592e35-c138-40bf-b3d4-9ca63d7466d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.305671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2176c0a021df40a6a82f6ce11e5d5e38', 'request_id': 'req-68592e35-c138-40bf-b3d4-9ca63d7466d9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.351314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] The token cache is being invalidate because project 2176c0a021df40a6a82f6ce11e5d5e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:16.351946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.354036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.358203 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2804/5628] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:16 2022] DELETE /identity/v3/projects/2176c0a021df40a6a82f6ce11e5d5e38 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:16.362392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:16.368481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:16.403794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a795e-68dd-4899-a539-e54fcb64ddaf tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:16.567975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc8b64780034fcf8953557eba5ea9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4cffd50f834de5a0a72be066cba1f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:16.569212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:16.569978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:16.570344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] PATH_INFO: `/v3/projects/6fbdd2b53f51474b936c5dc40e1771e2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:16.571741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6fbdd2b53f51474b936c5dc40e1771e2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:16.574338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:16.645539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbdd2b53f51474b936c5dc40e1771e2', 'request_id': 'req-36dd103e-9c88-4667-9184-289611501f0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.663680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbdd2b53f51474b936c5dc40e1771e2', 'request_id': 'req-36dd103e-9c88-4667-9184-289611501f0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.677915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbdd2b53f51474b936c5dc40e1771e2', 'request_id': 'req-36dd103e-9c88-4667-9184-289611501f0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.693122 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:16.717304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] The token cache is being invalidate because project 6fbdd2b53f51474b936c5dc40e1771e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:16.718592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.719666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-36dd103e-9c88-4667-9184-289611501f0b tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:16.729627 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2825/5629] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:16 2022] DELETE /identity/v3/projects/6fbdd2b53f51474b936c5dc40e1771e2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:16.734397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:16.736943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:16.862876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592e35-c138-40bf-b3d4-9ca63d7466d9 tempest-CredentialsTestJSON-2008143320 tempest-CredentialsTestJSON-2008143320-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:16.988057 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:17.041448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:17.044082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:17.044362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:17.044637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] PATH_INFO: `/v3/users/b5607c09747d45d0aad30a25dddf4e5f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:17.061977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5607c09747d45d0aad30a25dddf4e5f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:17.070478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:17.226546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5607c09747d45d0aad30a25dddf4e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:17.227274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5607c09747d45d0aad30a25dddf4e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:17.251664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5607c09747d45d0aad30a25dddf4e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:17.286851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5607c09747d45d0aad30a25dddf4e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:17.288778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5607c09747d45d0aad30a25dddf4e5f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:17.314203 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2805/5630] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:16 2022] DELETE /identity/v3/users/b5607c09747d45d0aad30a25dddf4e5f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:17.318766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:17.319058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:17.319385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:17.344335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:17.346001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:17.480397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2826/5631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:17.508253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:17.511075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:17.690682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11af0f-9391-4d57-86da-d404996d5551 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:17.703813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:17.704388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:17.704670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:17.704947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:17.719106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:17.723148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:17.738250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2806/5632] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:19.289280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:19.290792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:19.324584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffc8ce-5909-4dee-a75b-1127f1e68eab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:19.330462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:19.331118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:19.331395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:19.331666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] PATH_INFO: `/v3/projects/706bcde429e7433bac691f1d47a11e6f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:19.332834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706bcde429e7433bac691f1d47a11e6f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:19.334780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:19.502904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706bcde429e7433bac691f1d47a11e6f', 'request_id': 'req-636cd35e-4be1-4da3-9631-3ff5f167d491'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.518414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706bcde429e7433bac691f1d47a11e6f', 'request_id': 'req-636cd35e-4be1-4da3-9631-3ff5f167d491'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.533279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706bcde429e7433bac691f1d47a11e6f', 'request_id': 'req-636cd35e-4be1-4da3-9631-3ff5f167d491'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.589767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] The token cache is being invalidate because project 706bcde429e7433bac691f1d47a11e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:19.593103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.595090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.600709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2827/5633] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:19 2022] DELETE /identity/v3/projects/706bcde429e7433bac691f1d47a11e6f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:19.604421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:19.621776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d25dd-7014-41b5-b568-69c7b536f5d0 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:19.769354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:19.769976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:19.770260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:19.770533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] PATH_INFO: `/v3/users/bcc8b64780034fcf8953557eba5ea9ee` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:19.772664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc8b64780034fcf8953557eba5ea9ee)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:19.774749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:19.807370 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:19.918685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:19.920857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:19.943523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc8b64780034fcf8953557eba5ea9ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.944771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc8b64780034fcf8953557eba5ea9ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.952971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd35e-4be1-4da3-9631-3ff5f167d491 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:19.968654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc8b64780034fcf8953557eba5ea9ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:19.971360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:19.972087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:19.972305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:19.972588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] PATH_INFO: `/v3/users/69a3eaf35e17453caf8150401a4b0775` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:19.974482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a3eaf35e17453caf8150401a4b0775)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:19.976494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:20.018970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc8b64780034fcf8953557eba5ea9ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.022635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2446ae6f-040a-44a1-80a2-5d2d15d72f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc8b64780034fcf8953557eba5ea9ee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.054976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2807/5634] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:19 2022] DELETE /identity/v3/users/bcc8b64780034fcf8953557eba5ea9ee => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:20.109373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a3eaf35e17453caf8150401a4b0775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.121314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a3eaf35e17453caf8150401a4b0775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.149689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a3eaf35e17453caf8150401a4b0775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.151056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a3eaf35e17453caf8150401a4b0775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.152289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a3eaf35e17453caf8150401a4b0775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:20.172670 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:20.197494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2828/5635] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:19 2022] DELETE /identity/v3/users/69a3eaf35e17453caf8150401a4b0775 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:20.201435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:20.201727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:20.202001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:20.235870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:20.244808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:20.365439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2808/5636] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:20.478564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:20.485378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:20.677975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a528d-201c-439d-82d4-bd9fceecbc92 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:20.683272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:20.684346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:20.684823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:20.685444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:20.703672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:20.705603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687062b2-83f7-479d-a50c-c0a70eb2f1c5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:20.720818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2829/5637] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:21.148265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:21.150169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:21.173788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d618a3-f5b5-45c3-9052-6ec03059cb4c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:21.191369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:21.192512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:21.192897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:21.193545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] PATH_INFO: `/v3/projects/3c4cffd50f834de5a0a72be066cba1f6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:21.196545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4cffd50f834de5a0a72be066cba1f6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:21.201095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:21.315068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4cffd50f834de5a0a72be066cba1f6', 'request_id': 'req-9b05942b-395a-4ed6-9880-a11a2a25318b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:21.326353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4cffd50f834de5a0a72be066cba1f6', 'request_id': 'req-9b05942b-395a-4ed6-9880-a11a2a25318b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:21.336739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4cffd50f834de5a0a72be066cba1f6', 'request_id': 'req-9b05942b-395a-4ed6-9880-a11a2a25318b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:21.355876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] The token cache is being invalidate because project 3c4cffd50f834de5a0a72be066cba1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:21.358125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:21.359047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9b05942b-395a-4ed6-9880-a11a2a25318b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:21.361077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2809/5638] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:21 2022] DELETE /identity/v3/projects/3c4cffd50f834de5a0a72be066cba1f6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:21.365708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:21.366864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:21.367340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:21.443389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:21.447473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:21.626440 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2830/5639] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:21.628517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:21.628810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:21.629089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:21.755485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:21.757289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:21.770364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2810/5640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:21.774626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:21.789358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52c21-d3f5-4cce-b52b-582edd1f34e1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:21.808155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:21.808790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:21.809206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:21.809582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:21.810261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:21.810533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:21.828320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:21.861763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2831/5641] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:21.866396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:21.886640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096543d5-631c-45e2-ac05-545f68a8dd31 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:21.901136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:21.902429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:21.904143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:21.904476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:21.911634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:21.913646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:21.919774 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:21.954691 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2811/5642] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:21 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:21.958740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:21.969896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c592-65f7-48d0-9bda-14f8cf6a5349 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.049218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.050421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.051110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.051539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.052847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.055421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.084894 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2832/5643] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:21 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:22.089283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.104226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4041c-a25d-4439-b64c-55836d1231c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.116714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.117463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.117855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.118242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.120204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.131333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.160249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2812/5644] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:22.161715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.177883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e11b-f0eb-4380-a06d-1cc9dc7fd5f0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.185301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.188196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.188487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.188769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.189869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.192169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226dfc4-5b1b-4ee2-b96c-e0434b98af7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.236151 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2833/5645] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:22.239430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.251575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7463-7924-4c72-aa96-47ffadc25388 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.256948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.257652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.257932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.258206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] PATH_INFO: `/v3/projects/b8e62f4588e0457cbd4df2a829dd830c/users/41f74050a3104e02b8436212d9eb6139/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.277164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e62f4588e0457cbd4df2a829dd830c, user_id=41f74050a3104e02b8436212d9eb6139, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.280863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.316812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2813/5646] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:22 2022] PUT /identity/v3/projects/b8e62f4588e0457cbd4df2a829dd830c/users/41f74050a3104e02b8436212d9eb6139/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:22.318594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.318882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.319214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.331411 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:22.376058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] MFA Rules not processed for user `41f74050a3104e02b8436212d9eb6139`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:22.377300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:22.548081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2834/5647] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:22.552405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.693824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13305f33-f356-41ff-82fd-5c716d50404f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.706816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.707911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.708307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.708726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.710093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.714960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.746134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.748636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:22.774285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e5de0-cc15-4ca4-bbdf-a5dc9d945324 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:22.786893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:22.787551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:22.787829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:22.788098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] PATH_INFO: `/v3/projects/8dd36f321e414bb880624329223ddf1c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:22.792716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2814/5648] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:22.794672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd36f321e414bb880624329223ddf1c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:22.796784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:22.797451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:22.924634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd36f321e414bb880624329223ddf1c', 'request_id': 'req-24f1a609-2825-4117-a729-429a01439841'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:22.946508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd36f321e414bb880624329223ddf1c', 'request_id': 'req-24f1a609-2825-4117-a729-429a01439841'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:22.955676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd36f321e414bb880624329223ddf1c', 'request_id': 'req-24f1a609-2825-4117-a729-429a01439841'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:22.978817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] The token cache is being invalidate because project 8dd36f321e414bb880624329223ddf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:22.979327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:22.995171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.006997 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2835/5649] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:22 2022] DELETE /identity/v3/projects/8dd36f321e414bb880624329223ddf1c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:23.009373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:23.021831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:23.053770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331a8c0-8410-434b-bf86-8c88525e0703 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:23.206659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1a609-2825-4117-a729-429a01439841 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:23.216481 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:23.221038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:23.221797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:23.222097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:23.222281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] PATH_INFO: `/v3/users/a6a3f432af934922a60fafc3a5c5aa00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:23.223640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a3f432af934922a60fafc3a5c5aa00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:23.225793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:23.257251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:23.258137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:23.258137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:23.258356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:23.259735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:23.264330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:23.275635 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:23.317647 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2815/5650] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:22 2022] POST /identity/v3/users => generated 300 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:23.323275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:23.329420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:23.334040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a3f432af934922a60fafc3a5c5aa00'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.355334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a3f432af934922a60fafc3a5c5aa00'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.384270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a3f432af934922a60fafc3a5c5aa00'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.385684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a3f432af934922a60fafc3a5c5aa00'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.388362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a3f432af934922a60fafc3a5c5aa00'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:23.426818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d158-4e19-4cb8-8aef-234e0c64cc1b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:23.429345 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2836/5651] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:23 2022] DELETE /identity/v3/users/a6a3f432af934922a60fafc3a5c5aa00 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:23.625717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:23.626518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:23.628318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:23.629473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:23.633112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:23.635101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:23.675875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2816/5652] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:23.680187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:23.681793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:23.716409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49885-9257-4b3e-8300-ff9a952b5d41 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:23.736227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:23.742168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:23.742453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:23.742737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] PATH_INFO: `/v3/projects/789ec05eaac64abebc7eead5d191fe33/users/8b8d175b6ac1435ba71fb0015240c067/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:23.820295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ec05eaac64abebc7eead5d191fe33, user_id=8b8d175b6ac1435ba71fb0015240c067, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:23.828093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:23.872031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2837/5653] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:23 2022] PUT /identity/v3/projects/789ec05eaac64abebc7eead5d191fe33/users/8b8d175b6ac1435ba71fb0015240c067/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:23.876744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:23.895900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ac86-3685-4ba7-a7dc-b88cc53cd700 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.076680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.081771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.082307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.082594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.083336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.085074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d4e97-1be3-4a40-9b61-58765570fb20 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.105074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.106177 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2817/5654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:24.119803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54d43-c843-41c8-9831-6440c26d0cd2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.140312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.142274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.143468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.144608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] PATH_INFO: `/v3/projects/789ec05eaac64abebc7eead5d191fe33/users/8b8d175b6ac1435ba71fb0015240c067/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.151368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ec05eaac64abebc7eead5d191fe33, user_id=8b8d175b6ac1435ba71fb0015240c067, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.163135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.197573 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2838/5655] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:24 2022] PUT /identity/v3/projects/789ec05eaac64abebc7eead5d191fe33/users/8b8d175b6ac1435ba71fb0015240c067/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:24.212263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.212263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.212430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.285067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] MFA Rules not processed for user `8b8d175b6ac1435ba71fb0015240c067`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:24.290388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:24.480324 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:24.530027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2818/5656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:24.530242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.546180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da36b-7bdb-4e82-bb7b-7583ffccade6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.562106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.562794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.563074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.563345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.564062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.565947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.601872 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2839/5657] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:24 2022] POST /identity/v3/services => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:24.602543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.617668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774eeac-26ba-4151-bd8b-2f012bca3641 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.660304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.660944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.661231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.661537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.664661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.667433 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:24.667433 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:23:24.667433 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:23:24.668906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: On instance['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: On instance['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: 'False' Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise error Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'False' Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.701936 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:23:24.703445 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'False' Sep 25 01:23:24.704481 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:24.708037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2819/5658] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:23:24 2022] POST /identity/v3/endpoints => generated 283 bytes in 106 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:23:24.713366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.733433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26392-7698-4bc3-902d-aa6ee2226575 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.740514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.741346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.741802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.742257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.743092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.744278 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:24.744278 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:23:24.744278 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:24.745535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: On instance['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: On instance['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: 'True' Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise error Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'True' Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.762143 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:23:24.764295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'True' Sep 25 01:23:24.765524 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:24.767860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2840/5659] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:23:24 2022] POST /identity/v3/endpoints => generated 281 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:23:24.776463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.798725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d669-500b-4d27-910d-49795cbb000d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.811123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.811830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.812223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.812600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.813397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.818244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.841696 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1809941874. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:23:24.841696 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:23:24.841696 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:23:24.912759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2820/5660] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:23:24 2022] POST /identity/v3/endpoints => generated 360 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:24.914411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:24.931670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0ca2-6724-4282-b268-ff25846c3bb7 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:24.975666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:24.976602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:24.977079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:24.977350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/regions/tempest-region-1809941874` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:24.978271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1809941874)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:24.979356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:24.985308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2841/5661] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:23:24 2022] GET /identity/v3/regions/tempest-region-1809941874 => generated 180 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:23:24.995386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.016256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4d73e-5eb1-4f19-aa9f-dad8abd0248a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.035863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.036902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.037389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.037800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints/6046ed4f1d8045d8990684568e4e5a55` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.048805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=6046ed4f1d8045d8990684568e4e5a55)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.051405 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:25.051405 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:23:25.051405 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:23:25.053214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: On instance['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: On instance['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: 'False' Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise error Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'False' Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.070248 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:23:25.071963 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'False' Sep 25 01:23:25.073010 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:23:25.080349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2821/5662] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 25 01:23:24 2022] PATCH /identity/v3/endpoints/6046ed4f1d8045d8990684568e4e5a55 => generated 283 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:23:25.081844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.098550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751a404-7bcd-4c40-a9a6-838fabd6db5a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.132402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.133479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.134014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.134502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints/6046ed4f1d8045d8990684568e4e5a55` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.138979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6046ed4f1d8045d8990684568e4e5a55)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.140332 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:25.140332 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:23:25.140332 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:25.141706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.226314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6046ed4f1d8045d8990684568e4e5a55', 'request_id': 'req-8371f774-dc22-4b40-8aa0-8692ec16974d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.250211 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2842/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:25 2022] DELETE /identity/v3/endpoints/6046ed4f1d8045d8990684568e4e5a55 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:25.252878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.285261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6cf2-e6b1-4e14-a81e-8a28634525cb tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.346847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.348379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.348728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.348917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/regions/tempest-region-1809941874` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.349543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1809941874)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.351185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.408140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.410030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2822/5664] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:23:25 2022] DELETE /identity/v3/regions/tempest-region-1809941874 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:25.426057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f774-dc22-4b40-8aa0-8692ec16974d tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.464255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.464975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.465515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.466073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.466932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.468616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.510172 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1756345505. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:23:25.510172 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:23:25.510172 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:25.527083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.530119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:25.566992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2843/5665] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:23:25 2022] POST /identity/v3/endpoints => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:25.569132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.629360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fe6cb-0bfc-4c80-81cf-9462f719dcdc tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.641573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.642241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.642525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.642803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/regions/tempest-region-1756345505` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.643402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1756345505)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.651030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.662182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2844/5666] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:23:25 2022] GET /identity/v3/regions/tempest-region-1756345505 => generated 180 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:25.664020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.684833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d9aa0-132a-4fc1-9102-7faca5906991 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.692348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.693089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.693926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.694284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints/4cbfa151423d410192da6d81cf9fd5a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.700690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a06-c006-4ff5-bf6c-7aca5cd88c2e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.710911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=4cbfa151423d410192da6d81cf9fd5a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.712689 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:25.712689 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:23:25.712689 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:25.712967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: On instance['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: On instance['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: 'True' Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise error Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'True' Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.725103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:23:25.726965 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['enabled']: Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application 'True' Sep 25 01:23:25.728194 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:25.743036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2845/5667] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 25 01:23:25 2022] PATCH /identity/v3/endpoints/4cbfa151423d410192da6d81cf9fd5a1 => generated 281 bytes in 79 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:23:25.745049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.752599 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=84,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:25.763488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.764152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.764449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.764711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] PATH_INFO: `/v3/projects/a73745f227f949e7a9f58dbabd7eadc4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.767442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73745f227f949e7a9f58dbabd7eadc4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.768527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adb8b-1e02-4595-b69a-ec82b7c8907a tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.770809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.778992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:25.779891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.780357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.780994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/endpoints/4cbfa151423d410192da6d81cf9fd5a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.783111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4cbfa151423d410192da6d81cf9fd5a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:25.786927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:25.803094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4cbfa151423d410192da6d81cf9fd5a1', 'request_id': 'req-ca01e528-a82b-4562-a1b2-6479e757b903'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.838234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2846/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:25 2022] DELETE /identity/v3/endpoints/4cbfa151423d410192da6d81cf9fd5a1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:25.843983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:25.854634 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:25.868645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73745f227f949e7a9f58dbabd7eadc4', 'request_id': 'req-ad1686fb-1d6a-4243-9ae8-1686d837af61'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.874598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e528-a82b-4562-a1b2-6479e757b903 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:25.882224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73745f227f949e7a9f58dbabd7eadc4', 'request_id': 'req-ad1686fb-1d6a-4243-9ae8-1686d837af61'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.899089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73745f227f949e7a9f58dbabd7eadc4', 'request_id': 'req-ad1686fb-1d6a-4243-9ae8-1686d837af61'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.918982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] The token cache is being invalidate because project a73745f227f949e7a9f58dbabd7eadc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:25.919469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.920764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad1686fb-1d6a-4243-9ae8-1686d837af61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:25.929346 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2823/5669] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:25 2022] DELETE /identity/v3/projects/a73745f227f949e7a9f58dbabd7eadc4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:25.951183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862862-80a3-41da-b7b0-1dde25c165c2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:25.951528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862862-80a3-41da-b7b0-1dde25c165c2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:25.951756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862862-80a3-41da-b7b0-1dde25c165c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:25.986657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a7862862-80a3-41da-b7b0-1dde25c165c2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:25.988507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7862862-80a3-41da-b7b0-1dde25c165c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.001703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.003389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.004859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.005436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/regions/tempest-region-1756345505` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.007747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1756345505)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.010597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.061544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2847/5670] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:23:25 2022] DELETE /identity/v3/regions/tempest-region-1756345505 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:26.067424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.069427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.135148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23328248-8f3e-4b4d-acbb-a9a7e3bfbff4 tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.147462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8d175b6ac1435ba71fb0015240c067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '789ec05eaac64abebc7eead5d191fe33', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.148254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.148545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.148829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] PATH_INFO: `/v3/services/a2689dc59c4f48c9960dde2f5c98c4cd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.151977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a2689dc59c4f48c9960dde2f5c98c4cd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.155011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.166256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2824/5671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:26.167975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.168382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.168955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.194997 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2848/5672] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:26 2022] DELETE /identity/v3/services/a2689dc59c4f48c9960dde2f5c98c4cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:26.196318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.199207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.202890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:26.204582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.230344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2825/5673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:26.235126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73a3a-2d0a-45d0-af12-10dec1557a5e tempest-EndpointsNegativeTestJSON-1535442183 tempest-EndpointsNegativeTestJSON-1535442183-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.236327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.240885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.241565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.241899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.242406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] PATH_INFO: `/v3/users/41f74050a3104e02b8436212d9eb6139` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.244456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f74050a3104e02b8436212d9eb6139)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.247765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.248887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c527-94a1-4991-b1e0-9b339850399f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.255765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.256385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.256669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.256954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.257620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:26.257925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.259675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.276544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2826/5674] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:26.281297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.312855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a573-6f19-4224-92bf-4d1ed7b45dba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.321542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f74050a3104e02b8436212d9eb6139'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.325526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.326156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.326436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.326711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.327616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.329580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.335208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f74050a3104e02b8436212d9eb6139'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.354835 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=14 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:26.357913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f74050a3104e02b8436212d9eb6139'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.358909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f74050a3104e02b8436212d9eb6139'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.359942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-48b78093-8a5f-4974-84e6-58439e6e8218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f74050a3104e02b8436212d9eb6139'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.375664 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2827/5675] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:26 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:26.376778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.378539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.385929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2849/5676] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:26 2022] DELETE /identity/v3/users/41f74050a3104e02b8436212d9eb6139 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:26.392253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.393570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.394364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.456402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:26.458180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.480568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a92515-3195-440e-87d2-b238f0860c95 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.499317 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:26.564795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2850/5677] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:26.571852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.572368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.573378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.573790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.574113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.574237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.575528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.577839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.613834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2828/5678] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:26 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:26.619394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.635052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dc4e6-dabd-4fb4-b852-eb82ba685784 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.644073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.645237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.645734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.646302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.649764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.652304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.669388 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2829/5679] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:26.674328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.690842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f6b4a-ff9a-498a-ab0e-f8114385578b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.701725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.702612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.704913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.706074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.708050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.710129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.724718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9330-59be-4fd9-886c-d67747826e70 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.728975 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2830/5680] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:26.729279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.729973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.730260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.730539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.733759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.750461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd110c-e096-4395-8110-81f1c8ad192a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.750965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.753435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.759106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.763983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.765240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.767127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] PATH_INFO: `/v3/projects/70547d11ae944b3e8995271b37f509c0/users/1895e21cdf0f4ab5b064fafb1b3fb368/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.781853 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2851/5681] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:26.784814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:26.786896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.800716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70547d11ae944b3e8995271b37f509c0, user_id=1895e21cdf0f4ab5b064fafb1b3fb368, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.804190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceea3a9-1a04-4bee-be47-42cb29b39daa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.804678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e714b-686c-42bf-83f9-14e71cd10ca3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:26.813599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:26.816029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.816955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.819596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] PATH_INFO: `/v3/users/dda33440a14f49d1847ca7c7c37ce78e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.822161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda33440a14f49d1847ca7c7c37ce78e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:26.830936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:26.840909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2831/5682] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:26 2022] PUT /identity/v3/projects/70547d11ae944b3e8995271b37f509c0/users/1895e21cdf0f4ab5b064fafb1b3fb368/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:26.848524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:26.848806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:26.849089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:26.924295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] MFA Rules not processed for user `1895e21cdf0f4ab5b064fafb1b3fb368`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:26.929420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:26.936946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda33440a14f49d1847ca7c7c37ce78e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.958702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda33440a14f49d1847ca7c7c37ce78e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.984712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda33440a14f49d1847ca7c7c37ce78e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.986070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda33440a14f49d1847ca7c7c37ce78e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.987891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0a888c04-874a-4125-8264-9522ca43c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda33440a14f49d1847ca7c7c37ce78e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:26.993305 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:27.014838 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2852/5683] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:26 2022] DELETE /identity/v3/users/dda33440a14f49d1847ca7c7c37ce78e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:27.019726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.024638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.025464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.083657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:27.086052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:27.120717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2832/5684] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:27.122130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.132797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:27.258752 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2853/5685] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:27.274796 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:27.299515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d3ade-1727-4ef3-a9d7-6556460dcdc2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.303991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.305712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:27.315524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.316157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.316434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.316705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.317344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.323754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.395727 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2833/5686] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:27 2022] POST /identity/v3/projects => generated 365 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:27.397001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.464960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e8f80-33d4-496e-9618-e01204ac201d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.555328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002357a-371e-46a1-b443-0fbdf2cb5c7e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.564619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.564619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.564619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.564619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.565137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.566832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.591144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.591789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.592081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.592464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.609223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2834/5687] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:27 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:27.611220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.614927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:27.619479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.623329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.640978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fe871-a4f5-438b-9e66-fcbd099eba79 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.642685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2854/5688] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:27.643771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.655325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.656846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.658219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.659067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] PATH_INFO: `/v3/projects/b8e62f4588e0457cbd4df2a829dd830c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.661576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e62f4588e0457cbd4df2a829dd830c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.663752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.678273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed74e5e-0e9a-41da-b512-676641049334 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.701621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.702328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.702824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.702966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.704695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.709683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.735873 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2855/5689] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:27.736861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.762882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478c7e0-e9bb-4ad4-95f4-915f00416560 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:27.800092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e62f4588e0457cbd4df2a829dd830c', 'request_id': 'req-f8f342e2-ea77-4c0c-980d-8b59bbc41511'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:27.815519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e62f4588e0457cbd4df2a829dd830c', 'request_id': 'req-f8f342e2-ea77-4c0c-980d-8b59bbc41511'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:27.825442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e62f4588e0457cbd4df2a829dd830c', 'request_id': 'req-f8f342e2-ea77-4c0c-980d-8b59bbc41511'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:27.853987 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:27.860477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] The token cache is being invalidate because project b8e62f4588e0457cbd4df2a829dd830c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:27.861049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:27.862021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:27.864077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2835/5690] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:27 2022] DELETE /identity/v3/projects/b8e62f4588e0457cbd4df2a829dd830c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:27.869786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.873454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:27.904263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:27.904901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:27.905204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:27.909337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] PATH_INFO: `/v3/projects/451b1d80da6146d6a0f12243e3c56f4a/users/6a900b0a34dc4b3aa7287c9ce9adf101/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:27.944137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=451b1d80da6146d6a0f12243e3c56f4a, user_id=6a900b0a34dc4b3aa7287c9ce9adf101, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:27.948971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:27.982584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2856/5691] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:27 2022] PUT /identity/v3/projects/451b1d80da6146d6a0f12243e3c56f4a/users/6a900b0a34dc4b3aa7287c9ce9adf101/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:27.983740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:27.992528 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:27.994806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.028819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f342e2-ea77-4c0c-980d-8b59bbc41511 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.109238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.109238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.109238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.109593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] PATH_INFO: `/v3/users/8b8d175b6ac1435ba71fb0015240c067` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.112369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149199-176d-44cf-8dc3-1a8555b55dde admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.112994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8d175b6ac1435ba71fb0015240c067)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.115505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:28.120794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.121608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.122616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.122616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] PATH_INFO: `/v3/projects/953bbd3878e74add83dd281bea3d6a93` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.123638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953bbd3878e74add83dd281bea3d6a93)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.126446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:28.195244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8d175b6ac1435ba71fb0015240c067'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.196224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8d175b6ac1435ba71fb0015240c067'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.219479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8d175b6ac1435ba71fb0015240c067'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.241139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8d175b6ac1435ba71fb0015240c067'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.242934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8d175b6ac1435ba71fb0015240c067'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.257699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953bbd3878e74add83dd281bea3d6a93', 'request_id': 'req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.266189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2836/5692] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:27 2022] DELETE /identity/v3/users/8b8d175b6ac1435ba71fb0015240c067 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:28.269214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953bbd3878e74add83dd281bea3d6a93', 'request_id': 'req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.271057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:28.274241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.278525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953bbd3878e74add83dd281bea3d6a93', 'request_id': 'req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.298149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] The token cache is being invalidate because project 953bbd3878e74add83dd281bea3d6a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:28.298610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.299486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.302581 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2857/5693] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:27 2022] DELETE /identity/v3/projects/953bbd3878e74add83dd281bea3d6a93 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:28.306914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:28.309070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.380469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4693a1-34df-41f1-bc4c-918b042d5e42 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.411798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.412870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.413310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.414050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.414913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.416868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:28.432152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2837/5694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:28.437191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:28.440276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.467501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607106e9-df77-427f-b286-214c08db84f2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.473308 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:28.477038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.478449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.478888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.479313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] PATH_INFO: `/v3/projects/451b1d80da6146d6a0f12243e3c56f4a/users/6a900b0a34dc4b3aa7287c9ce9adf101/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.481516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8378b5-64e1-4701-a80e-92e3e4ce8ba7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.482111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=451b1d80da6146d6a0f12243e3c56f4a, user_id=6a900b0a34dc4b3aa7287c9ce9adf101, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.488507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62117a-2788-497e-99bf-5ecf568e21cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:28.497465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.497465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.497465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.497465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] PATH_INFO: `/v3/users/9ec441bd9de9458cae98269a6deccf96` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.503211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec441bd9de9458cae98269a6deccf96)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.505095 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:28.507169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:28.514828 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2838/5695] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:28 2022] PUT /identity/v3/projects/451b1d80da6146d6a0f12243e3c56f4a/users/6a900b0a34dc4b3aa7287c9ce9adf101/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:28.530716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.534118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.534471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.581109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] MFA Rules not processed for user `6a900b0a34dc4b3aa7287c9ce9adf101`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:28.581827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec441bd9de9458cae98269a6deccf96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.583241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.590550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec441bd9de9458cae98269a6deccf96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.621963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec441bd9de9458cae98269a6deccf96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.624222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec441bd9de9458cae98269a6deccf96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.625463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec441bd9de9458cae98269a6deccf96'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:28.678068 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2858/5696] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:28 2022] DELETE /identity/v3/users/9ec441bd9de9458cae98269a6deccf96 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:28.725664 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2839/5697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:28.743731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:28.746078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.847752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2f1e1-3a92-4161-9601-1c6bbfe461ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:28.854568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:28.855219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:28.855506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:28.856379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:28.939528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:28.942972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:28.987111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:28.989877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:29.008898 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2859/5698] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:29.078623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4930c48-be84-4745-9e27-322e719ac219 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:29.148652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:29.183367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd76de-9419-410b-b688-e30c92dd586d service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:29.213206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:29.214035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.214598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.215040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] PATH_INFO: `/v3/projects/789ec05eaac64abebc7eead5d191fe33` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.216949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789ec05eaac64abebc7eead5d191fe33)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:29.217141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:29.219208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:29.222889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.223172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.223448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.240025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:29.296813 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:29.312623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789ec05eaac64abebc7eead5d191fe33', 'request_id': 'req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:29.321119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789ec05eaac64abebc7eead5d191fe33', 'request_id': 'req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:29.329384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789ec05eaac64abebc7eead5d191fe33', 'request_id': 'req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:29.344320 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:29.346080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] The token cache is being invalidate because project 789ec05eaac64abebc7eead5d191fe33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:29.346904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:29.347817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d998a088-8ba6-41ee-8cc2-3e3cdc394fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:29.350168 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2840/5699] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:28 2022] DELETE /identity/v3/projects/789ec05eaac64abebc7eead5d191fe33 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:29.354853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bf74-3397-4d08-863b-36fc69cf30a6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.355314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bf74-3397-4d08-863b-36fc69cf30a6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.355746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bf74-3397-4d08-863b-36fc69cf30a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.386125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6cc1bf74-3397-4d08-863b-36fc69cf30a6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:29.388313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6cc1bf74-3397-4d08-863b-36fc69cf30a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:29.466915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2841/5700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:29.477162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.477162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.477574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.537728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:29.539083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:29.542140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:29.544916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:29.563325 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2842/5701] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:29.567183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:29.573343 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2860/5702] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:29.606200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72e87-5478-4d53-8792-098b4bee58b6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:29.635120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:29.638963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.639280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.639565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.640273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:29.640587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:29.644880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:29.678385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:29.679961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:29.689512 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2843/5703] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:29.703726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd09b0-4520-4b91-b51d-719c182403ab service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:29.717842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:29.719302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:29.719592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:29.719873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:29.721368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:29.731442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:29.808446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2861/5704] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:29 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:29.813519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:29.847159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ae36-f785-43d4-9cca-6c4643020860 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.009991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.010628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.010923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.011194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.013172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.017429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.100158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.100372 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2844/5705] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:29 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:30.124567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7611198-55ba-41c1-af1b-52fe2c6f34a4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.151272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.153436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.163995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.166996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.169992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.173594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.200556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2862/5706] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:30.205253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.223228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081cbab-9b71-4afe-b570-a34962c1c1f1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.241295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.242307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.242590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.242866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.243904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.245581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.279305 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2845/5707] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:30.282155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.301861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec16b-cccc-4333-9a6d-c8c1fb13710c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.316461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.317329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.317799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.318254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] PATH_INFO: `/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/fdfe9eb3da064ea68a9f1b42f2ef6374/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.356212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef57a015a94d3d89c38e03cafcd95c, user_id=fdfe9eb3da064ea68a9f1b42f2ef6374, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.359185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4ec7-a17e-4beb-ae15-e40fedb80d55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.365153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.367038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:30.399598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e307-1167-4c70-9f79-31a945c4265e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.429308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2863/5708] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:30 2022] PUT /identity/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/fdfe9eb3da064ea68a9f1b42f2ef6374/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:30.440712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.443938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.443938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.487008 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:30.520508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] MFA Rules not processed for user `fdfe9eb3da064ea68a9f1b42f2ef6374`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:30.525375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:30.588197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.588936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.589335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.589752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] PATH_INFO: `/v3/projects/bc253022917447a3a00237b476ff9838` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.591842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc253022917447a3a00237b476ff9838)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.595049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.689811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc253022917447a3a00237b476ff9838', 'request_id': 'req-3ef7c8bb-50da-4725-a0d6-d1faead74c54'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:30.696316 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2864/5709] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:30.697524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.704028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc253022917447a3a00237b476ff9838', 'request_id': 'req-3ef7c8bb-50da-4725-a0d6-d1faead74c54'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:30.722793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc253022917447a3a00237b476ff9838', 'request_id': 'req-3ef7c8bb-50da-4725-a0d6-d1faead74c54'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:30.741355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16bb2-cf24-4b10-9790-d0ff1d62c52b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.751162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] The token cache is being invalidate because project bc253022917447a3a00237b476ff9838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:30.752038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:30.752193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:30.759957 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2846/5710] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:30 2022] DELETE /identity/v3/projects/bc253022917447a3a00237b476ff9838 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:30.762844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:30.765395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:30.874828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7c8bb-50da-4725-a0d6-d1faead74c54 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:30.880935 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:30.883156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.883955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.884258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.884520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] PATH_INFO: `/v3/users/2d57ebf9d332468e90da1661e2d5f212` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.886195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d57ebf9d332468e90da1661e2d5f212)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.889484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:30.932708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:30.936304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:30.936603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:30.936883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:30.937566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:30.943934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:31.063187 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2865/5711] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:30 2022] POST /identity/v3/projects => generated 367 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:31.066522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:31.070635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:31.073742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d57ebf9d332468e90da1661e2d5f212'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:31.075890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d57ebf9d332468e90da1661e2d5f212'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:31.085378 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:31.094680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d57ebf9d332468e90da1661e2d5f212'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:31.136696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d57ebf9d332468e90da1661e2d5f212'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:31.137793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d57ebf9d332468e90da1661e2d5f212'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:31.177554 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2847/5712] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:30 2022] DELETE /identity/v3/users/2d57ebf9d332468e90da1661e2d5f212 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:31.239337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d28d-1c5f-4414-87a2-8aa431e9fa61 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:31.346298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:31.347244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:31.348754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:31.349377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:31.350463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:31.356656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:31.433698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2866/5713] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:31 2022] POST /identity/v3/users => generated 290 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:31.437508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:31.439544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:31.483143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacc9a-3388-4438-bc61-e8b17742eb47 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:31.504229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:31.504229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:31.504229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:31.504229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:31.505204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:31.509346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:31.540841 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2848/5714] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:31.545520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:31.559943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e398-0fae-4af7-93c0-abaa774306a7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:31.574785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:31.581932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:31.581932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:31.581932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] PATH_INFO: `/v3/projects/b6dc9de39bc84baf8275572857b81afd/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:31.628325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dc9de39bc84baf8275572857b81afd, user_id=f71ac2bd07254e5d8bba9e0df5b55112, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:31.632537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:31.669238 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2867/5715] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:31 2022] PUT /identity/v3/projects/b6dc9de39bc84baf8275572857b81afd/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:31.672938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:31.691400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93113a3-2d94-46fe-b15b-ed1e0a3e4cfd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:31.862727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:31.879230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:31.879457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:31.879750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:31.880486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:31.882102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220f7d-84e9-4322-a2b6-668988b8e250 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:31.902665 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2849/5716] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:31.906609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:31.921319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73affa7d-b29c-4635-a161-492c8a7e34c3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:31.950796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:31.951488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:31.951766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:31.952041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] PATH_INFO: `/v3/projects/b6dc9de39bc84baf8275572857b81afd/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:31.968018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dc9de39bc84baf8275572857b81afd, user_id=f71ac2bd07254e5d8bba9e0df5b55112, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:31.986536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:32.018806 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2868/5717] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:31 2022] PUT /identity/v3/projects/b6dc9de39bc84baf8275572857b81afd/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:32.033778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.034076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.034404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.097816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] MFA Rules not processed for user `f71ac2bd07254e5d8bba9e0df5b55112`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:32.099275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:32.218304 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2850/5718] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:32.222696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:32.283880 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:32.357783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e5c-d433-41b9-8887-1ba42f71fd4e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:32.378032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:32.378673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.378955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.379231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.381619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:32.387731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:32.490729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:32.493081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2869/5719] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:32 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:32.506012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017774d-209d-4f26-8a16-4d44cbd37f9e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:32.517475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:32.519630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:32.655161 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:32.708500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:32.708928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.709161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.709450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.710104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:32.712046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:32.727185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b12b0-b9a4-4026-972f-3c00e9166336 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:32.749303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:32.751050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.751396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.753330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] PATH_INFO: `/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.758554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265d1d3834a54f6bb6deaffa13d6fa53)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:32.765425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:32.769609 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2851/5720] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:32 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:23:32.770872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:32.791578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5efc-b062-405d-98bc-bde0b67cba1a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:32.805617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:32.805617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.805617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.805908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.806565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:32.809059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:32.831906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2852/5721] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:32.841524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:32.873189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d580a-c4e5-458b-9a3c-47acd3576fe1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:32.896317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265d1d3834a54f6bb6deaffa13d6fa53', 'request_id': 'req-d75a9928-4cce-4b96-91c9-2cbeb4592f44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:32.908894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265d1d3834a54f6bb6deaffa13d6fa53', 'request_id': 'req-d75a9928-4cce-4b96-91c9-2cbeb4592f44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:32.916664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265d1d3834a54f6bb6deaffa13d6fa53', 'request_id': 'req-d75a9928-4cce-4b96-91c9-2cbeb4592f44'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:32.934428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] The token cache is being invalidate because project 265d1d3834a54f6bb6deaffa13d6fa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:32.934849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:32.935752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d75a9928-4cce-4b96-91c9-2cbeb4592f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:32.944285 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2870/5722] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:32 2022] DELETE /identity/v3/projects/265d1d3834a54f6bb6deaffa13d6fa53 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:32.945605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ca7b7-226c-4f97-b7f2-e1935840062f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.946100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ca7b7-226c-4f97-b7f2-e1935840062f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.946464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ca7b7-226c-4f97-b7f2-e1935840062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.972805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ea4ca7b7-226c-4f97-b7f2-e1935840062f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:32.974910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea4ca7b7-226c-4f97-b7f2-e1935840062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:32.988958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:32.989618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:32.989905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:32.990181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:32.990831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:32.993238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.019414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2853/5723] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:33.019414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.019414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.038876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30b6e-a596-4341-9326-1963906bfea9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.048618 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:33.070734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:33.071605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.071964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.072330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] PATH_INFO: `/v3/projects/847f88c19a1a4bc9a8581506e5805c4a/users/6253e676f5dc4644b30265489219e30f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.082379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2871/5724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:33.091990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b390-d598-49f6-9a63-dcab839e47f7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.092477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b390-d598-49f6-9a63-dcab839e47f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.093191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b390-d598-49f6-9a63-dcab839e47f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.110452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f88c19a1a4bc9a8581506e5805c4a, user_id=6253e676f5dc4644b30265489219e30f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:33.115249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.134014 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2854/5725] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:33 2022] PUT /identity/v3/projects/847f88c19a1a4bc9a8581506e5805c4a/users/6253e676f5dc4644b30265489219e30f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:33.135747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.138189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.148066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f388b390-d598-49f6-9a63-dcab839e47f7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:33.156301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f388b390-d598-49f6-9a63-dcab839e47f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.271100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de5a1-2eb4-4127-9465-e0ea3895ce45 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.276597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:33.277237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.277598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.277874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] PATH_INFO: `/v3/users/023415a906544acea2a4d54b1717010e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.279614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023415a906544acea2a4d54b1717010e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:33.283113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.294423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2872/5726] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:33.299744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.300059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.300482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.341202 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:33.356715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] MFA Rules not processed for user `6253e676f5dc4644b30265489219e30f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:33.358203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.358343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023415a906544acea2a4d54b1717010e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:33.359395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023415a906544acea2a4d54b1717010e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:33.371957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023415a906544acea2a4d54b1717010e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:33.390073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023415a906544acea2a4d54b1717010e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:33.391107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023415a906544acea2a4d54b1717010e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:33.417455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2855/5727] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:33 2022] DELETE /identity/v3/users/023415a906544acea2a4d54b1717010e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:33.417455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.420111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.489276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2873/5728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:33.492550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.496616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:33.536245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7870-5517-44aa-b575-be160afe73b2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.543669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:33.544305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.544747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.545030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.546159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:33.546472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:33.548764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.569575 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2856/5729] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:33.574122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.620106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd1bf-26fc-4816-b696-dc94520cfc81 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.636636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:33.640888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.641437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.641984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.645239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:33.648246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.678846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57015b6-63eb-4838-b5f4-91c24b03758e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.697799 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2857/5730] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:33.699646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.729149 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:33.827078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:33.828220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:33.828853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:33.830429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:33.831340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:33.833366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:33.855072 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2874/5731] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/domains => generated 276 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:33.860049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:33.901354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a457-b214-480e-965a-b59d75fa908e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:33.953591 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:34.005617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1b56-ec69-4204-8b94-db82926cd2d2 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.020248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.021046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.021494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.022545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.023051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.023630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.023752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.023928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.024201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.024836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.026058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.026786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.061533 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2875/5732] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/roles => generated 239 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:34.065060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.076789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2858/5733] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:33 2022] POST /identity/v3/users => generated 288 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:34.078152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.089619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177d6c-8e2d-4e00-b18a-3e9de7f1c860 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.098802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.100752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.101984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.102511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e/users/6253e676f5dc4644b30265489219e30f/roles/bd5eb4f7f9c64d72876aa47be69b86de` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.104644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890f60-f0ed-41ba-8db0-cf4af76455d9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.134507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.135143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.135430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.135709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.136364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.138104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.165161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=33fd3dae5f474d1b85982a1fa8f82b1e, user_id=6253e676f5dc4644b30265489219e30f, role_id=bd5eb4f7f9c64d72876aa47be69b86de)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.168776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.184991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2859/5734] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:34 2022] GET /identity/v3/roles => generated 1650 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:34.188456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.214352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661948-ffa2-4d3c-9176-5f029a9fb56e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.221128 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2876/5735] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 25 01:23:34 2022] PUT /identity/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e/users/6253e676f5dc4644b30265489219e30f/roles/bd5eb4f7f9c64d72876aa47be69b86de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:34.225096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.377542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ac575-347b-4c81-978c-850bbd383e97 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.393805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.394449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.394737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.395020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.395731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.397941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.402970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.403758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.404041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.404531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.405202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.407152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.436937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2877/5736] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:23:34 2022] POST /identity/v3/domains => generated 276 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:34.438355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.440828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:34.445869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2860/5737] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:34 2022] GET /identity/v3/roles => generated 1650 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:34.446983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.478404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4427a-bc44-4a63-841c-cfdf32bbf926 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.537169 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:34.616064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.619725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2810e27-c1cc-41f6-8d29-7cbcb4042ffa tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.620214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.620515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.620795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.622836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.626835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.628565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.629216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.629653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.629929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] PATH_INFO: `/v3/projects/f975dd85a90549e99f53ea92c21fb41f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.631089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f975dd85a90549e99f53ea92c21fb41f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.633030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.700777 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2861/5738] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:23:34 2022] POST /identity/v3/roles => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:34.700777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.732657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22347d-b95c-44bf-8a8c-5fca2b28f4ab tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.737164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f975dd85a90549e99f53ea92c21fb41f', 'request_id': 'req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:34.762703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f975dd85a90549e99f53ea92c21fb41f', 'request_id': 'req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:34.778166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f975dd85a90549e99f53ea92c21fb41f', 'request_id': 'req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:34.809785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] The token cache is being invalidate because project f975dd85a90549e99f53ea92c21fb41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:34.810370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:34.811546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:34.813906 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2878/5739] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:34 2022] DELETE /identity/v3/projects/f975dd85a90549e99f53ea92c21fb41f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:34.814793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:34.816261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:34.847032 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:34.892179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.894172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.894526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.895237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] PATH_INFO: `/v3/projects/6ac8e6d5be6e490cb0a496ee5864d351/users/c5dbbc7017ae488a8d091db10cf69f2e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.922656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01cc3a-121c-4f0a-9a28-b5c240f6d49e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:34.927434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:34.927724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac8e6d5be6e490cb0a496ee5864d351, user_id=c5dbbc7017ae488a8d091db10cf69f2e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.928068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.928349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.928732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.929384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:34.930485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77212f57-938d-42d2-80db-addc2927f56a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.931950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a173-1503-4928-a0c6-81ebba1d43e7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:34.976916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2862/5740] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:34 2022] PUT /identity/v3/projects/6ac8e6d5be6e490cb0a496ee5864d351/users/c5dbbc7017ae488a8d091db10cf69f2e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:34.988501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:34.990793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:34.991512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:34.993616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2879/5741] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:23:34 2022] POST /identity/v3/groups => generated 326 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:35.002297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3c73-5be7-4477-b444-4558a06bf761 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.002297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3c73-5be7-4477-b444-4558a06bf761 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.002297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3c73-5be7-4477-b444-4558a06bf761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.019721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:35.021086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.072370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-36bd3c73-5be7-4477-b444-4558a06bf761 None None] MFA Rules not processed for user `c5dbbc7017ae488a8d091db10cf69f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:35.073792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36bd3c73-5be7-4477-b444-4558a06bf761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.134913 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:35.141076 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2863/5742] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:35.149724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.206101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2880/5743] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:35.208564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.208908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.209162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.251387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2c1a-37c3-43e8-b7a3-3b69282d8272 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.261027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:35.261843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.262328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.262788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.265980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.266256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/users/6253e676f5dc4644b30265489219e30f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.277945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8e738831f4b84ce4a0dbeb3864fcf0bd, user_id=6253e676f5dc4644b30265489219e30f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.285596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:35.297382 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2881/5744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:35.298908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.303406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.336886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fe0b8-59b5-414e-8390-5b17535e5b14 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.341287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2864/5745] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:23:35 2022] PUT /identity/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/users/6253e676f5dc4644b30265489219e30f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:35.350806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.423892 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:35.462810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd888b2-1c97-4f7c-b7ca-8a8b47771670 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.487327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.487327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.487327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.487327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.488008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.488962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:35.489333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.490001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.490551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.490840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.491508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:35.492480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.494187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:35.513397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2865/5746] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:35.513397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.550564 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2882/5747] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:35 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:35.550564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.618876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99124-c5a2-4b79-996f-aae3d4b5006f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.654647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f3e45-f38d-4747-a44b-9802c368d722 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.660132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.660973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.661330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.661726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.662558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.664827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:35.700751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.701603 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2883/5748] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:35 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:35.702615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.704581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.704816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.705111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/roles/dd7928325f424cc5bde7cb0ee452cb60` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.708143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3c1c7a6e112c4d2cbde1f07e06c72a9c, group_id=8e738831f4b84ce4a0dbeb3864fcf0bd, role_id=dd7928325f424cc5bde7cb0ee452cb60)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.711113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:35.736604 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2866/5749] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:35 2022] PUT /identity/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/roles/dd7928325f424cc5bde7cb0ee452cb60 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:35.737616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:35.740562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.780745 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:35.836542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e6bab-e86f-4ad5-9c5b-422bcfc3068a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.916379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de9de-d68a-44cc-adde-d99c36879c1f tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:35.931260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.932224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.932513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.932958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.936347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:35.947923 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:35.955180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:35.956722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:35.957012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:35.957754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:35.960535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:35.963173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.000826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2884/5750] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:35 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:36.002077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.019416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b793711-e96a-4f4e-ba44-d76264f3ee6a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.026430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.028385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.029985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.030388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.031810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.033931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.059776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.060496 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2885/5751] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:36 2022] POST /identity/v3/users => generated 287 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:36.062005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.062145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.084328 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2867/5752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:36.086414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.162283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bca5d8-f661-4880-9fc3-d0b0579f8a2f service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.192480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc1c0-dddb-4ed3-a6c2-17910e974880 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.211307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.212174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.212608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.212608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.213309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.227123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.228885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.228885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.228885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.232986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.236886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.250354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.266621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2868/5753] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:36 2022] GET /identity/v3/roles => generated 1881 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:36.270995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.275155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2886/5754] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:23:36 2022] POST /identity/v3/domains => generated 277 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:36.276769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.291014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca540e77-1d24-47b0-b858-c8b3d78ecad4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.423217 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:36.445321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.463908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b553-2d87-45ae-b882-ad8e1b8d9477 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.464229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.465264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.466138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.470296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.471188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.471570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.472008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.472420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] PATH_INFO: `/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0/users/e63fd402f1f146078a217a1cc04bc0be/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.476775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.494841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264247e02bac44f6921b0a5d7d4aa3e0, user_id=e63fd402f1f146078a217a1cc04bc0be, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.499248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.525966 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2887/5755] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:36 2022] PUT /identity/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0/users/e63fd402f1f146078a217a1cc04bc0be/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:36.535760 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2869/5756] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:36 2022] GET /identity/v3/roles => generated 1881 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:36.535760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.536036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.570561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e6c1-6b74-4fba-9ae1-a5fce5dbe3d1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.669324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d034a0-55b2-4feb-bfb8-d94f380e51d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.688530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.689311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.689728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.690073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.690832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.692663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.715476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.717908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.718525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.718947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.721223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.725513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.747680 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2888/5757] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:23:36 2022] POST /identity/v3/roles => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:36.749359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.774915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2870/5758] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:36 2022] GET /identity/v3/roles => generated 2112 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:36.776348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.791428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddddc0-de02-4c17-9260-dcddc18e06a9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.812699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.814344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ccb7-ddf7-4384-8110-97f468f5b592 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.815547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.815845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.817503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.817503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.821603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.827586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.828267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.828549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.857768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/f200604b3ea043c580fad7f4daaea5a9/users/6253e676f5dc4644b30265489219e30f/roles/a99955869c0044fdb3cd7e10f1d8a43f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.869660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2889/5759] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:36 2022] GET /identity/v3/roles => generated 2112 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:36.872722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.891431 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:36.910286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f200604b3ea043c580fad7f4daaea5a9, user_id=6253e676f5dc4644b30265489219e30f, role_id=a99955869c0044fdb3cd7e10f1d8a43f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.914264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.915706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fda3-7264-4672-849e-150000186b6f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:36.935692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:36.936371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:36.936653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:36.936932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] PATH_INFO: `/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0/users/e63fd402f1f146078a217a1cc04bc0be/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:36.943660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264247e02bac44f6921b0a5d7d4aa3e0, user_id=e63fd402f1f146078a217a1cc04bc0be, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:36.945663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:36.948860 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2871/5760] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 25 01:23:36 2022] PUT /identity/v3/domains/f200604b3ea043c580fad7f4daaea5a9/users/6253e676f5dc4644b30265489219e30f/roles/a99955869c0044fdb3cd7e10f1d8a43f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:36.948860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:36.980385 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2890/5761] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:36 2022] PUT /identity/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0/users/e63fd402f1f146078a217a1cc04bc0be/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:36.980385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.173365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b97e-a514-4903-a870-bf37e8e711fc tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:37.249842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e16-dd01-4b2c-9291-6a2bac7ceb12 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:37.268950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:37.272289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.273288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.273376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.274210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:37.278347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774dd3d-a402-437a-a9dd-ac5be595e193 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:37.323123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2891/5762] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:23:36 2022] POST /identity/v3/domains => generated 274 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:37.325132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664c22-c73f-4819-901f-978e12b065bb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.325438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664c22-c73f-4819-901f-978e12b065bb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.326805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664c22-c73f-4819-901f-978e12b065bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.363623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:37.364342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.364631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.369526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] PATH_INFO: `/v3/projects/8f9849b93b6e407682309d5585094847/users/d3098d02a0814cf7ada5aae6bedf2771/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.420916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-90664c22-c73f-4819-901f-978e12b065bb None None] MFA Rules not processed for user `e63fd402f1f146078a217a1cc04bc0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:37.422162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90664c22-c73f-4819-901f-978e12b065bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:37.422544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9849b93b6e407682309d5585094847, user_id=d3098d02a0814cf7ada5aae6bedf2771, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:37.427712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:37.450061 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2872/5763] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:36 2022] PUT /identity/v3/projects/8f9849b93b6e407682309d5585094847/users/d3098d02a0814cf7ada5aae6bedf2771/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:37.451685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.528496 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:37.615120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01057c-fc4e-422a-a3f1-3babf3079fd1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:37.628647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:37.629339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2892/5764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:37.630542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.631129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.631588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.631943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.632348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.632773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:37.633048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.636944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:37.672570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2873/5765] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:23:37 2022] POST /identity/v3/roles => generated 239 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:37.673532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.678335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:37.701519 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:37.721851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] MFA Rules not processed for user `d3098d02a0814cf7ada5aae6bedf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:37.727354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:37.764288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979b901-9efb-4a59-9047-cb61dc450a4e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:37.770502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:37.771878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.772313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.772737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.847443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:37.849649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0c9ac-680a-44d3-8a88-20f9e327cd59 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:37.851336 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2893/5766] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:37.854312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.864042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2874/5767] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:37.865709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.865996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.866267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.876413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad059d-adcb-45fa-8e8b-29a417332dd5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:37.885960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:37.887343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:37.888128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] MFA Rules not processed for user `d3098d02a0814cf7ada5aae6bedf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:37.888363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:37.889049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:37.889347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:37.890299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:37.893923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:37.897776 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2875/5768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:37.909807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.963126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2894/5769] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:23:37 2022] POST /identity/v3/groups => generated 327 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:37.968288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:37.993931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f4857-d9c8-4d6e-a17f-3e67fb6eb152 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:38.005056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:38.007984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:38.008608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:38.009152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8/users/6253e676f5dc4644b30265489219e30f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:38.029779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8eb7e32bc18f49b88e1f359c7d463bc8, user_id=6253e676f5dc4644b30265489219e30f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:38.029779 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:38.029779 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:23:38.029779 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:38.030726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:38.093760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2895/5770] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:23:37 2022] PUT /identity/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8/users/6253e676f5dc4644b30265489219e30f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:38.098070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:38.113358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e8c2-e7fd-4beb-aa46-c3b3158620bb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:38.251186 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:38.273675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7fee-2804-4935-9a7a-200f543c9c22 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:38.276552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:38.278226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:38.279171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:38.279171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:38.288605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:38.289325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:38.289799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:38.290147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/890958417a204bd890b5dc1b30e8a95d/groups/8eb7e32bc18f49b88e1f359c7d463bc8/roles/176318c1616245ca907abc108731f501` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:38.292773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=890958417a204bd890b5dc1b30e8a95d, group_id=8eb7e32bc18f49b88e1f359c7d463bc8, role_id=176318c1616245ca907abc108731f501)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:38.296190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:38.300891 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:38.316907 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2896/5771] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:38 2022] PUT /identity/v3/domains/890958417a204bd890b5dc1b30e8a95d/groups/8eb7e32bc18f49b88e1f359c7d463bc8/roles/176318c1616245ca907abc108731f501 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:38.320893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:38.326728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:38.384217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:38.390879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:38.415263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2876/5772] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:38.548844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47a5d-38a3-4874-90b0-d7f418a1b98c tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:38.570758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6253e676f5dc4644b30265489219e30f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '847f88c19a1a4bc9a8581506e5805c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:38.571853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:38.572148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:38.572427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] PATH_INFO: `/v3/auth/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:38.575131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:38.579597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:38.719234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2897/5773] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:23:38 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:23:38.719413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:38.733030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f9c-7174-45b8-a051-599bd8e7e571 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:38.913969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:38.914936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:38.915323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:38.915724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/890958417a204bd890b5dc1b30e8a95d/groups/8eb7e32bc18f49b88e1f359c7d463bc8/roles/176318c1616245ca907abc108731f501` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:38.918971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=890958417a204bd890b5dc1b30e8a95d, group_id=8eb7e32bc18f49b88e1f359c7d463bc8, role_id=176318c1616245ca907abc108731f501)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:38.921981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:38.930715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role 176318c1616245ca907abc108731f501 was removed from group 8eb7e32bc18f49b88e1f359c7d463bc8 on domain 890958417a204bd890b5dc1b30e8a95d. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:38.931143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:38.932044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f4e5085b-c7b3-4307-a45e-cd1f6e47ee95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:38.976920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:38.978033 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2877/5774] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:23:38 2022] DELETE /identity/v3/domains/890958417a204bd890b5dc1b30e8a95d/groups/8eb7e32bc18f49b88e1f359c7d463bc8/roles/176318c1616245ca907abc108731f501 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:38.990245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:39.003063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:39.003356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:39.003797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:39.023162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d7e39-6a61-479c-8d28-36994b1636be tempest-TokensV3TestJSON-56035851 tempest-TokensV3TestJSON-56035851-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:39.097692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] MFA Rules not processed for user `d3098d02a0814cf7ada5aae6bedf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:39.099030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:39.243726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:39.244543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:39.244834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:39.245819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8/users/6253e676f5dc4644b30265489219e30f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:39.248422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8eb7e32bc18f49b88e1f359c7d463bc8, user_id=6253e676f5dc4644b30265489219e30f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:39.249523 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:23:39.249523 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:23:39.249523 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:23:39.250689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:39.267994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2878/5775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:39.268994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:39.270436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:39.272400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:39.279072 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:39.330801 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2898/5776] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:23:38 2022] DELETE /identity/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8/users/6253e676f5dc4644b30265489219e30f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:39.332928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:39.399235 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:39.567760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb84c9-8a0c-4f7f-a05d-0c2b0cd74c12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:39.579589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:39.581950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:39.581950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:39.581950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:39.585168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8eb7e32bc18f49b88e1f359c7d463bc8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:39.621304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:39.632011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6502de2-42ba-4917-800c-a1cfdf8b3ee1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:39.737620 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2899/5777] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:23:39 2022] DELETE /identity/v3/groups/8eb7e32bc18f49b88e1f359c7d463bc8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:39.741723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:39.833256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:39.833951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:39.837353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:39.837693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:39.842267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:40.017563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484f943-b257-4c13-83cc-a6b4c7dbd496 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:40.032251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:40.035463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:40.035750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:40.050010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles/176318c1616245ca907abc108731f501` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:40.050010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_role(role_id=176318c1616245ca907abc108731f501)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:40.050010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:40.111034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:40.115476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:40.177164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role 176318c1616245ca907abc108731f501 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:40.177546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.178559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.187696 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2900/5778] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:39 2022] DELETE /identity/v3/roles/176318c1616245ca907abc108731f501 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:40.188858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:40.190459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:40.223505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2879/5779] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 945 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:40.243024 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:40.411182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ccd6-29d3-4669-afc3-8bf50506b687 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:40.453085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:40.453789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:40.454071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:40.455095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/890958417a204bd890b5dc1b30e8a95d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:40.455828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=890958417a204bd890b5dc1b30e8a95d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:40.457211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:40.546737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.549894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.607209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.614447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:40.628311 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2901/5780] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:40 2022] PATCH /identity/v3/domains/890958417a204bd890b5dc1b30e8a95d => generated 275 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:40.628661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:40.656238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b85fe-1f43-4c2e-b5d2-9f66e1cecc0a service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:40.899792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:40.901330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:40.933877 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:40.958029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:40.958689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:40.958969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:40.961670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/890958417a204bd890b5dc1b30e8a95d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:40.990517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=890958417a204bd890b5dc1b30e8a95d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:40.994266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:41.084586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.105039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '890958417a204bd890b5dc1b30e8a95d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.175321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4bd-e970-43d8-974b-78d16c300897 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:41.189200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:41.192484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:41.193172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:41.193635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] PATH_INFO: `/v3/users/1895e21cdf0f4ab5b064fafb1b3fb368` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:41.196271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1895e21cdf0f4ab5b064fafb1b3fb368)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:41.201937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:41.328931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.371157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.378774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1895e21cdf0f4ab5b064fafb1b3fb368'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.411264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.431858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1895e21cdf0f4ab5b064fafb1b3fb368'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.468026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project 890958417a204bd890b5dc1b30e8a95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:41.468517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.469967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.486082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1895e21cdf0f4ab5b064fafb1b3fb368'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.491088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1895e21cdf0f4ab5b064fafb1b3fb368'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.492884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47b73bc1-1fe6-47ba-999d-2325b8b1c78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1895e21cdf0f4ab5b064fafb1b3fb368'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.504550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.509711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.510889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '890958417a204bd890b5dc1b30e8a95d', 'request_id': 'req-294fe802-c73f-4a32-abe0-d87a0d32ddb6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.519133 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2880/5781] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:23:40 2022] DELETE /identity/v3/domains/890958417a204bd890b5dc1b30e8a95d => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:41.526535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:41.527465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2902/5782] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:40 2022] DELETE /identity/v3/users/1895e21cdf0f4ab5b064fafb1b3fb368 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:41.531934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:41.532217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:41.532668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:41.533585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:41.550882 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:41.581459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:41.583642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:41.641020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe802-c73f-4a32-abe0-d87a0d32ddb6 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:41.713940 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:41.765055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2903/5783] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:41.771601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:41.776872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:41.778880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:41.788190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:41.789531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:41.789867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/f200604b3ea043c580fad7f4daaea5a9/users/6253e676f5dc4644b30265489219e30f/roles/a99955869c0044fdb3cd7e10f1d8a43f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:41.802532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f200604b3ea043c580fad7f4daaea5a9, user_id=6253e676f5dc4644b30265489219e30f, role_id=a99955869c0044fdb3cd7e10f1d8a43f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:41.810950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:41.825090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role a99955869c0044fdb3cd7e10f1d8a43f was removed from user 6253e676f5dc4644b30265489219e30f on domain f200604b3ea043c580fad7f4daaea5a9. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:41.825777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.827152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:41.856124 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2881/5784] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 25 01:23:41 2022] DELETE /identity/v3/domains/f200604b3ea043c580fad7f4daaea5a9/users/6253e676f5dc4644b30265489219e30f/roles/a99955869c0044fdb3cd7e10f1d8a43f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:41.860222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:41.863366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:41.935923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecf44-3c3c-4301-b5ea-d96e454647af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:42.066080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7697a-143b-4924-a588-6aff3e7b25bf tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:42.071718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:42.072699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:42.073511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:42.074173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles/a99955869c0044fdb3cd7e10f1d8a43f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:42.076275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a99955869c0044fdb3cd7e10f1d8a43f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:42.078520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:42.144280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:42.150572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:42.150999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:42.151284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:42.157442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:42.205253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role a99955869c0044fdb3cd7e10f1d8a43f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:42.207791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.213349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.257807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2882/5785] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:41 2022] DELETE /identity/v3/roles/a99955869c0044fdb3cd7e10f1d8a43f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:42.257807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:42.261260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:42.385792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:42.388530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:42.422839 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2904/5786] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:42.424961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:42.437417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f046ff-f786-44c0-9e38-bec9c5cbb5db tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:42.448949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131c12-21b6-47e7-9d47-6026b12c8d6f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:42.449851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:42.451087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:42.452161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:42.452823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] PATH_INFO: `/v3/users/f33ca9c1d1bd4d8dbc768c1746d42e25` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:42.455004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33ca9c1d1bd4d8dbc768c1746d42e25)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:42.460291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:42.460851 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:42.615334 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:42.650157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:42.654499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:42.654978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:42.661161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33ca9c1d1bd4d8dbc768c1746d42e25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.661773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33ca9c1d1bd4d8dbc768c1746d42e25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.661947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/f200604b3ea043c580fad7f4daaea5a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:42.663633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f200604b3ea043c580fad7f4daaea5a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:42.671990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:42.686294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33ca9c1d1bd4d8dbc768c1746d42e25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.718834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33ca9c1d1bd4d8dbc768c1746d42e25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.720377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0f445926-655d-4538-8481-4e77027cc58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33ca9c1d1bd4d8dbc768c1746d42e25'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.739979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.740763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.761332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2883/5787] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:42 2022] DELETE /identity/v3/users/f33ca9c1d1bd4d8dbc768c1746d42e25 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:42.766568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:42.767526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:42.768214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:42.819278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:42.820503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:42.823296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.827077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:42.836092 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2905/5788] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:42 2022] PATCH /identity/v3/domains/f200604b3ea043c580fad7f4daaea5a9 => generated 278 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:42.838310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:42.841488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:42.960827 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2884/5789] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:43.001904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718d68-6ecb-49fe-90d8-dee4d9259038 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:43.014097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:43.015848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:43.107133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:43.108245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:43.109222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:43.111633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/f200604b3ea043c580fad7f4daaea5a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:43.117939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193ce-09bb-4d8d-8a40-472214a08185 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:43.125219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:43.126638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:43.127075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:43.127357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:43.133380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f200604b3ea043c580fad7f4daaea5a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:43.138571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:43.141172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:43.142883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:43.157128 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2885/5790] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:43.164605 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:43.171889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.176682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.242602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.256686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.284296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.306245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project f200604b3ea043c580fad7f4daaea5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:43.306657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.307495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.320407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.325096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.326465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f200604b3ea043c580fad7f4daaea5a9', 'request_id': 'req-6c068b0d-bca8-42b8-a691-7f4bbecaf818'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.337187 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2906/5791] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:23:42 2022] DELETE /identity/v3/domains/f200604b3ea043c580fad7f4daaea5a9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:43.338449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:43.358634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da970e-c29e-44fb-9e84-837c02b5b999 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:43.457098 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:43.497951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:43.498981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:43.501784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:43.502386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/roles/dd7928325f424cc5bde7cb0ee452cb60` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:43.516704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3c1c7a6e112c4d2cbde1f07e06c72a9c, group_id=8e738831f4b84ce4a0dbeb3864fcf0bd, role_id=dd7928325f424cc5bde7cb0ee452cb60)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:43.528535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:43.534210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role dd7928325f424cc5bde7cb0ee452cb60 was removed from group 8e738831f4b84ce4a0dbeb3864fcf0bd on domain 3c1c7a6e112c4d2cbde1f07e06c72a9c. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:43.534514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.535442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.572804 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2886/5792] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:23:43 2022] DELETE /identity/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/roles/dd7928325f424cc5bde7cb0ee452cb60 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:43.578106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:43.580091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:43.608741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c068b0d-bca8-42b8-a691-7f4bbecaf818 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:43.737007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:43.738750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:43.826594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:43.827281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:43.827569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:43.827849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/users/6253e676f5dc4644b30265489219e30f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:43.834238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8e738831f4b84ce4a0dbeb3864fcf0bd, user_id=6253e676f5dc4644b30265489219e30f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:43.836320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:43.853714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:43.880261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2907/5793] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:23:43 2022] DELETE /identity/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd/users/6253e676f5dc4644b30265489219e30f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:43.884381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:43.892983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:43.932842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406d03-df38-474c-88ed-1082f25a3ed1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.032235 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:44.073375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233897e-b21b-4a25-92f6-8e16a637e66a tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.085483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.086419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.087216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.087507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.087809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.088248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.088704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.089033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] PATH_INFO: `/v3/projects/70547d11ae944b3e8995271b37f509c0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.091060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70547d11ae944b3e8995271b37f509c0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.092933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8e738831f4b84ce4a0dbeb3864fcf0bd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.094926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.097630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.207248 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2908/5794] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:23:43 2022] DELETE /identity/v3/groups/8e738831f4b84ce4a0dbeb3864fcf0bd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:44.212265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:44.223636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70547d11ae944b3e8995271b37f509c0', 'request_id': 'req-deefc621-e296-4c40-9493-4d3b1d7edc90'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.244860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70547d11ae944b3e8995271b37f509c0', 'request_id': 'req-deefc621-e296-4c40-9493-4d3b1d7edc90'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.264080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70547d11ae944b3e8995271b37f509c0', 'request_id': 'req-deefc621-e296-4c40-9493-4d3b1d7edc90'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.298472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] The token cache is being invalidate because project 70547d11ae944b3e8995271b37f509c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:44.298862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.299897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.308341 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2887/5795] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:43 2022] DELETE /identity/v3/projects/70547d11ae944b3e8995271b37f509c0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:44.309464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:44.312686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:44.407382 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:44.426649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91ccb-a211-4f1a-b19e-64c91fbbd349 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.441023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.443625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.444541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.445485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles/dd7928325f424cc5bde7cb0ee452cb60` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.450582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dd7928325f424cc5bde7cb0ee452cb60)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.453377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.507594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc621-e296-4c40-9493-4d3b1d7edc90 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.533049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role dd7928325f424cc5bde7cb0ee452cb60 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:44.534680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.536703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.541313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2909/5796] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:44 2022] DELETE /identity/v3/roles/dd7928325f424cc5bde7cb0ee452cb60 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:44.542420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:44.547602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:44.638270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.638913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.639189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.639462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] PATH_INFO: `/v3/projects/23809750555c4833995dcc11499fa523` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.642131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23809750555c4833995dcc11499fa523)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.644277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565572b6-8b25-4fbd-9cdc-419f454f6fe7 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.648593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.649726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.651550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.651945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.652679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] PATH_INFO: `/v3/users/6a900b0a34dc4b3aa7287c9ce9adf101` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.654112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a900b0a34dc4b3aa7287c9ce9adf101)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.658530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.688397 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:44.746321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23809750555c4833995dcc11499fa523', 'request_id': 'req-13d86a07-844e-4d18-94ca-c43bc3f84d33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.771055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a900b0a34dc4b3aa7287c9ce9adf101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.785061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23809750555c4833995dcc11499fa523', 'request_id': 'req-13d86a07-844e-4d18-94ca-c43bc3f84d33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.787994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a900b0a34dc4b3aa7287c9ce9adf101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.809705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23809750555c4833995dcc11499fa523', 'request_id': 'req-13d86a07-844e-4d18-94ca-c43bc3f84d33'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.822009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a900b0a34dc4b3aa7287c9ce9adf101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.822868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a900b0a34dc4b3aa7287c9ce9adf101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.823723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a900b0a34dc4b3aa7287c9ce9adf101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.835271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] The token cache is being invalidate because project 23809750555c4833995dcc11499fa523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:44.835537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.836294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:44.839015 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2888/5797] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:44 2022] DELETE /identity/v3/projects/23809750555c4833995dcc11499fa523 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:44.843257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:44.851862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:44.856010 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2910/5798] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:44 2022] DELETE /identity/v3/users/6a900b0a34dc4b3aa7287c9ce9adf101 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:44.856010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:44.856766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:44.978543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3a17-a44a-4486-a045-62bb88952e1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.986696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:44.988164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:44.988455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:44.988728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] PATH_INFO: `/v3/users/bd65e7409e8340d2a5f2fd6b515a8909` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:44.989734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86a07-844e-4d18-94ca-c43bc3f84d33 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:44.990471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd65e7409e8340d2a5f2fd6b515a8909)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:44.992862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:44.999010 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:45.117305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd65e7409e8340d2a5f2fd6b515a8909'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.128934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd65e7409e8340d2a5f2fd6b515a8909'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.149339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd65e7409e8340d2a5f2fd6b515a8909'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.150582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd65e7409e8340d2a5f2fd6b515a8909'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.151432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:45.152721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd65e7409e8340d2a5f2fd6b515a8909'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.154137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:45.154886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:45.155174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:45.159417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3c1c7a6e112c4d2cbde1f07e06c72a9c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:45.163363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:45.180095 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2911/5799] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:44 2022] DELETE /identity/v3/users/bd65e7409e8340d2a5f2fd6b515a8909 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:45.204115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.204890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.238494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.239924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.248541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2889/5800] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:44 2022] PATCH /identity/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c => generated 277 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:45.249903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:45.252927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:45.268313 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:45.383069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577cb1f-9776-4fde-91f5-f0d5d3106a1c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:45.520720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:45.523519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:45.555986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:45.557212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:45.557661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:45.558426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:45.576643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3c1c7a6e112c4d2cbde1f07e06c72a9c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:45.579168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:45.628497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.638375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.674780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d1cd-1b5b-4ef3-be6e-d6bdadd219a8 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:45.686028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:45.686694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:45.686978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:45.687256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] PATH_INFO: `/v3/projects/451b1d80da6146d6a0f12243e3c56f4a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:45.690281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=451b1d80da6146d6a0f12243e3c56f4a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:45.692839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:45.723234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.733430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.741455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.764503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project 3c1c7a6e112c4d2cbde1f07e06c72a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:45.764820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.766811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.778272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.781765 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:45.785361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.787577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3c1c7a6e112c4d2cbde1f07e06c72a9c', 'request_id': 'req-9b3fae6c-912d-449f-954f-79db18c0e86e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.791366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451b1d80da6146d6a0f12243e3c56f4a', 'request_id': 'req-2226739a-8e04-405f-a641-9ef92ec60a7a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.800848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2912/5801] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:23:45 2022] DELETE /identity/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:45.804669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:45.807040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:45.815670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451b1d80da6146d6a0f12243e3c56f4a', 'request_id': 'req-2226739a-8e04-405f-a641-9ef92ec60a7a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.842138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451b1d80da6146d6a0f12243e3c56f4a', 'request_id': 'req-2226739a-8e04-405f-a641-9ef92ec60a7a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.874672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] The token cache is being invalidate because project 451b1d80da6146d6a0f12243e3c56f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:45.875011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.877718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2226739a-8e04-405f-a641-9ef92ec60a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:45.880712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2890/5802] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:45 2022] DELETE /identity/v3/projects/451b1d80da6146d6a0f12243e3c56f4a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:45.885981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb082-d19c-417c-bae1-1e142f2a1f7b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:45.886271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb082-d19c-417c-bae1-1e142f2a1f7b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:45.887084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb082-d19c-417c-bae1-1e142f2a1f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:45.922367 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:45.951936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f8cfb082-d19c-417c-bae1-1e142f2a1f7b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:45.953178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f8cfb082-d19c-417c-bae1-1e142f2a1f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:45.967436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fae6c-912d-449f-954f-79db18c0e86e tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.038317 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2891/5803] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:46.047182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.047675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.048090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.088491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:46.091347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.104284 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2892/5804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:46.107190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.107891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.108171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.108444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e/users/6253e676f5dc4644b30265489219e30f/roles/bd5eb4f7f9c64d72876aa47be69b86de` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.109156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.117562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=33fd3dae5f474d1b85982a1fa8f82b1e, user_id=6253e676f5dc4644b30265489219e30f, role_id=bd5eb4f7f9c64d72876aa47be69b86de)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.120253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.131735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4262d64-9ba6-4dc9-83c3-a2997a9dd371 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.139015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.140131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.140676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.141280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.142284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role bd5eb4f7f9c64d72876aa47be69b86de was removed from user 6253e676f5dc4644b30265489219e30f on domain 33fd3dae5f474d1b85982a1fa8f82b1e. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:46.142603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.143204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:46.144109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.144571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.146920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.170608 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2893/5805] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:46.176323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.182365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.184253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2913/5806] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 25 01:23:45 2022] DELETE /identity/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e/users/6253e676f5dc4644b30265489219e30f/roles/bd5eb4f7f9c64d72876aa47be69b86de => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:46.185514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.186842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.236576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea5f5-926c-479b-8f3d-442b663c711e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.347840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.348770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.349204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.349687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.350476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.352783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.380872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9820fdd-878e-4ed8-9cee-546ebd219d11 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.398622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.399928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.400312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.400686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles/bd5eb4f7f9c64d72876aa47be69b86de` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.402469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bd5eb4f7f9c64d72876aa47be69b86de)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.404535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.413735 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2894/5807] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:46 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:46.415132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.446261 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:46.486546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role bd5eb4f7f9c64d72876aa47be69b86de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:46.486846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.491174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.493138 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2914/5808] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:46 2022] DELETE /identity/v3/roles/bd5eb4f7f9c64d72876aa47be69b86de => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:46.498127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.500433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.550577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c8cf-79ab-4c8e-9c5c-533ae43797c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.590314 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:46.698275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.702869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.703262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.704408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.705334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.709662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b68c6-5206-4806-92a7-110b1e802ba9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.714163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.733117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.733923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.734272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.734580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.736194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=33fd3dae5f474d1b85982a1fa8f82b1e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.738030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.751339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2895/5809] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:46 2022] POST /identity/v3/users => generated 292 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:46.756793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.760404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.818756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.819602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.823522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc395dcd-fb5d-4157-8165-787f200126df admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:46.877814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.878594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:46.885552 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2915/5810] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:46 2022] PATCH /identity/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e => generated 277 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:23:46.887823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:46.892842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:46.973261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:46.973865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:46.974154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:46.974483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:46.975161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:46.977954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:46.999440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2896/5811] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:47.000671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.003259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.026777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863f81-41e0-4d73-a164-778d7cbe0f28 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.030809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49dda-fff3-4359-ac95-f76c8ccac0a1 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.037706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.038436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.038657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.038953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.039746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.042268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.043484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.045390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.047645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.051729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.056118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=33fd3dae5f474d1b85982a1fa8f82b1e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.059502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.089147 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2897/5812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:47.094222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.099945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.104806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.158479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d969a0-8f18-41d6-bb81-6e4ca58a2453 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.175695 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:47.178770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.180824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.184497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.184497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] PATH_INFO: `/v3/projects/f619193042f04d90aa7fd371dc279a15/users/699bf009aca54fccb9ec863c4f320cd5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.210939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.223865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.226226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f619193042f04d90aa7fd371dc279a15, user_id=699bf009aca54fccb9ec863c4f320cd5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.231410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.243919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.275759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2898/5813] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:47 2022] PUT /identity/v3/projects/f619193042f04d90aa7fd371dc279a15/users/699bf009aca54fccb9ec863c4f320cd5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:47.276613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.281817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.300300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project 33fd3dae5f474d1b85982a1fa8f82b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:47.300761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.301526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.345452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.357141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.360211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '33fd3dae5f474d1b85982a1fa8f82b1e', 'request_id': 'req-c19c366f-2197-4d58-bf77-b1413a65245b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.399722 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2916/5814] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:23:46 2022] DELETE /identity/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:47.400080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.404621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.499596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5d55-23bd-4fac-af30-c4d681388235 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.506231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.506966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.507231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.507501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] PATH_INFO: `/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.508722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7f4992b1bf407d9c0f68282a58e86e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.510878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.528967 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:47.593913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7f4992b1bf407d9c0f68282a58e86e', 'request_id': 'req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.594785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c366f-2197-4d58-bf77-b1413a65245b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.616857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7f4992b1bf407d9c0f68282a58e86e', 'request_id': 'req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.627558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7f4992b1bf407d9c0f68282a58e86e', 'request_id': 'req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.646980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] The token cache is being invalidate because project 8d7f4992b1bf407d9c0f68282a58e86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:47.647947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.648993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e2fe1a4b-4bd8-443a-bf23-66d393f4b9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:47.650840 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2899/5815] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:47 2022] DELETE /identity/v3/projects/8d7f4992b1bf407d9c0f68282a58e86e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:47.653742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.654300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.654813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.696329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] MFA Rules not processed for user `699bf009aca54fccb9ec863c4f320cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:47.698226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.702276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.702913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.703207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.703486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.704411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.705994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4977b-defb-4a0f-8deb-cfb90c303733 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.736471 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2917/5816] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:47.738951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.739250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.739523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.815851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:47.817165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.821855 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2900/5817] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:47.823036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.844046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.885174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85609-139a-4ad1-a1f4-2b9892aa80a7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:47.912142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:47.912841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:47.913129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:47.919478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:47.924560 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:47.927057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3cef57a015a94d3d89c38e03cafcd95c, user_id=f71ac2bd07254e5d8bba9e0df5b55112, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:47.937726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:47.965720 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2901/5818] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:47 2022] PUT /identity/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:47.966668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.975126 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2918/5819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:47.975126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:47.975427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:47.993147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cece-0baf-491e-9998-4e401b8bf72e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.118573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.119255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.119477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.119753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.120330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.121965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.158917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e75734-67d5-4f8e-9fe0-cc2e235a5355 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.192939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.194972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.197599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.198449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.200521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.209282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d26a4-b5ef-45b7-88b1-45f46e59bf31 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.284438 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:48.294371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2902/5820] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:47 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:48.298568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.298939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.300623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.316421 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2919/5821] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:23:47 2022] GET /identity/v3/auth/projects => generated 826 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:48.317835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.343001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:48.344386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:48.344533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72fad7-0632-4d59-9d53-161cbffef5d9 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.534329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.535256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.536144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.536599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.537439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.540866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.588152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2903/5822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:48.593112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.593335 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2920/5823] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:48 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:48.594235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.615295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a89a-2aab-4263-8c8c-e8a8242d344c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.624241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.625245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.625718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.625858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.626529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:48.626837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.628933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.647702 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2921/5824] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:48.648960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.670540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576d9f2-14e2-429d-be39-546ead47735c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.695828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.696470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.696753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.697027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.697712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.703330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.733753 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2922/5825] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:48.735354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.744892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb94a9-7713-43bf-a60c-9d6384948e87 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.760382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d5f8-17f8-4e16-9e6a-130721557197 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:48.761589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.763818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.764375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.764975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.774183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3cef57a015a94d3d89c38e03cafcd95c, user_id=f71ac2bd07254e5d8bba9e0df5b55112, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.776115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:48.776743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:48.777065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:48.777341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:48.779879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.786788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:48.788756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:48.791665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role ce0f72b1198f4b18845fae1c4d7f94af was removed from user f71ac2bd07254e5d8bba9e0df5b55112 on project 3cef57a015a94d3d89c38e03cafcd95c. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:48.792431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:48.794565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:48.807779 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:48.821784 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2904/5826] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 25 01:23:48 2022] DELETE /identity/v3/projects/3cef57a015a94d3d89c38e03cafcd95c/users/f71ac2bd07254e5d8bba9e0df5b55112/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:48.827880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.831631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:48.876886 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2923/5827] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:48 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:48.877799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:48.893108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:49.055342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa271f7-10c3-4624-8a73-55ff54108f47 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.125296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65c3b-c820-4cb2-a655-40e69563ec7f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.141860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.143430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.145433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.146160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.149344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.155417 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:49.156724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.203558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.204185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.204471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.204869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.205724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.207341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.222497 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2924/5828] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:48 2022] POST /identity/v3/users => generated 323 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:49.223519 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2905/5829] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:49.224375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.224516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.231638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:49.239530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c173b-1d9e-4bbc-8b0c-38faebe85d40 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.245030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.246381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.246822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.247230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] PATH_INFO: `/v3/projects/b1c8014cd92c450193554f82187f60f4/users/54630f374b114d7fa976acda8f314f02/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.260896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c125f-536f-4f1b-b896-11e3535cfa09 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.268288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c8014cd92c450193554f82187f60f4, user_id=54630f374b114d7fa976acda8f314f02, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.271105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.279551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.280550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.280838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.281783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.281783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.284000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92da4e0-157c-4aac-88d1-9dbd63f8f16c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.296065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2906/5830] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:49 2022] PUT /identity/v3/projects/b1c8014cd92c450193554f82187f60f4/users/54630f374b114d7fa976acda8f314f02/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:49.297352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.309716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2925/5831] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:49.311438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.311880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.312913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.350499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] MFA Rules not processed for user `54630f374b114d7fa976acda8f314f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:49.352095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:49.403065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13cd9c-5c47-4eec-b29d-52ed468428fe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.422825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.422825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.422825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.423087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.423462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.426115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.487537 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2907/5832] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:49.488404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.506168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2926/5833] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:49.512666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.548464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55239-885d-48c4-bf2d-770b8cf3b795 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.658153 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:49.684456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.688916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.691684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.693708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.694802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff92b11-aace-45b1-aa36-dc8aa025969d tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.697470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.703310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.704243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.705796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.706114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.706610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.707273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.709172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.726939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2908/5834] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:49.727716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.764339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2927/5835] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/projects => generated 363 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:49.764811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c378117-dbf0-4fce-bcc7-5839749f58c0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.765649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.821837 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:49.892683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.894599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.895553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.898279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.900627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.903585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.916961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff7b2-5c1a-4509-8e6d-437231065831 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:49.924031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:49.924803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:49.925181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:49.925794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:49.926551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:49.929234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:49.942272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2928/5836] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:49.943644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:49.952234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2909/5837] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:49.953139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.075515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8ab9d-8dcd-4ad2-83ce-95b40e5f8c22 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.092172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db0c9-2e56-434b-9a42-8f169a0c5b2b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.098105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.098790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.099069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.099347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] PATH_INFO: `/v3/projects/95a2bdded9774dfa8422055adaede901/users/cf95edb2c5894782b5fffa589f4091cb/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.173524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a2bdded9774dfa8422055adaede901, user_id=cf95edb2c5894782b5fffa589f4091cb, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.194524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.238442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2910/5838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:49 2022] PUT /identity/v3/projects/95a2bdded9774dfa8422055adaede901/users/cf95edb2c5894782b5fffa589f4091cb/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:50.240632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.298020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.299982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.300283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.301780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.303020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.309782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c460-b796-43b7-9564-e2d9f8506796 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.357921 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2929/5839] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:23:49 2022] POST /identity/v3/roles => generated 239 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:50.361199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.361710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.362147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.421398 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:50.423154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa475-944c-4bc9-abe5-33238fa95415 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.431673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.432302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.432582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.432855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.434666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.437502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] MFA Rules not processed for user `cf95edb2c5894782b5fffa589f4091cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:50.437895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.438918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:50.469502 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2911/5840] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:50 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:50.470316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.474680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:50.522227 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:50.542091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2930/5841] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:50.543809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.587830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a65b5-b52b-4441-ab9e-3e493f308d3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.594121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63fd402f1f146078a217a1cc04bc0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264247e02bac44f6921b0a5d7d4aa3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.595210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.595712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.596212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.597104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:50.597683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.599726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.616728 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2912/5842] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:50.617443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.632187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d19a2-d8f2-4a08-9533-0b8a16c6feb7 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.633774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8586-2f8c-49ba-bedf-9cabcdf1acce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.638996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.639577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.639863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.640167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/afabeace8a37499d9a317c485da53abb/users/a4e7ea6778b64b3ea261230a7dc2f950/roles/0d7c3cd61408495594bdbd91725ed0b8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.641317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.643176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.644197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.645847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.646973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.649071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.660812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(project_id=afabeace8a37499d9a317c485da53abb, user_id=a4e7ea6778b64b3ea261230a7dc2f950, role_id=0d7c3cd61408495594bdbd91725ed0b8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.664536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2913/5843] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:50 2022] GET /identity/v3/roles => generated 1650 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:50.665444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.665843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.684526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2931/5844] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:50 2022] PUT /identity/v3/projects/afabeace8a37499d9a317c485da53abb/users/a4e7ea6778b64b3ea261230a7dc2f950/roles/0d7c3cd61408495594bdbd91725ed0b8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:50.686248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.691616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129124-5a14-44fd-9042-28742607e164 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.789022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63fd402f1f146078a217a1cc04bc0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264247e02bac44f6921b0a5d7d4aa3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.790393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.791026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.791651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.793653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.796710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.800587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064045-c4a8-4944-9899-42f3c3f27ab3 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:50.812979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:50.814035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:50.814603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:50.815157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] PATH_INFO: `/v3/projects/deec79800517446fad6e997ed19d4211/users/3f0ac51d98d046a39a3869f6ff9a8042/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:50.835713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=deec79800517446fad6e997ed19d4211, user_id=3f0ac51d98d046a39a3869f6ff9a8042, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:50.855158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:50.877882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2914/5845] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:50 2022] POST /identity/v3/projects => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:50.880935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.905037 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2932/5846] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:50 2022] PUT /identity/v3/projects/deec79800517446fad6e997ed19d4211/users/3f0ac51d98d046a39a3869f6ff9a8042/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:50.905037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:50.906510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:50.927480 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.084627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f662-763d-4911-baa9-67a4c0c479cb tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.103721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104219-3f15-4f5e-916f-f8ee4a13e6bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.112166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.113132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.113434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.113712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.180927 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.197523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.199865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.209551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.210229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.210522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.210843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/0f55576041f64aea8d1b87deb2809063/users/a4e7ea6778b64b3ea261230a7dc2f950/roles/0d7c3cd61408495594bdbd91725ed0b8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.213676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f55576041f64aea8d1b87deb2809063, user_id=a4e7ea6778b64b3ea261230a7dc2f950, role_id=0d7c3cd61408495594bdbd91725ed0b8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.216745 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2933/5847] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:51.217707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.227137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.247549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2915/5848] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:50 2022] PUT /identity/v3/projects/0f55576041f64aea8d1b87deb2809063/users/a4e7ea6778b64b3ea261230a7dc2f950/roles/0d7c3cd61408495594bdbd91725ed0b8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:51.250527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.318550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e523-7337-4229-81c3-a11ecc376448 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.346073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989b450-14c3-41bb-8630-59d747a37965 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.353013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.354491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.354813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.355222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.356139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.357888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8993-8949-44f2-ba6c-84cb4d4fd72f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.369572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2916/5849] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:51 2022] GET /identity/v3/roles => generated 1650 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:51.371855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.372520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.372801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.382590 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.401069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63fd402f1f146078a217a1cc04bc0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264247e02bac44f6921b0a5d7d4aa3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.401717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.402189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.402679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.403433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:51.403739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.405376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0d4e9-c735-439f-9eab-69161ef232e2 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.408086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] MFA Rules not processed for user `a4e7ea6778b64b3ea261230a7dc2f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:51.409306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.413749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2917/5850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:51 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:51.413749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.423457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2934/5851] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:51.425032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.425746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.426030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.439308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66c36-e357-408e-a8ca-8f33b72ba6f4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.443300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] MFA Rules not processed for user `a4e7ea6778b64b3ea261230a7dc2f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:51.444499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.449705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.450504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.451195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.451474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] PATH_INFO: `/v3/projects/deec79800517446fad6e997ed19d4211/users/3f0ac51d98d046a39a3869f6ff9a8042/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.455104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=deec79800517446fad6e997ed19d4211, user_id=3f0ac51d98d046a39a3869f6ff9a8042, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.463694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b471a-34c6-44ca-be40-83bdd39f0d5f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.480116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2918/5852] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:51 2022] PUT /identity/v3/projects/deec79800517446fad6e997ed19d4211/users/3f0ac51d98d046a39a3869f6ff9a8042/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:51.490519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.491392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.491764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.528406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] MFA Rules not processed for user `3f0ac51d98d046a39a3869f6ff9a8042`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:51.529996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.534178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2935/5853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 25 01:23:51.539617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.630862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21481-eb9e-49eb-8889-45f2176ffa42 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.645274 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2919/5854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:51.657338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.659675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.710476 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.729706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.730967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.731881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.732183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.741225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0c0b-868b-4b8e-b4da-0d585530358d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.745648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.747646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.748287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.748810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.751241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.794166 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.815649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.818565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033a56f-8b73-455c-bdc1-bb1389b9a69b tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.842787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.842787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:51.846727 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2936/5855] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 25 01:23:51 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:51.851232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.851821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.852278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.854786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2920/5856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:23:51.867304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] MFA Rules not processed for user `a4e7ea6778b64b3ea261230a7dc2f950`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:51.868960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:51.954918 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2937/5857] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 25 01:23:51.958877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:51.976074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83566-c8ae-4438-9798-dcca5d4ce665 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:51.982139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:51.982793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:51.983080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:51.983357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/roles/0d7c3cd61408495594bdbd91725ed0b8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:51.984935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0d7c3cd61408495594bdbd91725ed0b8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:51.986611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.058590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invalidating the token cache because role 0d7c3cd61408495594bdbd91725ed0b8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:52.058987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.060644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.067896 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2921/5858] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:51 2022] DELETE /identity/v3/roles/0d7c3cd61408495594bdbd91725ed0b8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:52.069374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.097899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.099949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:52.104404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797be20-8493-4ab0-a74f-0de8f0cacca9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:52.192987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169948a4-a639-45c9-9ba3-7a262763c866 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:52.201796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63fd402f1f146078a217a1cc04bc0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264247e02bac44f6921b0a5d7d4aa3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:52.202467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:52.202938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:52.203236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] PATH_INFO: `/v3/projects/f8a14ddbe8f448bb95607b519c0171c4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:52.205342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8a14ddbe8f448bb95607b519c0171c4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:52.207907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.234787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:52.235748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:52.236037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:52.236332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/0f55576041f64aea8d1b87deb2809063` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:52.237803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f55576041f64aea8d1b87deb2809063)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:52.241135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.321561 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:52.325233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a14ddbe8f448bb95607b519c0171c4', 'request_id': 'req-e73f09d9-0061-4f50-a973-41a89c1c5494'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.346509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a14ddbe8f448bb95607b519c0171c4', 'request_id': 'req-e73f09d9-0061-4f50-a973-41a89c1c5494'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.363766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a14ddbe8f448bb95607b519c0171c4', 'request_id': 'req-e73f09d9-0061-4f50-a973-41a89c1c5494'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.398765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] The token cache is being invalidate because project f8a14ddbe8f448bb95607b519c0171c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:52.399068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.400329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.417329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2922/5859] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:52 2022] DELETE /identity/v3/projects/f8a14ddbe8f448bb95607b519c0171c4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:52.419322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.424621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:52.425540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f55576041f64aea8d1b87deb2809063', 'request_id': 'req-7adf56d9-b04a-4c45-b027-c096917d8665'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.440220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f55576041f64aea8d1b87deb2809063', 'request_id': 'req-7adf56d9-b04a-4c45-b027-c096917d8665'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.448955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f55576041f64aea8d1b87deb2809063', 'request_id': 'req-7adf56d9-b04a-4c45-b027-c096917d8665'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.488251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project 0f55576041f64aea8d1b87deb2809063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:52.489896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.491520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.495589 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2938/5860] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:52 2022] DELETE /identity/v3/projects/0f55576041f64aea8d1b87deb2809063 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:52.506676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.510561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:52.531659 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:52.615252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f09d9-0061-4f50-a973-41a89c1c5494 tempest-RoutersIpV6AdminTest-898131993 tempest-RoutersIpV6AdminTest-898131993-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:52.658153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf56d9-b04a-4c45-b027-c096917d8665 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:52.671776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:52.672576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:52.672929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:52.673345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/0f55576041f64aea8d1b87deb2809063` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:52.689892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f55576041f64aea8d1b87deb2809063)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:52.695398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Could not find project: 0f55576041f64aea8d1b87deb2809063.: keystone.exception.ProjectNotFound: Could not find project: 0f55576041f64aea8d1b87deb2809063. Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 25 01:23:52.722788 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0f55576041f64aea8d1b87deb2809063. Sep 25 01:23:52.723893 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:52.733258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2939/5861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:52 2022] DELETE /identity/v3/projects/0f55576041f64aea8d1b87deb2809063 => generated 113 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:23:52.734336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.747061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:52.747693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:52.748004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:52.748279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:52.750445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:52.770125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199f285-12f6-4afc-8702-b883a89dada4 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:52.778660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:52.779745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:52.780991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:52.781692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/projects/afabeace8a37499d9a317c485da53abb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:52.783031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_project(project_id=afabeace8a37499d9a317c485da53abb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:52.785270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.840110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:52.843071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:52.854180 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2923/5862] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:52.916493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afabeace8a37499d9a317c485da53abb', 'request_id': 'req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.936091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afabeace8a37499d9a317c485da53abb', 'request_id': 'req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.955749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afabeace8a37499d9a317c485da53abb', 'request_id': 'req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.973098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] The token cache is being invalidate because project afabeace8a37499d9a317c485da53abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:52.973392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.977904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:52.980062 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2940/5863] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:52 2022] DELETE /identity/v3/projects/afabeace8a37499d9a317c485da53abb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:52.983747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:52.999893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a0bd3-9f28-4eef-b037-63631df931e4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.142677 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:53.176927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:53.177677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.177970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.178244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/users/a4e7ea6778b64b3ea261230a7dc2f950` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.187033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a4e7ea6778b64b3ea261230a7dc2f950)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:53.192991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:53.288611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e7ea6778b64b3ea261230a7dc2f950'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.289595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e7ea6778b64b3ea261230a7dc2f950'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.306932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e7ea6778b64b3ea261230a7dc2f950'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.332787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e7ea6778b64b3ea261230a7dc2f950'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.335551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e7ea6778b64b3ea261230a7dc2f950'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.363684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2924/5864] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:52 2022] DELETE /identity/v3/users/a4e7ea6778b64b3ea261230a7dc2f950 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:53.366958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:53.372662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:53.389579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:53.395241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:53.417477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2421c-fd3f-44bf-b9ed-2c1d13e33136 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.564282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dad9b-3b89-4532-aa51-2d43d99c2a95 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.591093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:53.591758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.592043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.592317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] PATH_INFO: `/v3/users/cf95edb2c5894782b5fffa589f4091cb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.598198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf95edb2c5894782b5fffa589f4091cb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:53.600138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:53.645035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:53.645649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.645891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.646168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/890958417a204bd890b5dc1b30e8a95d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.680767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Could not find domain: 890958417a204bd890b5dc1b30e8a95d.: keystone.exception.DomainNotFound: Could not find domain: 890958417a204bd890b5dc1b30e8a95d. Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 890958417a204bd890b5dc1b30e8a95d. Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:53.701187 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:23:53.702392 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 890958417a204bd890b5dc1b30e8a95d. Sep 25 01:23:53.703382 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.708810 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2941/5865] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:53 2022] PATCH /identity/v3/domains/890958417a204bd890b5dc1b30e8a95d => generated 112 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:23:53.709940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:53.719920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:53.755230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00529e-9a5c-4b5a-b948-0a09db13c3ec tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.759502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf95edb2c5894782b5fffa589f4091cb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.772133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf95edb2c5894782b5fffa589f4091cb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.785214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:53.786238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.786754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.787187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/f200604b3ea043c580fad7f4daaea5a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.797398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:23:53.798010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf95edb2c5894782b5fffa589f4091cb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Could not find domain: f200604b3ea043c580fad7f4daaea5a9.: keystone.exception.DomainNotFound: Could not find domain: f200604b3ea043c580fad7f4daaea5a9. Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f200604b3ea043c580fad7f4daaea5a9. Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:53.803669 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:23:53.804923 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f200604b3ea043c580fad7f4daaea5a9. Sep 25 01:23:53.806393 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.809990 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2942/5866] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:53 2022] PATCH /identity/v3/domains/f200604b3ea043c580fad7f4daaea5a9 => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:23:53.814235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:53.816710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:53.835858 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:53.842068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139805e2-2c3f-46b5-9a2a-15e1a3b54a12 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.842647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf95edb2c5894782b5fffa589f4091cb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.844147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d6e0c8bb-1ffc-46b2-8eef-88593f0afee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf95edb2c5894782b5fffa589f4091cb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:53.869929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2925/5867] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:53 2022] DELETE /identity/v3/users/cf95edb2c5894782b5fffa589f4091cb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:53.873673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:53.874529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.876024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.876472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.892361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:23:53.892575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:53.894071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:53.894679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Could not find domain: 3c1c7a6e112c4d2cbde1f07e06c72a9c.: keystone.exception.DomainNotFound: Could not find domain: 3c1c7a6e112c4d2cbde1f07e06c72a9c. Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3c1c7a6e112c4d2cbde1f07e06c72a9c. Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:53.901036 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:23:53.902554 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3c1c7a6e112c4d2cbde1f07e06c72a9c. Sep 25 01:23:53.903738 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:53.927013 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2943/5868] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:53 2022] PATCH /identity/v3/domains/3c1c7a6e112c4d2cbde1f07e06c72a9c => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:23:53.930921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:53.956523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc435dd-38a3-4702-abb3-e9fe20751880 tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:53.959107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:53.961644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:53.963074 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:54.084892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f71ac2bd07254e5d8bba9e0df5b55112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6dc9de39bc84baf8275572857b81afd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:54.085784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:54.086145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:54.086523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] PATH_INFO: `/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:54.094982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:23:54.095547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2926/5869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Could not find domain: 33fd3dae5f474d1b85982a1fa8f82b1e.: keystone.exception.DomainNotFound: Could not find domain: 33fd3dae5f474d1b85982a1fa8f82b1e. Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 33fd3dae5f474d1b85982a1fa8f82b1e. Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:23:54.100709 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:23:54.101996 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 33fd3dae5f474d1b85982a1fa8f82b1e. Sep 25 01:23:54.103167 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:23:54.104509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2944/5870] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:23:53 2022] PATCH /identity/v3/domains/33fd3dae5f474d1b85982a1fa8f82b1e => generated 112 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:23:54.108879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:54.110671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:54.128640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79442-fbf1-4305-b88e-a4cbee3c10b0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:54.134356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:54.135321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:54.135922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:54.136675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] PATH_INFO: `/v3/users/fdfe9eb3da064ea68a9f1b42f2ef6374` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:54.139480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:54.142690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:54.153938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfe9eb3da064ea68a9f1b42f2ef6374)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:54.158525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:54.234128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82107ed-5510-4a49-b0d3-fefda87414bd tempest-TokensV3TestJSON-325976274 tempest-TokensV3TestJSON-325976274-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:54.244183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:54.249097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:54.249764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:54.252030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:54.272459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:54.275189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26961a20-0f4a-4b73-b64a-c68a54dca6ef service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:54.285164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfe9eb3da064ea68a9f1b42f2ef6374'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:54.287188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfe9eb3da064ea68a9f1b42f2ef6374'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:54.294876 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2945/5871] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:54.303325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfe9eb3da064ea68a9f1b42f2ef6374'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:54.331147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfe9eb3da064ea68a9f1b42f2ef6374'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:54.332071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfe9eb3da064ea68a9f1b42f2ef6374'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:54.363126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2927/5872] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:54 2022] DELETE /identity/v3/users/fdfe9eb3da064ea68a9f1b42f2ef6374 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:23:54.370323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:54.370323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:54.372257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:54.408399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:54.409821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:54.549287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2946/5873] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:54.573676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:54.576432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:54.724958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be111-308e-45d4-9e30-9ec91d99dc33 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:54.732192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:54.737187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:54.737631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:54.738056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:54.761265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:54.763137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:54.774741 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:54.786882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2928/5874] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:55.176694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:55.178820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.283031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bacf0-fe19-46d3-9922-a034fe2dec4a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:55.287092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:55.287780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:55.288252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:55.288606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:55.290757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.295355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:55.297616 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:55.299799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.337279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5143f2-1b28-4965-942b-66d016b9a953 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:55.356224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:55.357093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:55.357377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:55.357855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] PATH_INFO: `/v3/projects/95a2bdded9774dfa8422055adaede901` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:55.364174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a2bdded9774dfa8422055adaede901)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:55.366837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:55.481816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:55.483466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f456f6c-8c91-4d79-b685-e737eccef732 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:55.536500 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2947/5875] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:55.572675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a2bdded9774dfa8422055adaede901', 'request_id': 'req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:55.592749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a2bdded9774dfa8422055adaede901', 'request_id': 'req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:55.612856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a2bdded9774dfa8422055adaede901', 'request_id': 'req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:55.641735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] The token cache is being invalidate because project 95a2bdded9774dfa8422055adaede901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:55.642184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:55.645333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:55.654074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2929/5876] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:55 2022] DELETE /identity/v3/projects/95a2bdded9774dfa8422055adaede901 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:55.656853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226275-a744-48d3-8d4d-2c12dbd915cd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:55.658486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226275-a744-48d3-8d4d-2c12dbd915cd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:55.659044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226275-a744-48d3-8d4d-2c12dbd915cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:55.706988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-95226275-a744-48d3-8d4d-2c12dbd915cd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:55.711757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95226275-a744-48d3-8d4d-2c12dbd915cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.746182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:55.748175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.895527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2948/5877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:55.907217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:55.907575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:55.907995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:55.966444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:55.967769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:55.968674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0ff6-2413-4bb7-997f-2dae3129eef6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:55.978825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:55.981340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:55.984594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:55.985538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] PATH_INFO: `/v3/projects/3cef57a015a94d3d89c38e03cafcd95c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:55.991410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cef57a015a94d3d89c38e03cafcd95c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:55.995874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2949/5878] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:23:55.996961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:55.999504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.017977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3223-1ac7-4eb6-804a-d64a6a3e6e8a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.035985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.036771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.037058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.037387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.038030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:23:56.038336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.039964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.065705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2950/5879] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:23:56.069521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.092937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cef57a015a94d3d89c38e03cafcd95c', 'request_id': 'req-b7b649ff-7c13-4ab4-abae-59b9058c2bec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.096875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85802eb-ccc9-4b73-8ef8-ca3745aa02e8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.105449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cef57a015a94d3d89c38e03cafcd95c', 'request_id': 'req-b7b649ff-7c13-4ab4-abae-59b9058c2bec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.124711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cef57a015a94d3d89c38e03cafcd95c', 'request_id': 'req-b7b649ff-7c13-4ab4-abae-59b9058c2bec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.148744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] The token cache is being invalidate because project 3cef57a015a94d3d89c38e03cafcd95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:56.151081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.152683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.154747 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2930/5880] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:55 2022] DELETE /identity/v3/projects/3cef57a015a94d3d89c38e03cafcd95c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:56.159611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.162839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:56.196996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:56.271179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.272260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.272543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.272820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.273493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.276766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.293051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b649ff-7c13-4ab4-abae-59b9058c2bec admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.299737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.300706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.301145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.301621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] PATH_INFO: `/v3/users/f71ac2bd07254e5d8bba9e0df5b55112` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.304208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71ac2bd07254e5d8bba9e0df5b55112)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.308931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.345013 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2951/5881] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:23:56 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:56.347928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.351971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:56.447956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71ac2bd07254e5d8bba9e0df5b55112'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.451256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71ac2bd07254e5d8bba9e0df5b55112'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.452877 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:56.505767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71ac2bd07254e5d8bba9e0df5b55112'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.553174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71ac2bd07254e5d8bba9e0df5b55112'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.554143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71ac2bd07254e5d8bba9e0df5b55112'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:56.583167 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2931/5882] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:56 2022] DELETE /identity/v3/users/f71ac2bd07254e5d8bba9e0df5b55112 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:56.604412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bad48-ea97-46c6-8528-805652364f05 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.742657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.743495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.743987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.744368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.745134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.747485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.805240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2952/5883] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:23:56 2022] POST /identity/v3/users => generated 288 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:23:56.810029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.811628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:56.857904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d6e5-a380-4f77-83fe-2fb205a71d92 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.877841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.882754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.885368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.885861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.889122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.899024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:56.937208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.952177 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2932/5884] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:56.954526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12869-34df-4a77-8fc8-a2d69a4e30be admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:56.967315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:56.970528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:56.981073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:56.983546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:56.984824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:56.986224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:56.988536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:56.991785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:57.035188 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2953/5885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:23:57.040812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:57.077556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ad918-6b9e-49ae-8cc0-663939c7e985 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:57.093635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:57.095662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:57.096459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:57.097679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] PATH_INFO: `/v3/projects/0a408e8689a04981ab7a8ccc52914fba/users/f1e59b7516f1419890705219d08bc6fb/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:57.147583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a408e8689a04981ab7a8ccc52914fba, user_id=f1e59b7516f1419890705219d08bc6fb, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:57.157826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8ff1-eca4-4a34-977b-69a24c1689af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:57.185484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2a65-5485-40d1-b828-57c00876a15e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:57.213264 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2954/5886] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:23:57 2022] PUT /identity/v3/projects/0a408e8689a04981ab7a8ccc52914fba/users/f1e59b7516f1419890705219d08bc6fb/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:57.216056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:57.216374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:57.216679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:57.303133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] MFA Rules not processed for user `f1e59b7516f1419890705219d08bc6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:23:57.304310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:57.314128 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:57.344572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:57.345198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:57.345512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:57.345787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:57.348467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:57.473800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2955/5887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:23:57.489389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:57.491365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:57.500423 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:57.508492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:57.510118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:57.522759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2933/5888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:57.617281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ab3d-b203-4921-978b-40bc12bcabc0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:57.626386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:57.627399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:57.627700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:57.627960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:57.638310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:57.640435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:57.652965 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2956/5889] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:23:58.009961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:58.011749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:58.236256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27906658-61b9-4038-92be-9fae6640218a service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:58.256763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:58.257477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:58.257735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:58.258172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] PATH_INFO: `/v3/projects/b6dc9de39bc84baf8275572857b81afd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:58.260318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dc9de39bc84baf8275572857b81afd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:58.262926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:58.379731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dc9de39bc84baf8275572857b81afd', 'request_id': 'req-386a9ef0-a77e-4ff8-9bfe-572a850abedc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.393940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dc9de39bc84baf8275572857b81afd', 'request_id': 'req-386a9ef0-a77e-4ff8-9bfe-572a850abedc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.411899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dc9de39bc84baf8275572857b81afd', 'request_id': 'req-386a9ef0-a77e-4ff8-9bfe-572a850abedc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.453781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] The token cache is being invalidate because project b6dc9de39bc84baf8275572857b81afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:23:58.454086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.455392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.461002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2934/5890] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:58 2022] DELETE /identity/v3/projects/b6dc9de39bc84baf8275572857b81afd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:58.465988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:58.486057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339bcad-e1d4-413f-b760-b186b1dc0c1c service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:58.702317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:58.703372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:58.703852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:58.704554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] PATH_INFO: `/v3/users/6253e676f5dc4644b30265489219e30f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:58.709132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6253e676f5dc4644b30265489219e30f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:58.726470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:23:58.854006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.869946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.900052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.913436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.916140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79557b23-f6e3-434e-bffc-5cd4e89dd7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6253e676f5dc4644b30265489219e30f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:23:58.941100 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2957/5891] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:23:58 2022] DELETE /identity/v3/users/6253e676f5dc4644b30265489219e30f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:23:59.775194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:23:59.778782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:23:59.806888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a9ef0-a77e-4ff8-9bfe-572a850abedc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:23:59.825291 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:59.923218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:23:59.923882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:23:59.924238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:23:59.924520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] PATH_INFO: `/v3/projects/847f88c19a1a4bc9a8581506e5805c4a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:23:59.925716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847f88c19a1a4bc9a8581506e5805c4a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:23:59.927662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:00.067082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847f88c19a1a4bc9a8581506e5805c4a', 'request_id': 'req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.077187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847f88c19a1a4bc9a8581506e5805c4a', 'request_id': 'req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.091229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847f88c19a1a4bc9a8581506e5805c4a', 'request_id': 'req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.113154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] The token cache is being invalidate because project 847f88c19a1a4bc9a8581506e5805c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:00.114102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.114760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.118450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2935/5892] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:23:59 2022] DELETE /identity/v3/projects/847f88c19a1a4bc9a8581506e5805c4a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:00.123823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.124642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.125072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.178215 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:00.201629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:00.203640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.211548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:00.218195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.404740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b04f5-95c9-4dfd-8651-5dfb35caacc5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:00.420286 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2958/5893] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:00.421081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:00.431736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:00.432360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.432545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.433462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.433886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] PATH_INFO: `/v3/users/f1e59b7516f1419890705219d08bc6fb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.453801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e59b7516f1419890705219d08bc6fb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:00.455338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413ea1-8e38-4912-bbe4-2d29bc870907 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:00.463979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:00.465831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:00.466718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.467158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.467582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] PATH_INFO: `/v3/users/0b6b3f79b49c4c13a2fdceba3b60d09f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.468921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6b3f79b49c4c13a2fdceba3b60d09f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:00.471129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:00.597070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6b3f79b49c4c13a2fdceba3b60d09f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.612194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e59b7516f1419890705219d08bc6fb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.613008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e59b7516f1419890705219d08bc6fb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.615791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6b3f79b49c4c13a2fdceba3b60d09f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.615928 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:00.631075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e59b7516f1419890705219d08bc6fb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.648213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6b3f79b49c4c13a2fdceba3b60d09f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.649241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6b3f79b49c4c13a2fdceba3b60d09f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.650096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3b4270f6-9257-43e3-a4cf-fe795cf3e7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6b3f79b49c4c13a2fdceba3b60d09f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.659354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e59b7516f1419890705219d08bc6fb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.660257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e3ed1cec-038c-4656-82ed-862b4c90623f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e59b7516f1419890705219d08bc6fb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:00.672071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2959/5894] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:00 2022] DELETE /identity/v3/users/0b6b3f79b49c4c13a2fdceba3b60d09f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:00.673487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.673702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.673970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.682083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2936/5895] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:00 2022] DELETE /identity/v3/users/f1e59b7516f1419890705219d08bc6fb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:00.686981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.687403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.687786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.722987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:00.724567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.738818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:00.740194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.846127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2937/5896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:00.854194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:00.856233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:00.865380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2960/5897] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:00.867083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:00.886181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc48918-a3e4-40cb-96e8-5073f06905f1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:00.902807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:00.903751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.904258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.904756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.905699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:00.906282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:00.909107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:00.930454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2961/5898] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:00.933520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:00.954981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd309f-5bb0-49b9-bab2-8116a7206229 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:00.960925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:00.962720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:00.963692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:00.965551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:00.981511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:00.983500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:00.999053 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:01.021452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bd3b5-bc48-44d1-b8f0-08697bfd9e58 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.041630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.048463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.049060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.049543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.056686 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2962/5899] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:00 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:01.062238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.081775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.083420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.107856 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2938/5900] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:24:01.221688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.223173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:01.228574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5bd25-898f-4f33-8921-b845a186b118 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.237521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.238743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.239029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.239308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.240339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.242685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.251812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88896-98c4-48ce-a6c6-a96d5aff0244 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.259536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.260284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.260688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.260884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] PATH_INFO: `/v3/projects/d0c73d4bbb354b0fafd5f5a714f6d4a0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.267347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c73d4bbb354b0fafd5f5a714f6d4a0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.270968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.290249 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2963/5901] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:01 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:01.311981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.349302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fe7e-a206-4aa1-9197-9886937a97ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.362067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.364809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.365096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.365520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.366071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.369913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.382501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'request_id': 'req-b335035a-041f-4439-a095-ba139014a1db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:01.391480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2964/5902] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:01.397258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.401059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'request_id': 'req-b335035a-041f-4439-a095-ba139014a1db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:01.423517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'request_id': 'req-b335035a-041f-4439-a095-ba139014a1db'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:01.426783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a973-bca6-4e20-9566-b58ca023bc8d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.431428 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:01.452856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] The token cache is being invalidate because project d0c73d4bbb354b0fafd5f5a714f6d4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:01.453241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:01.454246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b335035a-041f-4439-a095-ba139014a1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:01.457671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2939/5903] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:01 2022] DELETE /identity/v3/projects/d0c73d4bbb354b0fafd5f5a714f6d4a0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:01.463071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa033d-68a5-45a8-b514-52389f274602 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.463575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa033d-68a5-45a8-b514-52389f274602 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.463860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa033d-68a5-45a8-b514-52389f274602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.521215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-32aa033d-68a5-45a8-b514-52389f274602 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:01.524624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32aa033d-68a5-45a8-b514-52389f274602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:01.577511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.578516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.578869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.579234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.580740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.583186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.618707 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2965/5904] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:01.624307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.628168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:01.675254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2940/5905] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:01.685384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.688534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.688822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.691221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1082a1-8a71-45ff-95d8-a1da41036a43 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.702165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.703566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.703864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.704927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] PATH_INFO: `/v3/projects/50bd3c91231146e59ff72bfa55ca12b9/users/a8b01eb821bf48c0bd5eb5c1ef524db7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.743107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:01.745206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:01.749831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bd3c91231146e59ff72bfa55ca12b9, user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.752298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896303-1f47-41d8-bfca-8fba8ce39903 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.764535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2941/5906] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:01.774404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:01.781762 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2966/5907] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:01 2022] PUT /identity/v3/projects/50bd3c91231146e59ff72bfa55ca12b9/users/a8b01eb821bf48c0bd5eb5c1ef524db7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:01.791626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.792044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.792976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.795053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181858c3-2b35-470a-812d-42d682e9a7e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:01.884973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] MFA Rules not processed for user `a8b01eb821bf48c0bd5eb5c1ef524db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:01.888581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:01.940938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:01.940938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:01.945556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:01.945870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:01.947149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:01.947458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:01.949636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:01.959539 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:01.995349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2942/5908] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:01.997050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.004646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.034946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324d0c-40b3-4b51-b7b5-25332bf29132 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.047466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.048580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.049160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.049629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] PATH_INFO: `/v3/projects/0a408e8689a04981ab7a8ccc52914fba` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.052659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a408e8689a04981ab7a8ccc52914fba)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.054960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.057567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2967/5909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:02.059072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.079741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434d9d7-23d7-419e-b4da-764426b93d56 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.087909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.088989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.090047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.092313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.093187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.099053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.167884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a408e8689a04981ab7a8ccc52914fba', 'request_id': 'req-6e1e9683-6773-465c-8eec-9b7aa68113d8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:02.191616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2968/5910] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:02.192984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.199113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a408e8689a04981ab7a8ccc52914fba', 'request_id': 'req-6e1e9683-6773-465c-8eec-9b7aa68113d8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:02.218952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a408e8689a04981ab7a8ccc52914fba', 'request_id': 'req-6e1e9683-6773-465c-8eec-9b7aa68113d8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:02.247420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] The token cache is being invalidate because project 0a408e8689a04981ab7a8ccc52914fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:02.248218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:02.249955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:02.253558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2943/5911] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:01 2022] DELETE /identity/v3/projects/0a408e8689a04981ab7a8ccc52914fba => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:02.254924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.257624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.278259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec223d-60bc-4b4c-9b0f-fde369c29619 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.283392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.284126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.284967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.284967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.285702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.288615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc1ee-d48a-4ae0-b1e0-ca4ca693ef10 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.289310 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:02.410320 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2969/5912] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 789 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:02.414012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.415173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.416358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.457682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:02.458660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9683-6773-465c-8eec-9b7aa68113d8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.463183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.610502 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:02.626324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.628201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.628520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.629191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.630236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.632840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d045401-9f4b-42ec-9304-0b64db30293a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.646167 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2970/5913] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:02.656651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.664437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.686509 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2944/5914] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/users => generated 291 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:02.687702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f430c-8d7c-4666-b508-fbf16b4dd47b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.689207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f430c-8d7c-4666-b508-fbf16b4dd47b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.689790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f430c-8d7c-4666-b508-fbf16b4dd47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.709775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58498e58-c0a7-41e1-827e-54f2bfbcde25 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.727731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.728525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.728931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.729326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/1be95f84692b402f8aeaed77d41d2972` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.753130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-139f430c-8d7c-4666-b508-fbf16b4dd47b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:02.754951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-139f430c-8d7c-4666-b508-fbf16b4dd47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.756402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:get_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=1be95f84692b402f8aeaed77d41d2972)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.769495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.771478 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2971/5915] 10.222.0.16 () {58 vars in 1392 bytes} [Sun Sep 25 01:24:02 2022] GET /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/1be95f84692b402f8aeaed77d41d2972 => generated 689 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:02.774111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.779645 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2945/5916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:02.781116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.781428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.785103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.818827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1befc3-2e36-423f-8cdd-32f939f54b4f tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.822045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] MFA Rules not processed for user `a8b01eb821bf48c0bd5eb5c1ef524db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:02.825694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:02.832037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.833667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.834178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.834603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.836261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.838365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.858827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2972/5917] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:02.861791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.882600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881d2d-ed62-43ee-aadd-9f280d52f554 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.889904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.890704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.891102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.891465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.893296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:02.893760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.896722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.918306 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2973/5918] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:02.919323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.933298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086fcfc-2e0f-451e-8f10-130078f8d27c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.941830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.942645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.943059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.943628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.945239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.950854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:02.971280 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2974/5919] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:02.971280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:02.985043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc228b-c836-4faf-9b5c-b14169bf34a5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:02.990991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:02.992524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:02.992874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:02.993218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:02.994525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:02.998258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.039495 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:03.046081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2975/5920] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:03.046081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.057435 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2946/5921] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 25 01:24:03.059386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.137348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aef8c-2118-46cd-8c23-9b1729e03bd9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.145894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.149917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.150393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.150836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] PATH_INFO: `/v3/projects/10fa7c775d924acda02fb364a1818ba2/users/d4b32b37164a44f3a6ab4f0b4335cfbb/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.169054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351997b-7a1a-49ee-8231-408c5be2a23f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.173724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.174471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.174845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.175243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.175987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.176659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fa7c775d924acda02fb364a1818ba2, user_id=d4b32b37164a44f3a6ab4f0b4335cfbb, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.178271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b452d6-e529-4320-9d80-1d0748ca51e6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.180280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.213089 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2976/5922] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:03 2022] PUT /identity/v3/projects/10fa7c775d924acda02fb364a1818ba2/users/d4b32b37164a44f3a6ab4f0b4335cfbb/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:03.215434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.234874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2947/5923] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:03 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:03.236956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.237828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.238266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.311167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:03.314281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:03.411880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532277f6-49a1-4781-86c7-cf8222c9df67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.426431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.427014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.427680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.429354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/1be95f84692b402f8aeaed77d41d2972` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.429771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=1be95f84692b402f8aeaed77d41d2972)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.436254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.456688 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:03.476397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2977/5924] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:03 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/1be95f84692b402f8aeaed77d41d2972 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:03.477762 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2948/5925] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:03.478133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.481911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.493148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d969f6-e1f2-40a3-9b2b-c18c881dd35b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.496228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce009a-5d02-4360-ae3d-47e404229f72 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.497989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.498830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.499329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.500736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.501813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.502408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.503184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.503493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.504606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.505048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.506075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.509154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.528161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2978/5926] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:03.529448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.531421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:03.619477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2949/5927] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:24:03 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 921 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:24:03.621143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.623027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e060-33bb-4ce7-aaa5-c75eb3648a46 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.627428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.628182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.628566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.628945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.641657 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:03.645209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.647773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.650509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e559c6-afb1-4068-8a67-84801c5edd81 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.659080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.660119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.660625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.661254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.662192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.663636 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2979/5928] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:03.664762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.665191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.681276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f8bb-36b7-4829-aed7-2bebdcb4ff11 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.684916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2950/5929] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:03.689046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.690331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.691891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.692448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.694520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/d3bfee41e8ba482b9bc07f299d3f420a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.706316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247da662-da06-4e44-9574-b8c1cccf3ef1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.713062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.713956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=d3bfee41e8ba482b9bc07f299d3f420a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.714659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.715528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.715869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] PATH_INFO: `/v3/projects/2f306c688a1b4837871b0b45378e36e0/users/f2d2d473604047e49affedf50c2996d7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.717882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.740406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f306c688a1b4837871b0b45378e36e0, user_id=f2d2d473604047e49affedf50c2996d7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.743460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6393a-07a8-4d9a-86c3-2cd238dde86b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:03.749790 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2980/5930] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:03 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/d3bfee41e8ba482b9bc07f299d3f420a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:03.754908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:03.767007 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2951/5931] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:03 2022] PUT /identity/v3/projects/2f306c688a1b4837871b0b45378e36e0/users/f2d2d473604047e49affedf50c2996d7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:03.773393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2beb-ff02-41ee-85e9-1bef9aa6c4ca tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:03.779968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.780268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.780568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.859119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] MFA Rules not processed for user `f2d2d473604047e49affedf50c2996d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:03.863719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:03.894283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:03.895376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:03.896110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:03.896110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:03.897417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:03.899415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.015106 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:04.023858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2981/5932] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 25 01:24:03 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 812 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:04.024459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2952/5933] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:04.030425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.039175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.040613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:04.046018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62ccf6-a4f6-4a6c-b506-33880c809dbe tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.050947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.052173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.052888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.054215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/f6261ef53c994affba4ed6670880ab5c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.068952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=f6261ef53c994affba4ed6670880ab5c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.071283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.101358 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2982/5934] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:04 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/f6261ef53c994affba4ed6670880ab5c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:04.107006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.140366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249436-b88c-4e36-87bc-4fcb1c08e120 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.153347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.156750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.157092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.157362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.159355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.163026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa614-d9a7-4704-8284-5ee33ceb102a tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.205341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918a63-49f4-4802-809e-3ce3460cd7fe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.220459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.222302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.222607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.222887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.247413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.249703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.275234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2953/5935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:24:04.328739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2983/5936] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 25 01:24:04 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 788 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:24:04.330446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.344359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef9d7d-af38-4f15-8848-ca4cd0e284bd service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.349004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.349700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.350254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.350547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.351262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.352480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.392287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.393142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.394850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.440383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] MFA Rules not processed for user `f2d2d473604047e49affedf50c2996d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:04.442763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:04.461882 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2984/5937] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 25 01:24:04.468799 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:04.550306 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2954/5938] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 25 01:24:04 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 789 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:04.555372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.595534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4251ad-a0b7-4f93-8c35-2491981e2bfe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.606916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.607965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.612745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.613279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.614334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.620276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.661228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2985/5939] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:24:04 2022] GET /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 1501 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:04.665367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.680833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a6b5-534b-4da0-bee3-2a18e5192943 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.694931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.695787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.696252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.696593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/f5d968b371134e25a07f5072e311808d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.727247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=f5d968b371134e25a07f5072e311808d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.728920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.779783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2955/5940] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:04 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/f5d968b371134e25a07f5072e311808d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:04.781584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.801909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d3acc-acc0-48a0-bc8d-86651baafcaa tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.815806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.816485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.816758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.817033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/62f8ab6a0ba0437c9115a2dceb6726c1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.847668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=62f8ab6a0ba0437c9115a2dceb6726c1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.849204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:04.889754 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2986/5941] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:04 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/62f8ab6a0ba0437c9115a2dceb6726c1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:04.892594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:04.908810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b487e-53ad-43ba-8fc1-5eb24f8d8dbf tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:04.914969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:04.916255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:04.916869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:04.918042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:04.919142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:04.920959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.109613 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2956/5942] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 25 01:24:04 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 788 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:05.113637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:05.124697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471178-a8c1-44e4-b519-cd3adb307e55 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:05.135120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:05.136355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:05.136772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:05.137168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:05.138012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:create_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:05.139623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.347584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:05.349419 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2987/5943] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 25 01:24:05 2022] POST /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials => generated 789 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:05.364068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dbaa5-d492-43d9-a2a3-a1dc9c6a953b tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:05.369450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:05.370391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:05.370779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:05.371255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:05.372091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Adding query filter params (name=tempest-application_credential-1347492894) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:05.372508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:05.374597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.408386 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2957/5944] 10.222.0.16 () {58 vars in 1386 bytes} [Sun Sep 25 01:24:05 2022] GET /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials?name=tempest-application_credential-1347492894 => generated 887 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:05.409579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:05.428750 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:05.436610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b80c-a51a-4258-b4e0-bf6ac66acbcc tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:05.446548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:05.447343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:05.449035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:05.449928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/5498c50c9065487780f32aa70e8c3473` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:05.463104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=5498c50c9065487780f32aa70e8c3473)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:05.465704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.518836 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2988/5945] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:05 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/5498c50c9065487780f32aa70e8c3473 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:05.524681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:05.540960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25682-e081-4eb2-928b-cf0b7a049e52 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:05.549031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b01eb821bf48c0bd5eb5c1ef524db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50bd3c91231146e59ff72bfa55ca12b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:05.551234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:05.551234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:05.551234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/b12b71de92144545855f6eb2f882ec20` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:05.575619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7, application_credential_id=b12b71de92144545855f6eb2f882ec20)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:05.578168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2907d2-face-4f72-9f73-bb574bf352ff tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.639054 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2958/5946] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 25 01:24:05 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7/application_credentials/b12b71de92144545855f6eb2f882ec20 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:05.644250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:05.646447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:05.815579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981edd4-f913-4f99-9bd7-74606e3e2e70 tempest-ApplicationCredentialsV3Test-1353785260 tempest-ApplicationCredentialsV3Test-1353785260-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:05.834734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:05.835637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:05.836097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:05.836380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] PATH_INFO: `/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:05.839682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b01eb821bf48c0bd5eb5c1ef524db7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:05.841923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:05.957616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b01eb821bf48c0bd5eb5c1ef524db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:05.973232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b01eb821bf48c0bd5eb5c1ef524db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.023666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b01eb821bf48c0bd5eb5c1ef524db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.028589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b01eb821bf48c0bd5eb5c1ef524db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.030171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b01eb821bf48c0bd5eb5c1ef524db7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.062412 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2989/5947] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:05 2022] DELETE /identity/v3/users/a8b01eb821bf48c0bd5eb5c1ef524db7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:06.067136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:06.067683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:06.068326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:06.117427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:06.118656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:06.252108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2959/5948] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:06.326863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:06.328401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:06.520689 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:06.534081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b96ec-b00a-44d4-abce-30e45072f9c0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:06.538792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:06.540569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:06.542641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:06.543759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:06.544122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:06.544467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:06.554541 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:06.573054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:06.574079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa46cb-332f-468b-a6fa-0bf1cb5e4db9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:06.575724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6741b-9ecd-4646-bad2-e797883cf6a4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:06.588326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:06.589503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:06.590038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:06.590522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] PATH_INFO: `/v3/users/f2d2d473604047e49affedf50c2996d7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:06.594351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d2d473604047e49affedf50c2996d7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:06.596553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:06.597645 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2990/5949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:06.696545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d2d473604047e49affedf50c2996d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.697682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d2d473604047e49affedf50c2996d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.707934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d2d473604047e49affedf50c2996d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.759411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d2d473604047e49affedf50c2996d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.760195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d2d473604047e49affedf50c2996d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:06.789714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2960/5950] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:06 2022] DELETE /identity/v3/users/f2d2d473604047e49affedf50c2996d7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:06.804111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:06.804403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:06.808419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:06.841149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:06.842630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:06.981729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2991/5951] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:07.044252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:07.048264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:07.163660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5936-b0e1-474a-a9a0-c05fd01c9b2b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:07.171126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:07.172204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:07.174299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:07.175866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:07.215039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:07.216548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729feaa-1231-4a46-a601-64e0b52f5530 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:07.241598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2961/5952] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:08.309696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:08.311332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:08.333153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eed87-9140-4dd4-a421-2834e7223cd2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:08.355717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:08.356405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.356767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.357118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] PATH_INFO: `/v3/projects/50bd3c91231146e59ff72bfa55ca12b9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.358425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bd3c91231146e59ff72bfa55ca12b9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:08.362822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:08.500120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bd3c91231146e59ff72bfa55ca12b9', 'request_id': 'req-2a06016c-a59e-4711-af97-9126e271f365'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:08.507148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bd3c91231146e59ff72bfa55ca12b9', 'request_id': 'req-2a06016c-a59e-4711-af97-9126e271f365'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:08.514493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bd3c91231146e59ff72bfa55ca12b9', 'request_id': 'req-2a06016c-a59e-4711-af97-9126e271f365'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:08.530840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] The token cache is being invalidate because project 50bd3c91231146e59ff72bfa55ca12b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:08.531213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:08.531978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a06016c-a59e-4711-af97-9126e271f365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:08.534317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2992/5953] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:08 2022] DELETE /identity/v3/projects/50bd3c91231146e59ff72bfa55ca12b9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:08.538800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.539262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.539364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.575008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:08.576670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:08.777082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2962/5954] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:08.784485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.784789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.785072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.827391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:08.828331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:08.856305 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2993/5955] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:08.860818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:08.874787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d33494-c2b8-4853-a85e-1ebc5f8a2b1e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:08.889267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:08.890155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.890675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.891314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.892220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:08.892525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:08.894197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:08.911539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:08.912962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:08.939251 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2963/5956] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:08.939463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5ce7-ec9c-489c-9996-cc5941c66a4b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:08.941087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:08.955680 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:08.956660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:08.957323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.957635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.957916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] PATH_INFO: `/v3/projects/2f306c688a1b4837871b0b45378e36e0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.960564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f306c688a1b4837871b0b45378e36e0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:08.967722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:08.971752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f96ab-7d50-4d45-baa3-6bb9f76334de admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:08.990814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:08.991498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:08.991883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:08.992175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:08.992804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:08.994897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.088412 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2964/5957] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:08 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:09.090081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.101659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f306c688a1b4837871b0b45378e36e0', 'request_id': 'req-11906fb8-345c-4015-85b3-2aa7ca2ca937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:09.110035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f306c688a1b4837871b0b45378e36e0', 'request_id': 'req-11906fb8-345c-4015-85b3-2aa7ca2ca937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:09.129151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f306c688a1b4837871b0b45378e36e0', 'request_id': 'req-11906fb8-345c-4015-85b3-2aa7ca2ca937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:09.132568 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:09.173105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] The token cache is being invalidate because project 2f306c688a1b4837871b0b45378e36e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:09.173487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:09.174190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11906fb8-345c-4015-85b3-2aa7ca2ca937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:09.180030 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2994/5958] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:08 2022] DELETE /identity/v3/projects/2f306c688a1b4837871b0b45378e36e0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:09.184759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f11b2-135f-4ba7-9991-4f34a7269d0b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.185053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f11b2-135f-4ba7-9991-4f34a7269d0b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.185336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f11b2-135f-4ba7-9991-4f34a7269d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.222583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4b1f11b2-135f-4ba7-9991-4f34a7269d0b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:09.223829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b1f11b2-135f-4ba7-9991-4f34a7269d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:09.278731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826777a4-1fa1-4892-8a26-3805f9995c5f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.290982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.292605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.293265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.293956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.294809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.298977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.344417 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2965/5959] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:09.345920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.348171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:09.375776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237116b-2615-4cdc-9d74-83f0b5e4128f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.397185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2995/5960] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:09.407060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.408362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.409239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.410116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.410734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.425780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.426422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.429199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.434030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.468997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:09.472990 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2966/5961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:09.474387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:09.474797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.486705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2996/5962] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:09.492547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.505055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b4e5-3b31-4169-ac6d-2de3a5176a34 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.523248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.523881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.524165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.524440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.525094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.531078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742005e-9c8b-4f4a-a477-b091b7587061 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.533286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.559402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.560254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.560566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.560944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.566022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:09.568084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.571100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.572508 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2967/5963] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:09.579986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.619404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556370-729e-4410-8bd1-cb85766af688 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.625373 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2997/5964] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:09.626494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.629213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.629934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.630217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.630500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] PATH_INFO: `/v3/projects/e9a58255a166436c995acdc8977838ee/users/6021bc98aa9b48f39592dbe8e3624d7c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.654456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8719a0-9984-4104-ac85-bf659e57146c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:09.659732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:09.660944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.661518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.661904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.662855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.665199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4cad9-59e1-4f9b-ae9f-24d3d00b556d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.671329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a58255a166436c995acdc8977838ee, user_id=6021bc98aa9b48f39592dbe8e3624d7c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:09.674346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:09.703737 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2968/5965] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:09 2022] PUT /identity/v3/projects/e9a58255a166436c995acdc8977838ee/users/6021bc98aa9b48f39592dbe8e3624d7c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:09.708298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2998/5966] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:09.710204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.715479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:09.715850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:09.716203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:09.790091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] MFA Rules not processed for user `6021bc98aa9b48f39592dbe8e3624d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:09.791759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:09.883499 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2999/5967] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:09.905331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:09.927780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eee87-3325-4195-ab08-ba36940debd3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.018437 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:10.053759 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:10.073809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.074533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.075034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.075332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.076331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.079024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.115296 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2969/5968] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/users => generated 290 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:10.116512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fe3e4-0d1d-479d-9b62-c798c894caa4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.132016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.139694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.140341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.140625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.143792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.144528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.146556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.160580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4bd5a-ac11-44de-9c2f-a555ad0c0119 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.185993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.186651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.187040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.191664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.192570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.202446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.225775 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3000/5969] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:09 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:10.227411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.239952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2970/5970] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:10.244517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.282953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f7be-a377-4e11-98ed-ee0eb5dc1079 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.420541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf03cc-3975-4205-a3e0-f8e87bae69de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.434812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.435668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.436136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.436586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.437397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.439540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.487211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.487842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.488125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.488421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.489174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.490879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.503177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3001/5971] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:10 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:24:10.504187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.508458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:10.515000 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2971/5972] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:10.515948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.541536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde12b1-ccfb-4c98-812e-dc5761dd26d5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.547133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8321d1-d322-4820-af88-3bf15adf1058 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.563670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.564352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.564672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.565496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.566212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.566503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.567168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.567558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.567937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] PATH_INFO: `/v3/users/699bf009aca54fccb9ec863c4f320cd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.568817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.574595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699bf009aca54fccb9ec863c4f320cd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.578170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.612697 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2972/5973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:10.616205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.649441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5c6c5-e2f0-419b-84bc-fa3c34f35656 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.671877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:10.672591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.672876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.673163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] PATH_INFO: `/v3/projects/1af93ee90d9d415b850745b7374348b8/users/45ae26af1d0d4104850875f565485d49/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.713076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af93ee90d9d415b850745b7374348b8, user_id=45ae26af1d0d4104850875f565485d49, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:10.717615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:10.718249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699bf009aca54fccb9ec863c4f320cd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:10.736128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699bf009aca54fccb9ec863c4f320cd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:10.754278 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2973/5974] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:10 2022] PUT /identity/v3/projects/1af93ee90d9d415b850745b7374348b8/users/45ae26af1d0d4104850875f565485d49/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:10.755259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:10.757997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699bf009aca54fccb9ec863c4f320cd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:10.758973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699bf009aca54fccb9ec863c4f320cd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:10.759792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-089147b3-e84f-473b-851f-a605bb94a667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699bf009aca54fccb9ec863c4f320cd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:10.798268 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3002/5975] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:10 2022] DELETE /identity/v3/users/699bf009aca54fccb9ec863c4f320cd5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:10.801873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb06d-0fce-431a-a90c-035339e57ce3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:10.804850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb06d-0fce-431a-a90c-035339e57ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:10.805546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb06d-0fce-431a-a90c-035339e57ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:10.865791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-748fb06d-0fce-431a-a90c-035339e57ce3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:10.880601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-748fb06d-0fce-431a-a90c-035339e57ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:10.904483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ccb9c-91c0-46c8-81ea-407becc04162 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:10.941810 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:10.945173 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:11.031344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:11.032905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.034082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.034549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.036403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:11.057272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:11.071142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3003/5976] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:11.072695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.072989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.076484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.090186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2974/5977] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:11.093877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:11.095728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:11.124117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9830f8-0e05-41f4-bbc3-e2277b1906a3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:11.128310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:11.131894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:11.132585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.132870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.133147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] PATH_INFO: `/v3/projects/95106a365134442086811e115ca429ba/users/05e27db1865a4a12b2bed495e7ca57c2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.133744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:11.165513 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3004/5978] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:11.166490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:11.169245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:11.183982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95106a365134442086811e115ca429ba, user_id=05e27db1865a4a12b2bed495e7ca57c2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:11.186775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfaf4a-cf61-453c-80a5-f66bf13a3e46 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:11.219546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2975/5979] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:11 2022] PUT /identity/v3/projects/95106a365134442086811e115ca429ba/users/05e27db1865a4a12b2bed495e7ca57c2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:11.229268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.230396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.230396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.290413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] MFA Rules not processed for user `05e27db1865a4a12b2bed495e7ca57c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:11.291701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:11.375693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d0674-04bf-40d3-acb4-38bb0a06f56b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:11.476918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:11.477585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.477873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.478144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.540236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2976/5980] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:11.544713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:11.583674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edafa2-d5d3-44ea-a9ec-e904ce36861e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:11.599273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:11.602140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:11.602596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:11.604913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:11.640726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:11.642843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:11.643884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:11.649340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0911278-7104-4771-b6f0-5227e1be128c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:11.677061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3005/5981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:11.678064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:11.686473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:11.705696 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2977/5982] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:11.815016 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:12.054793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115163-beea-4381-b1d2-abc6b7b890c5 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:12.068828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:12.068828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:12.069143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:12.069243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:12.073388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:12.309128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:12.312906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:12.340343 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3006/5983] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:12.687707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00544414-58b7-4c87-bbe7-eb89fab600bf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:12.688871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00544414-58b7-4c87-bbe7-eb89fab600bf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:12.689319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00544414-58b7-4c87-bbe7-eb89fab600bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:12.722509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-00544414-58b7-4c87-bbe7-eb89fab600bf None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:12.747269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-00544414-58b7-4c87-bbe7-eb89fab600bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.021027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2978/5984] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:13.100940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:13.103548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.184812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62bb0-7788-4a46-9816-61f0879aa377 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.185890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62bb0-7788-4a46-9816-61f0879aa377 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.186580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62bb0-7788-4a46-9816-61f0879aa377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:13.225369 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:13.297450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68f62bb0-7788-4a46-9816-61f0879aa377 None None] MFA Rules not processed for user `d4b32b37164a44f3a6ab4f0b4335cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:13.299005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68f62bb0-7788-4a46-9816-61f0879aa377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.394999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd183-57e1-4464-ae22-48e922685554 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:13.416195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:13.418348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.418348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.418348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:13.435979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2979/5985] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:13.447004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.447541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.448021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:13.448561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:13.450859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:13.482773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] MFA Rules not processed for user `d4b32b37164a44f3a6ab4f0b4335cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:13.484873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.505543 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2980/5986] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:13.524253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3007/5987] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:13.553431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:13.556959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.822492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569c9f5-c70e-4893-83c6-addcbd2b0088 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:13.838184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:13.843104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.843321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.844652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:13.852788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:13.855274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.903589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:13.910526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf692-346b-4294-a131-c9c2b2854a2a service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:13.911142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:13.930475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:13.931703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.935107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.935585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] PATH_INFO: `/v3/projects/f619193042f04d90aa7fd371dc279a15` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:13.939702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f619193042f04d90aa7fd371dc279a15)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:13.944169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:13.944929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2981/5988] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:13.950300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:13.962603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:13.993534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438c832-8685-48cb-b871-90b183631f42 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:13.997363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:13.998034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:13.998316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:13.998587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:14.044463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:14.048689 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:14.049903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:14.073532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f619193042f04d90aa7fd371dc279a15', 'request_id': 'req-63754b7c-1d29-4a6f-a2d2-f864554068e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.093860 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2982/5989] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:14.104640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f619193042f04d90aa7fd371dc279a15', 'request_id': 'req-63754b7c-1d29-4a6f-a2d2-f864554068e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.132823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f619193042f04d90aa7fd371dc279a15', 'request_id': 'req-63754b7c-1d29-4a6f-a2d2-f864554068e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.191132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] The token cache is being invalidate because project f619193042f04d90aa7fd371dc279a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:14.191448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.193875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-63754b7c-1d29-4a6f-a2d2-f864554068e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.201759 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3008/5990] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:13 2022] DELETE /identity/v3/projects/f619193042f04d90aa7fd371dc279a15 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:14.203079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:14.226238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a724281-6cbd-43c0-97d1-dd60de5c0982 service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:14.347330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:14.347619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:14.347899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:14.408594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:14.409256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:14.409609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:14.409888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] PATH_INFO: `/v3/users/54630f374b114d7fa976acda8f314f02` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:14.410546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:14.415277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:14.417070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54630f374b114d7fa976acda8f314f02)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:14.419155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:14.422549 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:14.508553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54630f374b114d7fa976acda8f314f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.509233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54630f374b114d7fa976acda8f314f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.519902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54630f374b114d7fa976acda8f314f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.538902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54630f374b114d7fa976acda8f314f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.539873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54630f374b114d7fa976acda8f314f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:14.547312 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3009/5991] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:14.548840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:14.550702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:14.563479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2983/5992] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:14 2022] DELETE /identity/v3/users/54630f374b114d7fa976acda8f314f02 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:14.730963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fd96e-9495-45ad-9077-e60b131af3d2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:14.895219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:14.895862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:14.896146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:14.896422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:14.913078 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:15.004626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:15.009809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f5e08-57bf-497d-9c68-767414742283 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:15.029849 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3010/5993] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:15.230907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:15.233064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:15.436286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc133bd-01a8-4f30-8e20-847eff5f1891 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:15.454312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:15.458557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:15.460587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:15.460973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] PATH_INFO: `/v3/users/6021bc98aa9b48f39592dbe8e3624d7c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:15.467223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6021bc98aa9b48f39592dbe8e3624d7c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:15.491524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:15.651684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6021bc98aa9b48f39592dbe8e3624d7c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:15.655306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6021bc98aa9b48f39592dbe8e3624d7c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:15.683719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6021bc98aa9b48f39592dbe8e3624d7c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:15.722644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6021bc98aa9b48f39592dbe8e3624d7c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:15.725234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6021bc98aa9b48f39592dbe8e3624d7c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:15.744946 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:15.758179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2984/5994] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:15 2022] DELETE /identity/v3/users/6021bc98aa9b48f39592dbe8e3624d7c => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:15.763135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:15.763674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:15.763674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:15.810276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:15.817435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:16.029051 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3011/5995] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:16.050572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:16.053544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:16.227365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109550d9-8c43-4ac9-bbd5-83b08fad2104 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:16.246085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:16.247000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:16.247302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:16.247712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:16.311751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:16.313256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:16.352195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2985/5996] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:16.795491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:16.798187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:16.821465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c32c2-93d3-46a3-89ee-c4660b6784a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:16.833975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:16.834646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:16.834973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:16.835253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] PATH_INFO: `/v3/projects/b1c8014cd92c450193554f82187f60f4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:16.836440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c8014cd92c450193554f82187f60f4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:16.838465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:17.006969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c8014cd92c450193554f82187f60f4', 'request_id': 'req-7af316df-e1c4-4c35-8c85-9b38f87bc8af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.034828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c8014cd92c450193554f82187f60f4', 'request_id': 'req-7af316df-e1c4-4c35-8c85-9b38f87bc8af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.061582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c8014cd92c450193554f82187f60f4', 'request_id': 'req-7af316df-e1c4-4c35-8c85-9b38f87bc8af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.106729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] The token cache is being invalidate because project b1c8014cd92c450193554f82187f60f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:17.107124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.109111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.115949 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3012/5997] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:16 2022] DELETE /identity/v3/projects/b1c8014cd92c450193554f82187f60f4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:17.121096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:17.131576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ed7e-0ed5-47bb-9126-9d53ae94f832 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:17.292001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:17.293687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:17.298319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:17.298793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] PATH_INFO: `/v3/users/3f0ac51d98d046a39a3869f6ff9a8042` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:17.300330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0ac51d98d046a39a3869f6ff9a8042)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:17.302507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:17.506593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0ac51d98d046a39a3869f6ff9a8042'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.509622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0ac51d98d046a39a3869f6ff9a8042'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.562283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0ac51d98d046a39a3869f6ff9a8042'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.615478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0ac51d98d046a39a3869f6ff9a8042'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.620293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0ac51d98d046a39a3869f6ff9a8042'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:17.652129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2986/5998] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:17 2022] DELETE /identity/v3/users/3f0ac51d98d046a39a3869f6ff9a8042 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:17.827496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:17.830371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:17.881855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af316df-e1c4-4c35-8c85-9b38f87bc8af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:18.103723 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:18.292646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:18.293839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:18.294569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:18.295015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] PATH_INFO: `/v3/projects/e9a58255a166436c995acdc8977838ee` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:18.300617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a58255a166436c995acdc8977838ee)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:18.302987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:18.544364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a58255a166436c995acdc8977838ee', 'request_id': 'req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.637117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a58255a166436c995acdc8977838ee', 'request_id': 'req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.668331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a58255a166436c995acdc8977838ee', 'request_id': 'req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.723056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] The token cache is being invalidate because project e9a58255a166436c995acdc8977838ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:18.723709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.724864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.727308 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3013/5999] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:17 2022] DELETE /identity/v3/projects/e9a58255a166436c995acdc8977838ee => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:18.731355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:18.733300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:18.748167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b75f6-e352-4719-afe9-252aa5f0f7ce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:18.803674 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:18.905684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:18.908016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:18.908672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:18.909157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] PATH_INFO: `/v3/users/05e27db1865a4a12b2bed495e7ca57c2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:18.913245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e27db1865a4a12b2bed495e7ca57c2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:18.916553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:18.991531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e27db1865a4a12b2bed495e7ca57c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:18.992669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e27db1865a4a12b2bed495e7ca57c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:19.002285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e27db1865a4a12b2bed495e7ca57c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:19.019159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e27db1865a4a12b2bed495e7ca57c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:19.019387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e27db1865a4a12b2bed495e7ca57c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:19.041518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2987/6000] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:18 2022] DELETE /identity/v3/users/05e27db1865a4a12b2bed495e7ca57c2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:19.287678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:19.289930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:19.358652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:19.360099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:19.563874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38df66-bf6f-43e9-ba21-a4d1e62170c3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:19.603838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8c47-099b-45a2-9362-27e07185794a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:19.621688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:19.623979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:19.624942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:19.632521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:19.641289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:19.675348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:19.677081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:19.718432 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:19.731017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2988/6001] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:19.740744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:19.741373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:19.741682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:19.741953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:19.778886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:19.782421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddab01d-b019-4023-a74e-5d38158461c9 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:19.812228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3014/6002] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:19.842130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:19.844859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:19.961849 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:20.039761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4cd18-6c6d-4e4a-b2d5-0e61189ded24 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:20.046938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:20.048527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:20.051508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:20.053538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] PATH_INFO: `/v3/projects/deec79800517446fad6e997ed19d4211` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:20.055835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=deec79800517446fad6e997ed19d4211)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:20.061384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:20.219196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deec79800517446fad6e997ed19d4211', 'request_id': 'req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:20.277863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deec79800517446fad6e997ed19d4211', 'request_id': 'req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:20.295565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deec79800517446fad6e997ed19d4211', 'request_id': 'req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:20.339448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] The token cache is being invalidate because project deec79800517446fad6e997ed19d4211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:20.343630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:20.353482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-435269b1-cb67-4e2a-9dfd-6e3074cffe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:20.375286 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2989/6003] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:19 2022] DELETE /identity/v3/projects/deec79800517446fad6e997ed19d4211 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:20.382902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:20.383321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:20.383479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:20.467272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:20.470983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:20.695783 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3015/6004] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:20.703456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:20.703745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:20.704012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:20.760215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:20.762212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:20.795099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2990/6005] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:20.799212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:20.813696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d3e2c-9d06-45ab-ad87-66df906dfdc9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:20.825140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:20.825914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:20.826206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:20.826482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:20.827279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:20.827587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:20.829220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:20.858242 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3016/6006] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:20.863667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:20.877572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac602ffc-351d-4031-8144-ab903396e2a4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:20.890077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:20.890733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:20.891004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:20.891280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:20.906473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:20.913936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.021483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2991/6007] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:20 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:21.027261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.047508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561696a-670a-4ccd-aa2d-badb2450f76a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.068796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.072207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:21.263247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef56d-0b80-4b08-b4dc-a41075984fe3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.270517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.271497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.272195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.273395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] PATH_INFO: `/v3/projects/95106a365134442086811e115ca429ba` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.274907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95106a365134442086811e115ca429ba)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.279409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.339108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.340679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.344705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.348352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.353186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.367561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.380927 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:21.436683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95106a365134442086811e115ca429ba', 'request_id': 'req-3ed03c26-9632-4a07-b73a-0fd54ad3106b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:21.459392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95106a365134442086811e115ca429ba', 'request_id': 'req-3ed03c26-9632-4a07-b73a-0fd54ad3106b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:21.488764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95106a365134442086811e115ca429ba', 'request_id': 'req-3ed03c26-9632-4a07-b73a-0fd54ad3106b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:21.490411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3017/6008] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:21 2022] POST /identity/v3/users => generated 290 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:21.495844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.522837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f3fa-b644-43d7-850b-1ca83801449d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.545174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] The token cache is being invalidate because project 95106a365134442086811e115ca429ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:21.545577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:21.546399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3ed03c26-9632-4a07-b73a-0fd54ad3106b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:21.548279 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2992/6009] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:21 2022] DELETE /identity/v3/projects/95106a365134442086811e115ca429ba => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:21.554188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282290b2-8b26-44f7-bdc7-96863dea8c74 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.554520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282290b2-8b26-44f7-bdc7-96863dea8c74 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.554746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282290b2-8b26-44f7-bdc7-96863dea8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.601801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-282290b2-8b26-44f7-bdc7-96863dea8c74 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:21.603201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-282290b2-8b26-44f7-bdc7-96863dea8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:21.704883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2993/6010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:21.714970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.715336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.715574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.729540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.730511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.730797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.734876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.736759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.740372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:21.740918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.742123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:21.760081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2994/6011] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:21.761812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.764033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3018/6012] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:21.771870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.773951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:21.785737 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:21.797039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93893b1-4801-492a-8950-c3e43e988201 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.801122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481c982-6070-4d0f-b3f3-359c1f83d829 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.806519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.807941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.808254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.808522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.809328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.810991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.817554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.818197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.818478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.818836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.819601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:21.819908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.828731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.844230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3019/6013] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:21.845806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.858683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef13e8-b426-4d16-ad97-1058970e8f4b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.865998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:21.868284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.868871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.869394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] PATH_INFO: `/v3/projects/9423abf226924bda908336987ed1ef5f/users/5eb4a7652e4c4f16833ab002da950f02/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.877444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2995/6014] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:21.882338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:21.891610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9423abf226924bda908336987ed1ef5f, user_id=5eb4a7652e4c4f16833ab002da950f02, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:21.895689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b013-5c1b-40b2-891b-2566078bbe12 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:21.913365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1864-15a6-4b8d-b62d-b583ee2ba165 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:21.919184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3020/6015] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:21 2022] PUT /identity/v3/projects/9423abf226924bda908336987ed1ef5f/users/5eb4a7652e4c4f16833ab002da950f02/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:21.924790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:21.925213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:21.925517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:21.981909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:21.987308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:22.093017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.096285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.096861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.097898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.098611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.113232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.257343 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2996/6016] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:21 2022] POST /identity/v3/projects => generated 373 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:22.262581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:22.267607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3021/6017] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:22.401972 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:22.414177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:22.415992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:22.556248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491868-032e-431b-ae57-6b8d19565df7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:22.587191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.587830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.588112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.588446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.589612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.591572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.625865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6a750-2458-4bd0-ac91-22414488c924 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:22.659706 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2997/6018] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:22 2022] POST /identity/v3/users => generated 287 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:22.664315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:22.711177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9e08-b3d5-4399-b4f3-3f5c969b0802 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:22.740159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.740628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.740914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.741192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.741880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.743525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.761920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.762724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.763110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.763655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.784367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.785948 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2998/6019] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:22.786727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.787144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:22.812247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e35195-e470-4d7d-965e-78d8123f6fc2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:22.829867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.830511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.830798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.831076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.831729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.833361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5c7e-8655-4b19-885d-cf037ed49212 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.841334 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3022/6020] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:22.857781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 2999/6021] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:22.863087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:22.878453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebd415-6c88-42e0-80cd-898998c2f5d1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:22.891673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:22.896186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:22.896622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:22.897511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] PATH_INFO: `/v3/projects/088f98fd85ba46b086cf3c731bbe9164/users/a97e3c1964984e5589d06c27d5468b29/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:22.934448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=088f98fd85ba46b086cf3c731bbe9164, user_id=a97e3c1964984e5589d06c27d5468b29, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:22.939295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:22.983705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3023/6022] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:22 2022] PUT /identity/v3/projects/088f98fd85ba46b086cf3c731bbe9164/users/a97e3c1964984e5589d06c27d5468b29/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:23.003994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0fc0-9cb7-4f54-b9c8-3a50d136c357 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:23.004921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0fc0-9cb7-4f54-b9c8-3a50d136c357 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:23.005357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0fc0-9cb7-4f54-b9c8-3a50d136c357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:23.085156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e61d0fc0-9cb7-4f54-b9c8-3a50d136c357 None None] MFA Rules not processed for user `a97e3c1964984e5589d06c27d5468b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:23.086690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e61d0fc0-9cb7-4f54-b9c8-3a50d136c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:23.271165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3000/6023] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:23.288800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:23.290812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:23.299553 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:23.436464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67129b0d-a7ca-431e-8639-2c0df87ca08e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:23.445563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:23.447467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:23.448405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:23.449138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:23.468539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:23.471780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:23.487331 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3024/6024] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:23.808125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177daa4e-c6dc-4d42-8674-1a6e35688023 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:23.808557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177daa4e-c6dc-4d42-8674-1a6e35688023 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:23.808995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177daa4e-c6dc-4d42-8674-1a6e35688023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:23.892968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-177daa4e-c6dc-4d42-8674-1a6e35688023 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:23.895642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-177daa4e-c6dc-4d42-8674-1a6e35688023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:24.085319 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3001/6025] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:24.105311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:24.110276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:24.547541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331a81-9cbc-4b77-9252-56377b93635b service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:24.580733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:24.584731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:24.585869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:24.586417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:24.619507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:24.622807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:24.636793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3025/6026] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:25.254703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269501-4151-4e3a-b940-a1c09eebdfa5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:25.255188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269501-4151-4e3a-b940-a1c09eebdfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:25.255408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269501-4151-4e3a-b940-a1c09eebdfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:25.312425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-49269501-4151-4e3a-b940-a1c09eebdfa5 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:25.313874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49269501-4151-4e3a-b940-a1c09eebdfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:25.331222 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3002/6027] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:25.343345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:25.363718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576450-7a05-4c87-bfa5-4e658fff305a service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:25.379273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:25.380386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:25.394000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:25.395104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:25.410020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:25.415330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a6e33-4762-402a-b1ff-6f0fdce4a769 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:25.438035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3026/6028] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:25.537482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:25.538015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:25.538536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:25.609765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] MFA Rules not processed for user `45ae26af1d0d4104850875f565485d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:25.611342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:25.631107 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:25.739646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e0d4-495c-4d10-9d1a-a8fb356bf8a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:25.740230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e0d4-495c-4d10-9d1a-a8fb356bf8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:25.740749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e0d4-495c-4d10-9d1a-a8fb356bf8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:25.795549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ea72e0d4-495c-4d10-9d1a-a8fb356bf8a4 None None] MFA Rules not processed for user `5eb4a7652e4c4f16833ab002da950f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:25.797747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea72e0d4-495c-4d10-9d1a-a8fb356bf8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:25.799479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3003/6029] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:25.803905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:25.808261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:25.996273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3027/6030] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:25.999879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.000356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.000824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.003724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9f0a6-5ce3-4141-bbe6-5f1cc0a55164 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.016180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.017105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.017588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.018680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.020526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.026558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.040385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:26.043151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:26.058023 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3028/6031] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:26.059309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.083452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c3e0-1c39-4fda-9911-b0efc569db7d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.089295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.090014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.091343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.091624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.092274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.094311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.099862 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:26.163394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3029/6032] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:26 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:26.164609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.210117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3004/6033] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:25 2022] POST /identity/v3/projects => generated 379 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:26.217756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.368924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee36-f775-449c-9c4a-d646e79470d0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.520018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652b66c-aafb-4f5b-a953-32c41a76f8f3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.530840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.534035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.534498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.540076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.541465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.544329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.566505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.567940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.568643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.569028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.643906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3005/6034] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:26 2022] POST /identity/v3/users => generated 295 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:26.652098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.698231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13d95-f5c0-4ee0-bc82-5603fbbb6054 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.716711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.722008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.722891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.723848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.726244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.729597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.768347 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3006/6035] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:26 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:26.769788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.798277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad616-a157-4066-9700-b9d0f8bec86e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.804622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.805638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.806417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.806417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.807427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.809298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.811745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.812361 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:26.814763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.826337 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3007/6036] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:26.827480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.842437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11681a31-b5f0-4821-ba43-f90e2eff0372 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.845486 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3030/6037] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:26.846698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.850821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.852192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.852767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.853275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.858321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.867761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.882531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e94d-83ef-4d63-8fc1-074bf22e9bda service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.884099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3008/6038] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:26.889852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.894401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.895410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.895944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.896721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] PATH_INFO: `/v3/projects/62fc68ffd9554380913f6abd8a1c92fa/users/6ba73048e8e94c36823562113114e0be/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.918634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354eb57-787e-44f6-b848-83e61b244cc0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:26.925858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fc68ffd9554380913f6abd8a1c92fa, user_id=6ba73048e8e94c36823562113114e0be, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.929319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:26.936195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:26.938980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:26.939116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:26.939933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] PATH_INFO: `/v3/projects/5e4928093d8f4064b8352f345698b34d/users/c641cb06bb4249a18aa8c7b2df80d48e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:26.959017 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3031/6039] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:26 2022] PUT /identity/v3/projects/62fc68ffd9554380913f6abd8a1c92fa/users/6ba73048e8e94c36823562113114e0be/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:26.962671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:26.972654 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:26.986312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4928093d8f4064b8352f345698b34d, user_id=c641cb06bb4249a18aa8c7b2df80d48e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:26.996490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.040749 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3009/6040] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:26 2022] PUT /identity/v3/projects/5e4928093d8f4064b8352f345698b34d/users/c641cb06bb4249a18aa8c7b2df80d48e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:27.045935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:27.096329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde1d2-c96a-42e3-8993-db33c03ea151 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:27.212317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:27.214470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.214965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.216588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.217615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:27.222272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.224461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd77cc-55c1-42e8-92d7-6082eb65dfec admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:27.236725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:27.238089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.238089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.239443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.241722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:27.246005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.251893 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3032/6041] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:27.255071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:27.277302 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3010/6042] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:27.279249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:27.279985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5726a-2418-4e52-b51f-00f9b4df1f72 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:27.294221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:27.294911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.295204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.295474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] PATH_INFO: `/v3/projects/62fc68ffd9554380913f6abd8a1c92fa/users/6ba73048e8e94c36823562113114e0be/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.300711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfdc66-4470-40e8-971d-9881ae3f0384 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:27.301644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fc68ffd9554380913f6abd8a1c92fa, user_id=6ba73048e8e94c36823562113114e0be, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:27.308233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786ad23-6c35-414a-a860-c856af4fdda9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.312924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:27.314658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.314944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.315224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] PATH_INFO: `/v3/projects/5e4928093d8f4064b8352f345698b34d/users/c641cb06bb4249a18aa8c7b2df80d48e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.320462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4928093d8f4064b8352f345698b34d, user_id=c641cb06bb4249a18aa8c7b2df80d48e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:27.325725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.335982 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3033/6043] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:27 2022] PUT /identity/v3/projects/62fc68ffd9554380913f6abd8a1c92fa/users/6ba73048e8e94c36823562113114e0be/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:27.345459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3011/6044] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:27 2022] PUT /identity/v3/projects/5e4928093d8f4064b8352f345698b34d/users/c641cb06bb4249a18aa8c7b2df80d48e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:27.389716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437bd6-aaf9-4005-b2a3-3712352155b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.390261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437bd6-aaf9-4005-b2a3-3712352155b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.390348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437bd6-aaf9-4005-b2a3-3712352155b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.434463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-63437bd6-aaf9-4005-b2a3-3712352155b1 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:27.437899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63437bd6-aaf9-4005-b2a3-3712352155b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:27.534745 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3034/6045] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:27.553250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:27.659815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403ade-ee4e-4495-b3c3-3f27515ab66f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:27.669072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:27.670294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:27.670873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:27.671055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:27.684551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:27.687146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:27.712357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3012/6046] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:28.180937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7d1ae-f06a-41a1-ac7f-fae72a092029 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:28.181230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7d1ae-f06a-41a1-ac7f-fae72a092029 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:28.181673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7d1ae-f06a-41a1-ac7f-fae72a092029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:28.240351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-26f7d1ae-f06a-41a1-ac7f-fae72a092029 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:28.241823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26f7d1ae-f06a-41a1-ac7f-fae72a092029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:28.302927 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3035/6047] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:28.316662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:28.339472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6bca-2c71-4efe-b94d-2a7244f3f13f service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:28.350795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:28.353043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:28.354171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:28.355128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:28.378991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:28.380997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:28.407895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3013/6048] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:28.942379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08319f-47a6-4538-9ca1-6e343fe05c25 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:28.942901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08319f-47a6-4538-9ca1-6e343fe05c25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:28.942988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08319f-47a6-4538-9ca1-6e343fe05c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:29.020497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-df08319f-47a6-4538-9ca1-6e343fe05c25 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:29.021891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df08319f-47a6-4538-9ca1-6e343fe05c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:29.050967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3036/6049] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:29.065013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:29.083699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a05f90-c97a-4084-aab4-bb90bca8d046 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:29.103285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:29.104436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:29.104768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:29.105249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:29.133199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:29.135137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:29.156245 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3014/6050] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:31.051069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7de67-9aa4-4a95-9eb2-a0955c1f792f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:31.051695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7de67-9aa4-4a95-9eb2-a0955c1f792f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:31.051695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7de67-9aa4-4a95-9eb2-a0955c1f792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:31.084390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8ca7de67-9aa4-4a95-9eb2-a0955c1f792f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:31.086180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ca7de67-9aa4-4a95-9eb2-a0955c1f792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:31.098258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3037/6051] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:31.120260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:31.179249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7569c-2186-4016-b50e-4a26ffabfdd2 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:31.187011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:31.188134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:31.188896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:31.189438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:31.214569 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:31.230344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:31.241238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:31.253379 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3015/6052] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:31.565925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30180e-2fbe-4557-aa19-3fb65663236f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:31.566656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30180e-2fbe-4557-aa19-3fb65663236f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:31.567074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30180e-2fbe-4557-aa19-3fb65663236f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:31.608946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d30180e-2fbe-4557-aa19-3fb65663236f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:31.613854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d30180e-2fbe-4557-aa19-3fb65663236f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:31.646623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3038/6053] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:31.658588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:31.681210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf64ab-63b5-4a65-9734-a1f4d9e7385d service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:31.700194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:31.702040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:31.702751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:31.705584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:31.730886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:31.732514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:31.770754 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3016/6054] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:32.056721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee76c2-0dce-469f-9365-794ab4497ff5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:32.057364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee76c2-0dce-469f-9365-794ab4497ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:32.057571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee76c2-0dce-469f-9365-794ab4497ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:32.101638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-36ee76c2-0dce-469f-9365-794ab4497ff5 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:32.103573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36ee76c2-0dce-469f-9365-794ab4497ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:32.128426 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3039/6055] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:32.161159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:32.177358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee264c9f-0480-4699-a216-36d79ef88165 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:32.184168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:32.184801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:32.185423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:32.186543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:32.200669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:32.202562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:32.240834 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3017/6056] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:32.487419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478e72-2d43-410b-bb8c-845e250e0c26 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:32.487730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478e72-2d43-410b-bb8c-845e250e0c26 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:32.488057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478e72-2d43-410b-bb8c-845e250e0c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:32.528635 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:32.535412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a5478e72-2d43-410b-bb8c-845e250e0c26 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:32.543176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5478e72-2d43-410b-bb8c-845e250e0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:32.554497 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3040/6057] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:32.569354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:32.588887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8284bc-5d87-4abf-a968-0307069d25c7 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:32.598971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:32.600487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:32.600950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:32.601387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:32.611733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:32.613672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:32.626462 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3018/6058] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:32.860642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6d0f-da03-4311-ba57-c6835f338050 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:32.861066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6d0f-da03-4311-ba57-c6835f338050 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:32.867496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6d0f-da03-4311-ba57-c6835f338050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:32.902583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c2e6d0f-da03-4311-ba57-c6835f338050 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:32.914707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c2e6d0f-da03-4311-ba57-c6835f338050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:32.927526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3041/6059] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:32.955597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:32.995186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2545f7-7c57-43a1-8dcf-5eb275b77c39 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:33.002574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:33.003796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.004234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.004668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.027741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a74e-a2d7-4155-822f-752aea5b8fd1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.028018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a74e-a2d7-4155-822f-752aea5b8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.028295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a74e-a2d7-4155-822f-752aea5b8fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.029851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:33.032161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e4ab-a39c-499c-891f-33f33235d283 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:33.043909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3019/6060] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:33.100230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11a6a74e-a2d7-4155-822f-752aea5b8fd1 None None] MFA Rules not processed for user `6ba73048e8e94c36823562113114e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:33.103497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11a6a74e-a2d7-4155-822f-752aea5b8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:33.282953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.283511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.283511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.291585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3042/6061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:33.302445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.303065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.303500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.325568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:33.327229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:33.345028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] MFA Rules not processed for user `5eb4a7652e4c4f16833ab002da950f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:33.346608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:33.356623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3020/6062] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:33.371671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:33.393201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dc041-ae84-4457-a88d-1ec72933573c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:33.401687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:33.402643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.403219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.403698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.415464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:33.418713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:33.467645 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3021/6063] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:24:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:24:33.496186 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3043/6064] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:33.515250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:33.516910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:33.829007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969e7f-4a91-4e6b-a583-118a3b7eb0d6 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:33.856064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:33.856702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:33.856987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:33.857274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:33.887400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:33.889393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7f245-1b8e-4e3d-8538-0299819f5933 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:33.903441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3022/6065] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:33.967453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:34.163575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4234ca7-1dc1-4956-8482-f55e929cb92d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:34.171533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:34.172739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:34.173326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:34.173981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] PATH_INFO: `/v3/users/a97e3c1964984e5589d06c27d5468b29` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:34.177283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97e3c1964984e5589d06c27d5468b29)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:34.182889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:34.261893 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:34.316553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97e3c1964984e5589d06c27d5468b29'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:34.338980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97e3c1964984e5589d06c27d5468b29'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:34.401670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97e3c1964984e5589d06c27d5468b29'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:34.402568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97e3c1964984e5589d06c27d5468b29'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:34.403421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97e3c1964984e5589d06c27d5468b29'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:34.459989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3044/6066] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:33 2022] DELETE /identity/v3/users/a97e3c1964984e5589d06c27d5468b29 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:34.464586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:34.465138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:34.465138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:34.501706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:34.502950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:34.655393 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3023/6067] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:34.687562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:34.689115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:34.855640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fa5be-7495-4adb-acf1-f6bcbe9ffb52 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:34.861006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:34.861675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:34.861984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:34.862233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:34.898569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:34.904068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0512ea2-3b0c-4874-a8c5-97b4662ec1c1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:34.939503 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3045/6068] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:36.493955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:36.497396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:36.531798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966ccf-b221-4ec7-9ea2-f96f622537e7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:36.549528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:36.550481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:36.552157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:36.552519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] PATH_INFO: `/v3/projects/088f98fd85ba46b086cf3c731bbe9164` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:36.560683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] RBAC: Authorizing `identity:delete_project(project_id=088f98fd85ba46b086cf3c731bbe9164)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:36.562896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:36.571570 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:36.685641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088f98fd85ba46b086cf3c731bbe9164', 'request_id': 'req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:36.700874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088f98fd85ba46b086cf3c731bbe9164', 'request_id': 'req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:36.708599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088f98fd85ba46b086cf3c731bbe9164', 'request_id': 'req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:36.737118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] The token cache is being invalidate because project 088f98fd85ba46b086cf3c731bbe9164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:36.737447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:36.738197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d3b7e5f-f7f7-4446-b4d3-86a0ea6e507c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:36.743408 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3024/6069] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:36 2022] DELETE /identity/v3/projects/088f98fd85ba46b086cf3c731bbe9164 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:36.746528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:36.747598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:36.748037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:36.836554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:36.840434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:37.022622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.023167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.023667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.033845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3046/6070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:37.050632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:37.052798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:37.068137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.075406 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3025/6071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:37.079720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf0e3-cae0-4c5b-9aac-cbccc7ec181c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.101997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.102405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.102679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.102942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.106105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:37.106711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.108696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.126194 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3047/6072] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:24:37.130979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.146449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8becdf-b82b-4a2f-b55a-7a5ab6659273 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.162003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.163119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.163579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.163847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.164759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.168491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.217546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3026/6073] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:37 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:37.218664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.232848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da493c5-ac6d-4f8e-82e5-09854d3be9c9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.312089 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:37.380998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.382989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.389678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.389678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.389678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.392339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.446554 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3048/6074] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:37 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:37.451003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.467210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fe102-52e5-4882-90e8-683cd052ddf3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.480681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.481825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.482615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.483055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.484314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.486691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.504417 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3027/6075] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:37.510131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.526887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b435b-c0fb-4ae9-ba47-272a70e8af8a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.534620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.534826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.535056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.535264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.536305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.537774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a5193-6aca-4388-a343-d3ba1d9c0332 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.554043 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3049/6076] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:37.559855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:37.576770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9c112-9f09-4696-8007-5d6707a2dac2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:37.584843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:37.587088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.587478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.587765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] PATH_INFO: `/v3/projects/8c46c61da91140c4be12486915bee06a/users/16451649385c479aad7cc42458e1000b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.634588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c46c61da91140c4be12486915bee06a, user_id=16451649385c479aad7cc42458e1000b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:37.657111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:37.717055 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3028/6077] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:37 2022] PUT /identity/v3/projects/8c46c61da91140c4be12486915bee06a/users/16451649385c479aad7cc42458e1000b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:37.727571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:37.727749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:37.728034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:37.884534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] MFA Rules not processed for user `16451649385c479aad7cc42458e1000b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:37.886259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:38.061384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3050/6078] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:38.071094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:38.074767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:38.175513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc97-7798-423a-b183-5193870b0538 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:38.180331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:38.181315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:38.181864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:38.182534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:38.193130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:38.194744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a8246-1855-4f1b-bead-d7bb235c705f service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:38.205956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3029/6079] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:38.608281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:38.647548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:38.648038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:38.648140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:38.752181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] MFA Rules not processed for user `c641cb06bb4249a18aa8c7b2df80d48e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:38.753392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:38.808260 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:38.811743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594ad1a-6a3e-41e8-acad-e8a75dbacaaf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:38.824731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:38.825686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:38.825978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:38.826252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] PATH_INFO: `/v3/users/16451649385c479aad7cc42458e1000b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:38.829679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16451649385c479aad7cc42458e1000b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:38.831877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:38.964114 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:38.968549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3030/6080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:38.971673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16451649385c479aad7cc42458e1000b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:38.980749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:38.982180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.007027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16451649385c479aad7cc42458e1000b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.059251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16451649385c479aad7cc42458e1000b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.062119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16451649385c479aad7cc42458e1000b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.063521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-568645ea-bf73-430c-abfc-e01a7da1e0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16451649385c479aad7cc42458e1000b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.094890 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3051/6081] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:38 2022] DELETE /identity/v3/users/16451649385c479aad7cc42458e1000b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:39.099689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:39.100221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:39.100715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:39.116574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63340-5959-4639-b8c2-6347497e58a5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:39.130959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:39.135546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.248518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:39.249269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:39.251038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:39.251328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:39.253270 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3052/6082] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:39.254347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.283012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:39.290171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.393330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:39.394848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:39.425498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3031/6083] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:24:39.425982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:39.427383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.452452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac082a-73db-4100-a430-b58d279ba582 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:39.478516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:39.479870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:39.480153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:39.480431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] PATH_INFO: `/v3/users/d3098d02a0814cf7ada5aae6bedf2771` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:39.483318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3098d02a0814cf7ada5aae6bedf2771)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:39.487030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:39.497459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d073-6c37-452b-9ba7-474ca1132075 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:39.502469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:39.505307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:39.505587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:39.505871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:39.539744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:39.546903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9572e-1a17-4996-a9e5-1cb983c34dc4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:39.551848 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:39.573922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3053/6084] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:39.601767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3098d02a0814cf7ada5aae6bedf2771'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.602484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3098d02a0814cf7ada5aae6bedf2771'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.614002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3098d02a0814cf7ada5aae6bedf2771'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.632489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3098d02a0814cf7ada5aae6bedf2771'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.633954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3098d02a0814cf7ada5aae6bedf2771'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:39.667660 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3032/6085] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:24:39 2022] DELETE /identity/v3/users/d3098d02a0814cf7ada5aae6bedf2771 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:39.671973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196323-eedf-4d67-893c-3a845618056f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:39.672618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196323-eedf-4d67-893c-3a845618056f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:39.673679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196323-eedf-4d67-893c-3a845618056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:39.710461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2196323-eedf-4d67-893c-3a845618056f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:39.711692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2196323-eedf-4d67-893c-3a845618056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:39.848153 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3054/6086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:39.870286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:39.871901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:40.064080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434cbd-a4fe-42e7-82f6-c9afafd61e2c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:40.076633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:40.077260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:40.077567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:40.077839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:40.114732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:40.118398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:40.174900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3033/6087] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:41.227887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196323-eedf-4d67-893c-3a845618056f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:41.231073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2196323-eedf-4d67-893c-3a845618056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:41.246555 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:41.257568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196323-eedf-4d67-893c-3a845618056f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:41.271304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:41.273675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.274163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.274896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] PATH_INFO: `/v3/projects/8c46c61da91140c4be12486915bee06a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.278666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c46c61da91140c4be12486915bee06a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:41.281389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:41.317739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:41.319251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:41.348400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845818-c0e1-4360-8920-cb6bb6d82972 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:41.367370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:41.368027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.368311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.368583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] PATH_INFO: `/v3/projects/8f9849b93b6e407682309d5585094847` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.372846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9849b93b6e407682309d5585094847)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:41.377787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:41.443850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c46c61da91140c4be12486915bee06a', 'request_id': 'req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.469216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c46c61da91140c4be12486915bee06a', 'request_id': 'req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.489329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c46c61da91140c4be12486915bee06a', 'request_id': 'req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.534710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] The token cache is being invalidate because project 8c46c61da91140c4be12486915bee06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:41.536552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.544008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2a409f1b-9ef1-4381-b5a3-1aac84201e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.548343 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3055/6088] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:41 2022] DELETE /identity/v3/projects/8c46c61da91140c4be12486915bee06a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:41.554473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5defe2-de11-498d-83f7-8eddccf88f18 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.555223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5defe2-de11-498d-83f7-8eddccf88f18 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.555223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5defe2-de11-498d-83f7-8eddccf88f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.584962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9849b93b6e407682309d5585094847', 'request_id': 'req-dd832e91-2ddf-43fe-a4d2-3d2224148b51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.600740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9849b93b6e407682309d5585094847', 'request_id': 'req-dd832e91-2ddf-43fe-a4d2-3d2224148b51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.604259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0c5defe2-de11-498d-83f7-8eddccf88f18 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:41.605950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c5defe2-de11-498d-83f7-8eddccf88f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:41.618879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9849b93b6e407682309d5585094847', 'request_id': 'req-dd832e91-2ddf-43fe-a4d2-3d2224148b51'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.660198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] The token cache is being invalidate because project 8f9849b93b6e407682309d5585094847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:24:41.669365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.670921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dd832e91-2ddf-43fe-a4d2-3d2224148b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:24:41.677303 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3034/6089] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:24:41 2022] DELETE /identity/v3/projects/8f9849b93b6e407682309d5585094847 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:41.682893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b34991-a53c-434f-a8df-7e652e190741 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.683181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b34991-a53c-434f-a8df-7e652e190741 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.685191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b34991-a53c-434f-a8df-7e652e190741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.737455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c2b34991-a53c-434f-a8df-7e652e190741 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:41.740999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c2b34991-a53c-434f-a8df-7e652e190741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:41.758506 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3056/6090] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:41.768199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.768199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.768533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.793526 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:41.826494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:41.827717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:41.863163 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3057/6091] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:41.867184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:41.887508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09adba-4e8d-4a5f-9f43-725bb1dd5d9c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:41.894182 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3035/6092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:41.905139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.906936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:41.907119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.907240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.907340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.907628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.907911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.908570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:41.908864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:41.910521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:41.935523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3058/6093] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:24:41.939631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:41.956066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ecfe-19bf-4256-845c-91e201515871 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:41.975382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:41.975997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:41.976274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:41.976544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:41.978107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:41.981016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:41.981159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:41.982374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:42.018862 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3036/6094] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:42.022988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.044417 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3059/6095] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:41 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:24:42.048299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.050145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c58e8-46a3-4e23-9259-db9c9eebbcc0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.154640 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:42.187152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb25d-6e65-4a05-970c-8e48d918ab33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.199740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.201165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.201165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.201165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.202472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.209681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.261349 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3060/6096] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:42 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:24:42.262868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.273286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.273863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.274145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.276953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.277705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:24:42.278304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.281186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.288236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0740-cb86-40dc-9dbe-fae2010ed3e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.299375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.301737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.302021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.302297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.304301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.309934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.313375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3037/6097] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:24:42.319814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.338283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3061/6098] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:42.338494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a178f6-4ee3-45bf-b7b3-ff335c9c5c67 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.340215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.353230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.354028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.354518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.354871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.357585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.360613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.365365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ab11-995d-4951-aa35-e38dce64bbe6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.376804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.377452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.377737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.378008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.379881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.381569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.434742 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3062/6099] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:42.436008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.474021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3038/6100] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:42 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:42.474281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2a1f-ac8d-42a6-9bdd-c7b9154a1e19 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.477670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.704587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.705282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.705588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.705865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] PATH_INFO: `/v3/projects/03a0ca4d6def4f43abf7ed550cd6c347/users/ef7f12fc9fb945e39aea9f5447959e02/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.717811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0ccc-c195-4dcb-8ca0-b6aa75a33d40 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.730820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.731455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.731732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.732006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.732650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.735278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.741248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a0ca4d6def4f43abf7ed550cd6c347, user_id=ef7f12fc9fb945e39aea9f5447959e02, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.743907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129171-4591-4a52-b800-e6b82b1436cd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:42.770452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3063/6101] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:42 2022] PUT /identity/v3/projects/03a0ca4d6def4f43abf7ed550cd6c347/users/ef7f12fc9fb945e39aea9f5447959e02/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:42.781989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.784724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.785936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.802305 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3039/6102] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:42 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:42.803654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:42.828240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d344c-77a9-4068-bc64-45c0d760f19d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:42.866218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] MFA Rules not processed for user `ef7f12fc9fb945e39aea9f5447959e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:42.867608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:42.879529 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:42.987286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:42.987938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:42.988225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:42.988504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:42.989166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:42.990843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.027392 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3040/6103] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:43.043684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.068538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a5a-2634-48da-adf2-8a599b31d819 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.087706 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3064/6104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:43.088735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.089243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.089397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.089696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.089972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.090626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.092376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.120583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca58a-41ce-4627-ab2d-bfef60a65fe7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.133067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.134563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.135607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.135893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.136538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.138617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.156969 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3041/6105] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:43.160883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.178407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabb8d8-1dd6-4f2f-8b45-d4849c69cef9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.189695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.190390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.191330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.191613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] PATH_INFO: `/v3/projects/703dfa4ed0754356bfceaf96794ebd41/users/31d58d144d444a5895d002f81cf0bf2d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.197539 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3065/6106] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:24:43 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:43.201995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.212440 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:43.236342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703dfa4ed0754356bfceaf96794ebd41, user_id=31d58d144d444a5895d002f81cf0bf2d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.240209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170549e-ab6f-405d-94fd-22066dca1ec2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.273734 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3042/6107] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:43 2022] PUT /identity/v3/projects/703dfa4ed0754356bfceaf96794ebd41/users/31d58d144d444a5895d002f81cf0bf2d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:43.286092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.286434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.286653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.355471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] MFA Rules not processed for user `31d58d144d444a5895d002f81cf0bf2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:43.356761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:43.364657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28af-a93a-4339-98e2-b14c519a6dde admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.477541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.480375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.482093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.482443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.484358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.489725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.558951 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3043/6108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:43.562538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.569101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3066/6109] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:24:43 2022] POST /identity/v3/users => generated 306 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:24:43.570327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.572988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:43.591717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e868a7-35a9-4d28-8e47-2e4393763df1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.607837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.609552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.610576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.611446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.613806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.617367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.662027 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3044/6110] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:24:43.669056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.698227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec715-8fb8-49bd-b740-0ef76669af7a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.717396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.719120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.719412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.719691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] PATH_INFO: `/v3/projects/52b8291582ff4253ab875042daa87fa0/users/16c1109622904c5092803bd23e5784fe/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.764642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edbbb-1725-431c-af81-b34ae64fe100 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:43.773899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b8291582ff4253ab875042daa87fa0, user_id=16c1109622904c5092803bd23e5784fe, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.774954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:43.778108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:43.778400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:43.778683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:43.779223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.809007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:43.814081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:43.837447 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3045/6111] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:43 2022] PUT /identity/v3/projects/52b8291582ff4253ab875042daa87fa0/users/16c1109622904c5092803bd23e5784fe/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:24:43.840322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:43.848123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3067/6112] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:43.994529 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:44.099827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7d5b-fa12-443e-8eb1-edb3ed221910 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:44.114884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:44.115530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:44.116421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:44.116421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:44.117963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:44.120364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88c62-7b82-4157-ba89-0a4741281566 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:44.134340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3046/6113] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:24:44.139207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:44.159358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f765-a70d-4f68-9949-a554aa4c5648 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:44.171254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:44.174154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:44.175180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:44.175539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] PATH_INFO: `/v3/projects/52b8291582ff4253ab875042daa87fa0/users/16c1109622904c5092803bd23e5784fe/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:44.181311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b8291582ff4253ab875042daa87fa0, user_id=16c1109622904c5092803bd23e5784fe, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:44.190563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:44.234624 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3068/6114] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:24:44 2022] PUT /identity/v3/projects/52b8291582ff4253ab875042daa87fa0/users/16c1109622904c5092803bd23e5784fe/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:24:44.250237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:44.251972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:44.253029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:44.339831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] MFA Rules not processed for user `16c1109622904c5092803bd23e5784fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:44.343039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:44.492280 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3047/6115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:24:44.505285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:44.507442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:44.604691 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:44.664994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8f0-88ba-4a41-bcb2-8403f2942466 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:44.674581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:44.675512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:44.676180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:44.678310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:44.780569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:44.782435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:44.795124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3069/6116] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:45.997702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:45.999239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:46.269527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede92bd-cd4e-46c5-bb47-a6edbf861390 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:46.277676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:46.280825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:46.282220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:46.282744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:46.294609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:46.296728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c6a9-5884-42a6-8fc0-7346b45ba12e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:46.314371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3048/6117] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:24:52.908838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:24:52.911308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:52.911749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:52.911860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:52.912249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:52.956738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] MFA Rules not processed for user `d4b32b37164a44f3a6ab4f0b4335cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:24:52.959032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:53.042787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c441c8-da2c-4926-aa9b-2e1ada2a4c6b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:24:53.046877 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:53.059048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:24:53.059690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:24:53.059972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:24:53.060244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:24:53.065878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:24:53.073299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3049/6118] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:24:53.126221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:24:53.127878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:24:53.176321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3070/6119] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:02.340693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:02.342919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:02.382684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e46b1a-aac8-4de8-9339-75f9935d7336 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:02.407153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:02.407797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:02.408084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:02.408361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:02.414528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:02.466838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:02.468490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef585cc-1563-4923-b4ba-50882ab2195d service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:02.503585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3050/6120] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:02.746064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:02.967532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947187-b584-4516-bbf1-44beeebe4c59 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:02.979826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:02.980706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:02.980998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:02.981280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] PATH_INFO: `/v3/users/ef7f12fc9fb945e39aea9f5447959e02` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:02.984495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7f12fc9fb945e39aea9f5447959e02)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:02.991141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:03.030866 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:03.075892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7f12fc9fb945e39aea9f5447959e02'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:03.086582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7f12fc9fb945e39aea9f5447959e02'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:03.101723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7f12fc9fb945e39aea9f5447959e02'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:03.104391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7f12fc9fb945e39aea9f5447959e02'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:03.105111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7f12fc9fb945e39aea9f5447959e02'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:03.143437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3071/6121] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:02 2022] DELETE /identity/v3/users/ef7f12fc9fb945e39aea9f5447959e02 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:03.144379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:03.144670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:03.144942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:03.200100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:03.204554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:03.286820 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3051/6122] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:25:03.400627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:03.402455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:03.664385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8313-18c4-4070-b1ca-e01a179a8a97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:03.679067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:03.680012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:03.680430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:03.680816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:03.708386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:03.712066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:03.742253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3072/6123] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:04.998979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:05.001291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:05.023693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd6c25-0971-451d-bdcd-2240336f506c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:05.036392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:05.037314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:05.039430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:05.039928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] PATH_INFO: `/v3/projects/03a0ca4d6def4f43abf7ed550cd6c347` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:05.043446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a0ca4d6def4f43abf7ed550cd6c347)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:05.047491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:05.163389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a0ca4d6def4f43abf7ed550cd6c347', 'request_id': 'req-704ed9da-1a59-4f9e-938b-6f300899ff92'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.184029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a0ca4d6def4f43abf7ed550cd6c347', 'request_id': 'req-704ed9da-1a59-4f9e-938b-6f300899ff92'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.192738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a0ca4d6def4f43abf7ed550cd6c347', 'request_id': 'req-704ed9da-1a59-4f9e-938b-6f300899ff92'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.210108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] The token cache is being invalidate because project 03a0ca4d6def4f43abf7ed550cd6c347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:05.210330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.212191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-704ed9da-1a59-4f9e-938b-6f300899ff92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.215025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3052/6124] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:04 2022] DELETE /identity/v3/projects/03a0ca4d6def4f43abf7ed550cd6c347 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:05.218802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:05.232384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d860-523c-4f42-b800-dc0a20e83235 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:05.344506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:05.345323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:05.345784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:05.346092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] PATH_INFO: `/v3/users/16c1109622904c5092803bd23e5784fe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:05.347684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c1109622904c5092803bd23e5784fe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:05.350709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:05.430827 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:05.440084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c1109622904c5092803bd23e5784fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.451689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c1109622904c5092803bd23e5784fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.471332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c1109622904c5092803bd23e5784fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.473150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c1109622904c5092803bd23e5784fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.474088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c1109622904c5092803bd23e5784fe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:05.492755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3073/6125] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:05 2022] DELETE /identity/v3/users/16c1109622904c5092803bd23e5784fe => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:05.737629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f271bd8-6059-4e71-b9f3-73980d90895e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:05.737918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f271bd8-6059-4e71-b9f3-73980d90895e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:05.738191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f271bd8-6059-4e71-b9f3-73980d90895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:05.775453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:05.778551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:05.811472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1f271bd8-6059-4e71-b9f3-73980d90895e None None] MFA Rules not processed for user `2f080bae0ec94a5b88128dd69c8a3e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:05.814255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f271bd8-6059-4e71-b9f3-73980d90895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:05.906596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eafb60-9792-4018-b2e3-e2ccbea40929 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:05.925163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:05.925939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:05.926263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:05.926699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] PATH_INFO: `/v3/projects/52b8291582ff4253ab875042daa87fa0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:05.928790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b8291582ff4253ab875042daa87fa0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:05.931541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:05.961849 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:06.000006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3053/6126] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:06.044862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b8291582ff4253ab875042daa87fa0', 'request_id': 'req-aceccac2-401e-45dc-9e2d-ac5f88979c4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:06.050983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b8291582ff4253ab875042daa87fa0', 'request_id': 'req-aceccac2-401e-45dc-9e2d-ac5f88979c4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:06.063079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b8291582ff4253ab875042daa87fa0', 'request_id': 'req-aceccac2-401e-45dc-9e2d-ac5f88979c4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:06.080472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] The token cache is being invalidate because project 52b8291582ff4253ab875042daa87fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:06.080771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:06.081604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aceccac2-401e-45dc-9e2d-ac5f88979c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:06.090208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.090584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.090865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.103956 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3074/6127] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:05 2022] DELETE /identity/v3/projects/52b8291582ff4253ab875042daa87fa0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:06.118692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:06.120217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:06.222466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.222957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.223087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.230875 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3054/6128] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:06.246449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:06.248051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:06.263511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.273670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3075/6129] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:06.276120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9454cf-5951-4c28-8a10-986afdc72ea6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.300117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.301376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.302649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.303038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.308975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:06.309513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.313868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.356444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3055/6130] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:06.363045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.380980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23629-76bf-48a7-aa29-3f513e244d03 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.402340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.402981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.403263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.403537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.404182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.414742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.482694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.483270 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3076/6131] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:06 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:06.504740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e68df-500e-40be-a7eb-1a4160d7ae0c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.643387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.643928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.644061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.644287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.644933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.649286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.699295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3056/6132] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:06 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:06.701726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.717941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34f98-8111-4cfe-a1e6-0bc5840681bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.732358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.732993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.733277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.733609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.734268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.737015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.764033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3077/6133] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:06.768253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.784533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf03-5f12-42e8-ba27-7f41846ec313 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.798002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.798632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.798918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.799195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.799857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.803930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebf05-98e6-4ff4-aecf-73cb69674987 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.832491 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3057/6134] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:06.836743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:06.852125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54138-86db-4232-a89c-06861b66f2dd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:06.864052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:06.864745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.865030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.865310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] PATH_INFO: `/v3/projects/4e1afcb71e834d0a818f8acac4cd2fa3/users/27d615d7d9af4b47bab1d5b1a5a17418/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:06.875114 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:06.901703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1afcb71e834d0a818f8acac4cd2fa3, user_id=27d615d7d9af4b47bab1d5b1a5a17418, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:06.904786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:06.944865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3078/6135] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:06 2022] PUT /identity/v3/projects/4e1afcb71e834d0a818f8acac4cd2fa3/users/27d615d7d9af4b47bab1d5b1a5a17418/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:06.955769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:06.956058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:06.956721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:07.044149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] MFA Rules not processed for user `27d615d7d9af4b47bab1d5b1a5a17418`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:07.046656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:07.167758 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:07.209458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3058/6136] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:07.216204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:07.307701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399f64-0949-44ab-883e-188c1964902a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:07.331381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:07.332351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:07.332751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:07.333134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:07.334012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:07.336086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:07.409498 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3079/6137] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:07 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:07.410533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:07.454850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392e79-a9eb-4d89-81f3-d347689dcec7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:07.629663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:07.630492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:07.630989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:07.631742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:07.632713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:07.638092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:07.691834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:07.701624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3059/6138] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:07 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:07.707321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583840bd-48c1-4a97-9fc9-44e1c2d3834f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:07.718504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:07.721280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:07.721698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:07.722085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:07.726405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:07.729499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:07.771838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:07.782066 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3080/6139] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:07.783468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f820d-1b4f-4cbc-9ca5-d1c73f48a419 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:07.799827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:07.802330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:07.808844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:07.809346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] PATH_INFO: `/v3/projects/28da7f2f544b476aaab588c6dd8c1835/users/c6e1e87b6b134af2af85899605553992/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:07.844083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=28da7f2f544b476aaab588c6dd8c1835, user_id=c6e1e87b6b134af2af85899605553992, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:07.847126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:07.882458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:07.883085 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3060/6140] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:07 2022] PUT /identity/v3/projects/28da7f2f544b476aaab588c6dd8c1835/users/c6e1e87b6b134af2af85899605553992/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:07.902737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119428-d6d1-461e-bcbe-0b33ba6a9caf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:08.047545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:08.049117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:08.049438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:08.049705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:08.050364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:08.052345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d877-9427-4f72-a848-7dfecf967339 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:08.100929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3081/6141] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:08.105701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:08.119300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3bd-7bc2-482f-a8ed-a9d92b2b5dde admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:08.134578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:08.137187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:08.137555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:08.137842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] PATH_INFO: `/v3/projects/28da7f2f544b476aaab588c6dd8c1835/users/c6e1e87b6b134af2af85899605553992/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:08.144436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28da7f2f544b476aaab588c6dd8c1835, user_id=c6e1e87b6b134af2af85899605553992, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:08.154380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:08.205393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:08.205814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:08.206770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:08.210605 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3061/6142] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:08 2022] PUT /identity/v3/projects/28da7f2f544b476aaab588c6dd8c1835/users/c6e1e87b6b134af2af85899605553992/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:08.282201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] MFA Rules not processed for user `c6e1e87b6b134af2af85899605553992`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:08.283822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:08.364562 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:08.413463 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3082/6143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:08.499540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:08.501906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:08.714590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c05f6-0f5d-4e8c-aca8-4ebfed45b642 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:08.735854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:08.736530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:08.739028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:08.739334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:08.777690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:08.779178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391714a-10db-41b7-bb25-53e3ffe91dd0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:08.828666 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3062/6144] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:10.849365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:10.851947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:10.942312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106e22-c16c-47b7-8831-ba8bb6a849ce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:10.947969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:10.948633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:10.948916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:10.949193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] PATH_INFO: `/v3/users/31d58d144d444a5895d002f81cf0bf2d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:10.950695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d58d144d444a5895d002f81cf0bf2d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:10.952585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:11.042938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d58d144d444a5895d002f81cf0bf2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:11.058882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d58d144d444a5895d002f81cf0bf2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:11.096394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d58d144d444a5895d002f81cf0bf2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:11.097129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d58d144d444a5895d002f81cf0bf2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:11.099383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d58d144d444a5895d002f81cf0bf2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:11.128186 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3083/6145] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:10 2022] DELETE /identity/v3/users/31d58d144d444a5895d002f81cf0bf2d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:11.129343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:11.129768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:11.130202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:11.195541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:11.196780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:11.266975 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:11.294833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3063/6146] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:11.303850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:11.305876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:11.394591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46092-1433-4472-9aac-e771b70c9e36 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:11.399060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:11.400208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:11.400485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:11.400752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:11.424312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:11.425829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23450e-7fa6-4c30-a36b-0420768d7326 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:11.433229 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:11.461598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3084/6147] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:13.103159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:13.114673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:13.133056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f050de-0452-4897-b293-ea35067a4efa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:13.144558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:13.145986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.146763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.147839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] PATH_INFO: `/v3/projects/703dfa4ed0754356bfceaf96794ebd41` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.151589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703dfa4ed0754356bfceaf96794ebd41)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:13.154341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:13.271443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703dfa4ed0754356bfceaf96794ebd41', 'request_id': 'req-15a3122a-da73-46fb-99a4-f23025018443'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:13.283693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703dfa4ed0754356bfceaf96794ebd41', 'request_id': 'req-15a3122a-da73-46fb-99a4-f23025018443'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:13.297609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703dfa4ed0754356bfceaf96794ebd41', 'request_id': 'req-15a3122a-da73-46fb-99a4-f23025018443'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:13.320546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] The token cache is being invalidate because project 703dfa4ed0754356bfceaf96794ebd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:13.321053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:13.322687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-15a3122a-da73-46fb-99a4-f23025018443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:13.324979 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3064/6148] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:13 2022] DELETE /identity/v3/projects/703dfa4ed0754356bfceaf96794ebd41 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:13.329772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.330713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.331222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.354325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:13.356105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:13.458648 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3085/6149] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:13.459959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.460257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.460561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.519713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:13.521024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:13.564196 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3065/6150] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:25:13.566546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:13.586507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc091fa3-1c9a-4cee-ae09-3032f0c20527 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:13.606585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:13.607446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.607809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.608336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.609247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:13.609598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:13.613586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:13.652617 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3086/6151] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:13.654914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:13.681740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d80f2c-9fd2-411f-9153-0879de23462e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:13.704418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:13.705057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.705338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.706008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.706263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:13.708194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:13.758244 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3066/6152] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:13 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:13.762594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:13.776171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbff6-2ce0-43cd-9142-eb6340c6b3cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:13.860229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:13.860882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.861325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.861896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.862856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:13.881304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:13.932094 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3087/6153] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:13 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:13.934491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:13.946181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d569e71-2dc1-41b7-b56a-0f49a415ba88 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:13.952352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:13.953531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:13.954179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:13.954852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:13.955709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:13.957593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:13.982041 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3067/6154] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:13.987306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.003173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb746-cbb7-466b-bf04-ba94652439d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.018640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.019282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.019568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.019843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.020495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:14.026844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b626-6171-4372-9c34-cddbc33e57b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:14.054120 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3088/6155] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:14.058123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.069005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714f7a-916f-47a7-8225-57db4923dcc5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.086587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.087351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.087637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.087917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] PATH_INFO: `/v3/projects/6bbb9daca35e4a86956a0831ccae50fa/users/b6f0e2a4028e4e21a8f139855fc32213/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.119838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbb9daca35e4a86956a0831ccae50fa, user_id=b6f0e2a4028e4e21a8f139855fc32213, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:14.122541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:14.151974 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3068/6156] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:14 2022] PUT /identity/v3/projects/6bbb9daca35e4a86956a0831ccae50fa/users/b6f0e2a4028e4e21a8f139855fc32213/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:14.163395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.163689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.164228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.247512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] MFA Rules not processed for user `b6f0e2a4028e4e21a8f139855fc32213`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:14.248767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:14.400106 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:14.429468 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3089/6157] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:14.432620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.552064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b30a-1126-4c9d-a6bb-ae402e8540cc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.563872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.564556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.564838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.565418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.566121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:14.568404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:14.589880 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:14.636825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3069/6158] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:14 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:14.638302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.668390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc41f4-8504-4a5c-aefa-74dc282085f4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.830973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.833012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.833568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.834088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.835020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:14.837789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:14.895477 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3090/6159] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:14 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:14.899747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.926481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68300-c6d3-4d4e-9b66-10dbe1a6de30 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.934294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.934294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.934565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.934822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:14.935530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:14.937554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:14.951623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3070/6160] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:14.955667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:14.968320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b5b69-d92b-4d3a-9ab4-15ee96b79044 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:14.975899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:14.980781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:14.981075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:14.981360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] PATH_INFO: `/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda/users/53999c962d8f4f1c8b36f718ddff6b18/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.018406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=648a2e1ce4934d2ab4ab476a8ec5fcda, user_id=53999c962d8f4f1c8b36f718ddff6b18, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.022041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.044402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3091/6161] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:14 2022] PUT /identity/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda/users/53999c962d8f4f1c8b36f718ddff6b18/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:15.049136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.062984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bd82-200a-4ce2-84b9-dd909a6689e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.139405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.140738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.141440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.141995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.142815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.145093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058e05d-3f67-4af6-a226-fd797413dbb6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.157704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3071/6162] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:15.162371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.175895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa237d-a3c0-4a3d-a701-ee9f6b2f5b4a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.181943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.182890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.183343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.183783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] PATH_INFO: `/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda/users/53999c962d8f4f1c8b36f718ddff6b18/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.186444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648a2e1ce4934d2ab4ab476a8ec5fcda, user_id=53999c962d8f4f1c8b36f718ddff6b18, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.190523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.218555 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3092/6163] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:15 2022] PUT /identity/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda/users/53999c962d8f4f1c8b36f718ddff6b18/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:15.220187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.220590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.220902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.254184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] MFA Rules not processed for user `53999c962d8f4f1c8b36f718ddff6b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:15.255416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:15.345929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3072/6164] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:15.351006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.363967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d776b8-14f7-4751-91a2-95a6ebf9b340 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.371231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.371231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.371563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.372251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.373784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.375939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.412041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3093/6165] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:15 2022] POST /identity/v3/projects => generated 329 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:15.414209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.427134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f97e2-5030-4f49-9bbe-f01b78417511 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.515956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.516814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.517254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.517708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.518666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.523682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.534381 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:15.557716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3073/6166] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:15 2022] POST /identity/v3/users => generated 416 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:15.561774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.576100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3f9f-0f86-4ed2-8fa6-1ce15f765cde tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.581956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.583167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.583910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.583910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.584486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.586625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.610035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3094/6167] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:15 2022] POST /identity/v3/roles => generated 243 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:15.611728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.624144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc13bd-1994-4824-b177-d625dfdf29d0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.631280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.632358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.633161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.634496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.635602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.638106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.675211 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3074/6168] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:15 2022] POST /identity/v3/roles => generated 246 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:15.675484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.686682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b3ce-6406-4edb-a726-13ff8c1dcb4e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.691690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.692525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.692820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.693097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d/users/99a4b8da7e2f44f09df8ee7c05c15cff/roles/ecd8b05aac854014b46c2364df1c7321` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.716454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4e6ff88ef8a4175ab9756f484ed2d2d, user_id=99a4b8da7e2f44f09df8ee7c05c15cff, role_id=ecd8b05aac854014b46c2364df1c7321)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.719908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.750514 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3095/6169] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:15 2022] PUT /identity/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d/users/99a4b8da7e2f44f09df8ee7c05c15cff/roles/ecd8b05aac854014b46c2364df1c7321 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:15.754640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.769239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bf37-ab41-4c70-928a-74000100cd94 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:15.911822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:15.912767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:15.913064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:15.913349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d/users/99a4b8da7e2f44f09df8ee7c05c15cff/roles/c80e029e0b8d4b79bc03da84ab78e4c1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:15.916697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4e6ff88ef8a4175ab9756f484ed2d2d, user_id=99a4b8da7e2f44f09df8ee7c05c15cff, role_id=c80e029e0b8d4b79bc03da84ab78e4c1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:15.919859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ecfc-91bc-4fdc-9b4b-5035f536029b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:15.944589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3075/6170] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:15 2022] PUT /identity/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d/users/99a4b8da7e2f44f09df8ee7c05c15cff/roles/c80e029e0b8d4b79bc03da84ab78e4c1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:15.949503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:15.964074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe259f1-5656-4750-9368-274e25f351f7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:16.137595 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:16.163274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:16.164130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.164417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.164690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.165531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:16.167708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945898b9-c940-4e7f-a32e-416b9b51f3dd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:16.234118 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3096/6171] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:15 2022] GET /identity/v3/users => generated 9182 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:16.239072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.239618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.239618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.292577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] MFA Rules not processed for user `99a4b8da7e2f44f09df8ee7c05c15cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:16.293899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:16.489883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3076/6172] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:25:16.501332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c01b-e740-4189-b034-2d04713f816c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.501947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c01b-e740-4189-b034-2d04713f816c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.502125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c01b-e740-4189-b034-2d04713f816c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.542521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e898c01b-e740-4189-b034-2d04713f816c None None] MFA Rules not processed for user `99a4b8da7e2f44f09df8ee7c05c15cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:16.562437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e898c01b-e740-4189-b034-2d04713f816c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:16.583192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3097/6173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:16.588362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:16.604001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791903b-ec2e-4e6f-984f-cda20d8f3731 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:16.616393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a4b8da7e2f44f09df8ee7c05c15cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-489626164', 'tempest-NotDelegatedRole-733938621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:16.616915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.617194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.617529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.618900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: Authorizing `identity:create_trust()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:16.620106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:16.766320 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:16.819199 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3077/6174] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:16 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:16.823523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898c01b-e740-4189-b034-2d04713f816c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:16.845603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898c01b-e740-4189-b034-2d04713f816c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:16.859251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:16.860229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.860403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.860737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.861495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:16.862621 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:25:16.862621 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:25:16.862621 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:25:16.866773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:16.881474 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3098/6175] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:25:16 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:16.886423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:16.899781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb735c9-dd5b-41cf-abea-0af0019c8b9e tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:16.912453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a4b8da7e2f44f09df8ee7c05c15cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-489626164', 'tempest-NotDelegatedRole-733938621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:16.913503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:16.914032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:16.914539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] PATH_INFO: `/v3/OS-TRUST/trusts/25ba56af033744608531460280921dda` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:16.933234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: Authorizing `identity:delete_trust(trust_id=25ba56af033744608531460280921dda)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:16.935074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:16.964425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '25ba56af033744608531460280921dda', 'request_id': 'req-aa6720bd-881e-4d35-8ecf-f2e3d221e012'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:16.966507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '25ba56af033744608531460280921dda', 'request_id': 'req-aa6720bd-881e-4d35-8ecf-f2e3d221e012'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:16.968660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '25ba56af033744608531460280921dda', 'request_id': 'req-aa6720bd-881e-4d35-8ecf-f2e3d221e012'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.002142 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3078/6176] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:25:16 2022] DELETE /identity/v3/OS-TRUST/trusts/25ba56af033744608531460280921dda => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:17.006159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:17.010716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:17.033312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e04d-5d8c-4dbc-b8c7-362766d38642 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:17.047044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a4b8da7e2f44f09df8ee7c05c15cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-489626164', 'tempest-NotDelegatedRole-733938621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:17.048503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:17.048783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:17.049059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] PATH_INFO: `/v3/OS-TRUST/trusts/25ba56af033744608531460280921dda` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Could not find trust: 25ba56af033744608531460280921dda.: keystone.exception.TrustNotFound: Could not find trust: 25ba56af033744608531460280921dda. Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 25 01:25:17.111103 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 25ba56af033744608531460280921dda. Sep 25 01:25:17.112197 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:17.113071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3099/6177] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:17 2022] GET /identity/v3/OS-TRUST/trusts/25ba56af033744608531460280921dda => generated 111 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:17.116698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:17.119816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:17.154680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6720bd-881e-4d35-8ecf-f2e3d221e012 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:17.169801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:17.170697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:17.171031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:17.172402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/c80e029e0b8d4b79bc03da84ab78e4c1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:17.174726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c80e029e0b8d4b79bc03da84ab78e4c1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:17.186318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:17.262862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role c80e029e0b8d4b79bc03da84ab78e4c1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:17.263510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.263970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.266352 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3079/6178] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:17 2022] DELETE /identity/v3/roles/c80e029e0b8d4b79bc03da84ab78e4c1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:17.270298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:17.274064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:17.293026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182885d-0d13-466e-ba92-008f1fbccb39 tempest-TrustsV3TestJSON-2094081878 tempest-user-1541865242] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:17.370078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:17.370937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:17.371403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:17.371841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/ecd8b05aac854014b46c2364df1c7321` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:17.373684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ecd8b05aac854014b46c2364df1c7321)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:17.376546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:17.450405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role ecd8b05aac854014b46c2364df1c7321 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:17.451015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.452357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.455610 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3100/6179] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:17 2022] DELETE /identity/v3/roles/ecd8b05aac854014b46c2364df1c7321 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:17.459557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:17.475417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5612-493f-4358-8070-de73aaf0c8bd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:17.627489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:17.631648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:17.632152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:17.636522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/99a4b8da7e2f44f09df8ee7c05c15cff` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:17.639348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=99a4b8da7e2f44f09df8ee7c05c15cff)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:17.645363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:17.799773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a4b8da7e2f44f09df8ee7c05c15cff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.800986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a4b8da7e2f44f09df8ee7c05c15cff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.825573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a4b8da7e2f44f09df8ee7c05c15cff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.832056 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=12 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:17.850873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a4b8da7e2f44f09df8ee7c05c15cff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.851984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a4b8da7e2f44f09df8ee7c05c15cff'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:17.877554 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3080/6180] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:17 2022] DELETE /identity/v3/users/99a4b8da7e2f44f09df8ee7c05c15cff => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:17.882916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:17.886121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:17.903266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37e48-08f4-4359-a268-917d0d03d5c1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.002449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.003611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.003903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.004182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.006587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4e6ff88ef8a4175ab9756f484ed2d2d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.012772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.051869 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:18.080837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'request_id': 'req-7706764d-5190-47a7-85e6-7f8576be7268'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.099198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'request_id': 'req-7706764d-5190-47a7-85e6-7f8576be7268'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.116251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e6ff88ef8a4175ab9756f484ed2d2d', 'request_id': 'req-7706764d-5190-47a7-85e6-7f8576be7268'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.137170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project c4e6ff88ef8a4175ab9756f484ed2d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:18.137664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.138588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.149059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3101/6181] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:17 2022] DELETE /identity/v3/projects/c4e6ff88ef8a4175ab9756f484ed2d2d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:18.150791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.152263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.168587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f3667-d63a-4ff6-81a4-fa774852c7dc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.269152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.270075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.270458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.270895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.271781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.275111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.313549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3081/6182] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:18 2022] POST /identity/v3/projects => generated 328 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:18.317589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.319737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.349919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.351694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.357265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706764d-5190-47a7-85e6-7f8576be7268 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.429877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45391bc-3d2e-4aa3-a0ae-c8a9e54125c2 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.439985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.440648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.440930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.441882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] PATH_INFO: `/v3/users/c5dbbc7017ae488a8d091db10cf69f2e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.443240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5dbbc7017ae488a8d091db10cf69f2e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.445168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.491027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.491902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.492329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.492712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.493610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.495839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.519753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5dbbc7017ae488a8d091db10cf69f2e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.520539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5dbbc7017ae488a8d091db10cf69f2e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.524139 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3102/6183] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:18 2022] POST /identity/v3/users => generated 416 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:18.529030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.530856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.532371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5dbbc7017ae488a8d091db10cf69f2e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.542607 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:18.544518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230db1d-9647-4c71-89de-bcb16e8bf569 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.548722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5dbbc7017ae488a8d091db10cf69f2e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.549516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a47ca7c0-86f7-4c35-8fbf-ddf555a5d90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5dbbc7017ae488a8d091db10cf69f2e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:18.549990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.550601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.550884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.551158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.551839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.553455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.567349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3082/6184] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:18 2022] DELETE /identity/v3/users/c5dbbc7017ae488a8d091db10cf69f2e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:18.573064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3103/6185] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:18 2022] POST /identity/v3/roles => generated 244 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:18.576116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.576116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.576116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.577396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.590493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909028ae-2f90-466f-b682-d965567d0696 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.600866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:18.602436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.666365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.667394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.667394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.667593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.668119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.669787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.688143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3104/6186] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:18 2022] POST /identity/v3/roles => generated 247 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:18.692386 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3083/6187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:18.692532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.699833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.701729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:18.706675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b889c-8d28-477a-bae8-58235acba4ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.712437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.713447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.713900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.714339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/f52be5251b35448887eb8e7a42b5bd4f/users/d510b511c7664978b84e0407283f0a8b/roles/6fd02bfd20ca4a018bbf1f86ee85a542` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.736142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f52be5251b35448887eb8e7a42b5bd4f, user_id=d510b511c7664978b84e0407283f0a8b, role_id=6fd02bfd20ca4a018bbf1f86ee85a542)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.737569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.748756 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:18.755552 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3105/6188] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:18 2022] PUT /identity/v3/projects/f52be5251b35448887eb8e7a42b5bd4f/users/d510b511c7664978b84e0407283f0a8b/roles/6fd02bfd20ca4a018bbf1f86ee85a542 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:18.760026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:18.797481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc90e7-3dab-4793-9c97-286ce04c5027 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.898241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874819-7ac8-424f-a14d-9a23f756f234 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:18.905761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.906592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.906887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.907204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/f52be5251b35448887eb8e7a42b5bd4f/users/d510b511c7664978b84e0407283f0a8b/roles/c01b8f629feb47bfaef2d62f7693ef00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.919921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f52be5251b35448887eb8e7a42b5bd4f, user_id=d510b511c7664978b84e0407283f0a8b, role_id=c01b8f629feb47bfaef2d62f7693ef00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:18.926349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:18.927404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:18.928025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:18.928406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:18.928990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:18.951050 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3106/6189] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:18 2022] PUT /identity/v3/projects/f52be5251b35448887eb8e7a42b5bd4f/users/d510b511c7664978b84e0407283f0a8b/roles/c01b8f629feb47bfaef2d62f7693ef00 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:18.959894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.018967 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:19.037338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.038860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f41b9-6383-480b-abd1-7dbf7cdac6ce service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.040489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b05c5-5238-4c14-8c40-a15747d0f4b4 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.046727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.047794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.048184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.048567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.049371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.051367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbbb6e-994c-47ff-aa0c-87f4810de06d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.051503 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3084/6190] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:25:19.082427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3107/6191] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:18 2022] GET /identity/v3/users => generated 8903 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:19.089652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.090464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.090842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.168410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] MFA Rules not processed for user `d510b511c7664978b84e0407283f0a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:19.170402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.318592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3085/6192] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:19.323386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.323797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.324180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.349842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] MFA Rules not processed for user `d510b511c7664978b84e0407283f0a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:19.350963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.359597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3108/6193] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:19.363768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.375277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ec7e-3a20-40bd-8d0f-213f308c5b25 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.379831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd510b511c7664978b84e0407283f0a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52be5251b35448887eb8e7a42b5bd4f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1199436440', 'tempest-NotDelegatedRole-1969532403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.380200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.380588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.380959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.381790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorizing `identity:create_trust()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.383267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.484529 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3086/6194] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:19 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:19.488831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.500209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd809-fb47-4351-94c5-916a41b7dfe7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.506429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd510b511c7664978b84e0407283f0a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52be5251b35448887eb8e7a42b5bd4f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1199436440', 'tempest-NotDelegatedRole-1969532403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.507093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.507377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.508806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.509069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.513135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.520998 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3109/6195] 10.222.0.16 () {58 vars in 1252 bytes} [Sun Sep 25 01:25:19 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=d510b511c7664978b84e0407283f0a8b => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:19.522850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.534537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebee579-9555-434c-b1a0-9f2da5751373 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.540805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd510b511c7664978b84e0407283f0a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52be5251b35448887eb8e7a42b5bd4f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1199436440', 'tempest-NotDelegatedRole-1969532403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.542186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.542472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.542801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] PATH_INFO: `/v3/OS-TRUST/trusts/cfc614c75e5a4709a35d7134bc8a81bf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.549624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorizing `identity:delete_trust(trust_id=cfc614c75e5a4709a35d7134bc8a81bf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.551494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.573154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cfc614c75e5a4709a35d7134bc8a81bf', 'request_id': 'req-a193ffe2-dc5b-4208-aa7b-6362d40e7712'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:19.574055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cfc614c75e5a4709a35d7134bc8a81bf', 'request_id': 'req-a193ffe2-dc5b-4208-aa7b-6362d40e7712'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:19.574789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'cfc614c75e5a4709a35d7134bc8a81bf', 'request_id': 'req-a193ffe2-dc5b-4208-aa7b-6362d40e7712'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:19.593585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3087/6196] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:25:19 2022] DELETE /identity/v3/OS-TRUST/trusts/cfc614c75e5a4709a35d7134bc8a81bf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:19.597644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.600170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.635540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ff8d-01d6-493d-bfa3-aea7b0e72726 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.650814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd510b511c7664978b84e0407283f0a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52be5251b35448887eb8e7a42b5bd4f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1199436440', 'tempest-NotDelegatedRole-1969532403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.651637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.651806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.652235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] PATH_INFO: `/v3/OS-TRUST/trusts/cfc614c75e5a4709a35d7134bc8a81bf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Could not find trust: cfc614c75e5a4709a35d7134bc8a81bf.: keystone.exception.TrustNotFound: Could not find trust: cfc614c75e5a4709a35d7134bc8a81bf. Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 25 01:25:19.677464 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: cfc614c75e5a4709a35d7134bc8a81bf. Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:19.679630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3110/6197] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:19 2022] GET /identity/v3/OS-TRUST/trusts/cfc614c75e5a4709a35d7134bc8a81bf => generated 111 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:19.682308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.682308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.714155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ffe2-dc5b-4208-aa7b-6362d40e7712 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.720257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.720907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.721194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.721507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/c01b8f629feb47bfaef2d62f7693ef00` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.724084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c01b8f629feb47bfaef2d62f7693ef00)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.726391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.774078 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:19.831965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.834246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.838102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role c01b8f629feb47bfaef2d62f7693ef00 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:19.838602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:19.839562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:19.845494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3088/6198] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:19 2022] DELETE /identity/v3/roles/c01b8f629feb47bfaef2d62f7693ef00 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:19.846526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:19.848729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:19.965539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f861e-f589-4c8d-8342-4fe86731553d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:19.972763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:19.973395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:19.973922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:19.974485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/6fd02bfd20ca4a018bbf1f86ee85a542` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:19.978713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6fd02bfd20ca4a018bbf1f86ee85a542)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:19.980931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:19.990635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aabd45-9a60-4495-8249-77e0353b4f47 tempest-TrustsV3TestJSON-808723093 tempest-user-2126480560] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:20.005852 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:20.051159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role 6fd02bfd20ca4a018bbf1f86ee85a542 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:20.051593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.052345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.054498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3089/6199] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:19 2022] DELETE /identity/v3/roles/6fd02bfd20ca4a018bbf1f86ee85a542 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:20.059061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:20.060580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:20.086926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:20.088962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:20.089587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:20.090198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] PATH_INFO: `/v3/projects/6ac8e6d5be6e490cb0a496ee5864d351` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:20.092632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac8e6d5be6e490cb0a496ee5864d351)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:20.095222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:20.167972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc536e9-86eb-4524-a3d7-c63335e269fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:20.189823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac8e6d5be6e490cb0a496ee5864d351', 'request_id': 'req-417c3c05-24b2-451c-88aa-4476bff1fa85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.206739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac8e6d5be6e490cb0a496ee5864d351', 'request_id': 'req-417c3c05-24b2-451c-88aa-4476bff1fa85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.225296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac8e6d5be6e490cb0a496ee5864d351', 'request_id': 'req-417c3c05-24b2-451c-88aa-4476bff1fa85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.251692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] The token cache is being invalidate because project 6ac8e6d5be6e490cb0a496ee5864d351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:20.252289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.253037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.255354 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3111/6200] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:19 2022] DELETE /identity/v3/projects/6ac8e6d5be6e490cb0a496ee5864d351 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:20.259277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:20.264622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:20.361027 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:20.374814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:20.375539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:20.375846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:20.376117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/d510b511c7664978b84e0407283f0a8b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:20.377551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d510b511c7664978b84e0407283f0a8b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:20.379344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:20.428959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3c05-24b2-451c-88aa-4476bff1fa85 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:20.438189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:20.439397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:20.440196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:20.440951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] PATH_INFO: `/v3/users/e63fd402f1f146078a217a1cc04bc0be` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:20.443540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63fd402f1f146078a217a1cc04bc0be)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:20.447139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:20.460993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd510b511c7664978b84e0407283f0a8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.462778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd510b511c7664978b84e0407283f0a8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.474115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd510b511c7664978b84e0407283f0a8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.499307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd510b511c7664978b84e0407283f0a8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.500686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd510b511c7664978b84e0407283f0a8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.521654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3090/6201] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:20 2022] DELETE /identity/v3/users/d510b511c7664978b84e0407283f0a8b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:20.526284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:20.528807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:20.556466 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:20.564609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63fd402f1f146078a217a1cc04bc0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.578176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63fd402f1f146078a217a1cc04bc0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.607392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63fd402f1f146078a217a1cc04bc0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.608167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63fd402f1f146078a217a1cc04bc0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.608794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63fd402f1f146078a217a1cc04bc0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.630692 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3112/6202] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:20 2022] DELETE /identity/v3/users/e63fd402f1f146078a217a1cc04bc0be => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:20.647777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4de53-f56d-4a95-81f5-3767cb37e310 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:20.748309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:20.749209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:20.751001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:20.751384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/f52be5251b35448887eb8e7a42b5bd4f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:20.753063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f52be5251b35448887eb8e7a42b5bd4f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:20.755335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:20.790302 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:20.834650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52be5251b35448887eb8e7a42b5bd4f', 'request_id': 'req-204f5c02-72da-4718-aac6-cfe79ce0520f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.844889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52be5251b35448887eb8e7a42b5bd4f', 'request_id': 'req-204f5c02-72da-4718-aac6-cfe79ce0520f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.856414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52be5251b35448887eb8e7a42b5bd4f', 'request_id': 'req-204f5c02-72da-4718-aac6-cfe79ce0520f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.890369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project f52be5251b35448887eb8e7a42b5bd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:20.890792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.892276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:20.901700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3091/6203] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:20 2022] DELETE /identity/v3/projects/f52be5251b35448887eb8e7a42b5bd4f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:20.905161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:20.906950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:20.927295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a5617-a327-45ad-b801-0b3c21d8d611 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:20.984921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:20.987540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:21.054072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.057003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.057573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.058082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.059377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.062184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.120098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5c02-72da-4718-aac6-cfe79ce0520f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.131417 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3113/6204] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:20 2022] POST /identity/v3/projects => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:21.132710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.135797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:21.138936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.141445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.141445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.141445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] PATH_INFO: `/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.145477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264247e02bac44f6921b0a5d7d4aa3e0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.152075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.262913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ed584-c2a6-45da-b6f2-3fcf17ed0aa1 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.291124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264247e02bac44f6921b0a5d7d4aa3e0', 'request_id': 'req-f7496f4a-d368-4565-91aa-1e6dd1d39e56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:21.303427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264247e02bac44f6921b0a5d7d4aa3e0', 'request_id': 'req-f7496f4a-d368-4565-91aa-1e6dd1d39e56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:21.319159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264247e02bac44f6921b0a5d7d4aa3e0', 'request_id': 'req-f7496f4a-d368-4565-91aa-1e6dd1d39e56'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:21.355362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] The token cache is being invalidate because project 264247e02bac44f6921b0a5d7d4aa3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:21.356657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:21.358018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f7496f4a-d368-4565-91aa-1e6dd1d39e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:21.363151 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3092/6205] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:20 2022] DELETE /identity/v3/projects/264247e02bac44f6921b0a5d7d4aa3e0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:21.373676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5076d-24b2-41aa-b135-7befd6be1604 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.373966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5076d-24b2-41aa-b135-7befd6be1604 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.374291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5076d-24b2-41aa-b135-7befd6be1604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.398507 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:21.407458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.410328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.421849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.422343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.423060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.425243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.457080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-70f5076d-24b2-41aa-b135-7befd6be1604 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:21.460655 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3114/6206] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/users => generated 413 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:21.464628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-70f5076d-24b2-41aa-b135-7befd6be1604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:21.465194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.467471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:21.508096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d40035-ce3c-474c-837d-5a9a6da11cb5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.519066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.521191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.521585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.524509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.525325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.528560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.569359 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:21.573324 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3115/6207] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/roles => generated 243 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:21.578781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.591974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08159-a969-49eb-81c6-5ab667070109 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.598365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.599091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.599450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.599838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.600798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.603219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.624016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3116/6208] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/roles => generated 246 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:21.628928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.643008 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3093/6209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:21.654473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.656829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.656978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4709-24d7-4cd9-83e2-e4a10e490ccd tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.657829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.665276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.666682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.668279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.668605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a/users/5000c6afeae041148228671cab6c461e/roles/a30e3fec24694b1389b9991b5dde7c6c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.711100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5bfa10c48b7e4a2b9c6b125a4d2d5e4a, user_id=5000c6afeae041148228671cab6c461e, role_id=a30e3fec24694b1389b9991b5dde7c6c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.715907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:21.716138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.719096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:21.734394 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3094/6210] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:21.738461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.744751 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3117/6211] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:21 2022] PUT /identity/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a/users/5000c6afeae041148228671cab6c461e/roles/a30e3fec24694b1389b9991b5dde7c6c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:21.748892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.752423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732414b-97d8-49ab-b770-62d4a7d7d349 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.839168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.841349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.841720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.842006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.842861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:21.843455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.846434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.848706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dbabc-0cf1-4cfc-be69-8cc5f696a290 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:21.855424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:21.855424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:21.855990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:21.856375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a/users/5000c6afeae041148228671cab6c461e/roles/e87765b327d14f0d977913f3d885f86a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:21.858911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5bfa10c48b7e4a2b9c6b125a4d2d5e4a, user_id=5000c6afeae041148228671cab6c461e, role_id=e87765b327d14f0d977913f3d885f86a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:21.861902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:21.874864 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3095/6212] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:21.880932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.882340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3118/6213] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:21 2022] PUT /identity/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a/users/5000c6afeae041148228671cab6c461e/roles/e87765b327d14f0d977913f3d885f86a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:21.890313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:21.896000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831e68b-672c-4452-9867-1959ce8c9a80 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.015915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.017377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.017952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.018459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.020355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.023911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.047357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39411d-b810-4ff5-b742-70627bc372e7 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.059946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.062125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.063794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.066787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.069202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.077732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50670eab-46c9-421a-ab60-dcdeb661de75 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.078929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3096/6214] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:21 2022] POST /identity/v3/projects => generated 397 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:22.082846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.152678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3119/6215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:21 2022] GET /identity/v3/users => generated 8615 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:22.154150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19fc41-cc31-4a90-96c2-6187bbea4b28 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.154460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19fc41-cc31-4a90-96c2-6187bbea4b28 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.154775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19fc41-cc31-4a90-96c2-6187bbea4b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.183341 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:22.201456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13753b-940c-4d05-8f1c-c8165d8eff97 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.208902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0b19fc41-cc31-4a90-96c2-6187bbea4b28 None None] MFA Rules not processed for user `5000c6afeae041148228671cab6c461e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:22.210035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.210287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b19fc41-cc31-4a90-96c2-6187bbea4b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:22.211035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.212352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.213470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.214392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.218535 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:22.221003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.256441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3097/6216] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:22 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:22.259281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.272740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57df2b0-285b-4b66-89b8-2ed467191c58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.279756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.281483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.281846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.282345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.283071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.285606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.317933 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3098/6217] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:22 2022] GET /identity/v3/roles => generated 1891 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:22.320833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.340622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f098d5c-487a-4689-bd49-7b658fe9e6b5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.353446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3120/6218] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:22.369848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.370148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.370437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.370561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.371423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.371800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.372250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.373794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.380460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.402686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] MFA Rules not processed for user `5000c6afeae041148228671cab6c461e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:22.404083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:22.410244 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3099/6219] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:22 2022] GET /identity/v3/roles => generated 1891 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:22.417893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.419616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3121/6220] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:22.432056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.435083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedf41a-d4c2-48af-a6af-473fb8fc2b5b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.441610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.442389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.442767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.443189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] PATH_INFO: `/v3/projects/ab8c2da638164e929e966afb207f226a/users/a448e3982db840189af1a6af4464dbe4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.461021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2c961-b7be-4116-a034-04a6bb4666b7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.465342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8c2da638164e929e966afb207f226a, user_id=a448e3982db840189af1a6af4464dbe4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.468697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f320d6-e333-487d-be40-7c524e26244b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.485067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.486279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.486433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.486655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.487338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:create_trust()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.497146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3100/6221] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:22 2022] PUT /identity/v3/projects/ab8c2da638164e929e966afb207f226a/users/a448e3982db840189af1a6af4464dbe4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:22.497395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.499649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.500184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.500629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.567041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] MFA Rules not processed for user `a448e3982db840189af1a6af4464dbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:22.569675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:22.706550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3122/6222] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:22 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:22.710610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.736436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ee3-8059-4639-b726-c4a76c579c95 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.748844 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3101/6223] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:22.804467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.808001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:22.889381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.890329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.890778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.891228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.911411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:get_trust(trust_id=401e58ef27d0456683ede8e5f773268f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.912907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.934065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3123/6224] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:22 2022] GET /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f => generated 858 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:22.935558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:22.954306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef21c0-c052-4f3f-8695-23f37e7bffba tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.967761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.968433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.968723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.969000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:22.976076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb370aa-bc9e-4b83-99a2-82868ca11334 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:22.984915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=401e58ef27d0456683ede8e5f773268f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:22.986959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:22.990021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:22.990296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:22.990572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:22.991017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.005378 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3124/6225] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:25:22 2022] GET /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:25:23.007507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.012688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.014333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.027413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0357-3e92-45f8-8752-282b905d639d tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.038184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.039081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3102/6226] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:23.039401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.040816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.041219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/a30e3fec24694b1389b9991b5dde7c6c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.043908 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:23.059400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:get_role_for_trust(trust_id=401e58ef27d0456683ede8e5f773268f, role_id=a30e3fec24694b1389b9991b5dde7c6c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.061143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.074966 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3125/6227] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:23 2022] GET /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/a30e3fec24694b1389b9991b5dde7c6c => generated 243 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:23.075210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.089089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8bfe8-5b56-461d-98d6-05627534f8fd service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.106465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.106917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.107207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.107499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/a30e3fec24694b1389b9991b5dde7c6c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.123080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:get_role_for_trust(trust_id=401e58ef27d0456683ede8e5f773268f, role_id=a30e3fec24694b1389b9991b5dde7c6c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.124434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.138376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3103/6228] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:23 2022] HEAD /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/a30e3fec24694b1389b9991b5dde7c6c => generated 0 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 25 01:25:23.141006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.153051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649ee8-4ab9-4736-a0f0-c332077c1ef7 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.158453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.159248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.159634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.160033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/e87765b327d14f0d977913f3d885f86a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.169703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:get_role_for_trust(trust_id=401e58ef27d0456683ede8e5f773268f, role_id=e87765b327d14f0d977913f3d885f86a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.172054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Could not find role: e87765b327d14f0d977913f3d885f86a.: keystone.exception.RoleNotFound: Could not find role: e87765b327d14f0d977913f3d885f86a. Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:23.187539 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e87765b327d14f0d977913f3d885f86a. Sep 25 01:25:23.188761 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:23.192099 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3126/6229] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:23 2022] GET /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/e87765b327d14f0d977913f3d885f86a => generated 110 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:23.195051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.208329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5835155-870d-4d41-9704-55a1989cc657 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.221650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.222327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.222609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.222884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/e87765b327d14f0d977913f3d885f86a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.233484 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:23.237792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:get_role_for_trust(trust_id=401e58ef27d0456683ede8e5f773268f, role_id=e87765b327d14f0d977913f3d885f86a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.239537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Could not find role: e87765b327d14f0d977913f3d885f86a.: keystone.exception.RoleNotFound: Could not find role: e87765b327d14f0d977913f3d885f86a. Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:23.265717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e87765b327d14f0d977913f3d885f86a. Sep 25 01:25:23.266834 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:23.267762 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3104/6230] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:23 2022] HEAD /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f/roles/e87765b327d14f0d977913f3d885f86a => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 25 01:25:23.272821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.286108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c494ac-5bc2-4d83-bba6-d97538212ed9 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.297698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.298430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.298815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.299224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.320338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorizing `identity:delete_trust(trust_id=401e58ef27d0456683ede8e5f773268f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.330349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.402710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '401e58ef27d0456683ede8e5f773268f', 'request_id': 'req-0bb49fc7-d723-44c9-a3d0-7199f1b61189'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:23.403925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '401e58ef27d0456683ede8e5f773268f', 'request_id': 'req-0bb49fc7-d723-44c9-a3d0-7199f1b61189'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:23.406587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '401e58ef27d0456683ede8e5f773268f', 'request_id': 'req-0bb49fc7-d723-44c9-a3d0-7199f1b61189'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:23.436826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3127/6231] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:25:23 2022] DELETE /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:23.440862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.449731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:23.493117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5600a-8caf-4be2-a608-a1244698da4f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.499548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5000c6afeae041148228671cab6c461e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-713256587', 'tempest-NotDelegatedRole-298514954'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.500276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.500560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.500893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] PATH_INFO: `/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Could not find trust: 401e58ef27d0456683ede8e5f773268f.: keystone.exception.TrustNotFound: Could not find trust: 401e58ef27d0456683ede8e5f773268f. Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 25 01:25:23.532179 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 401e58ef27d0456683ede8e5f773268f. Sep 25 01:25:23.533297 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:23.542085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.543801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:23.547358 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3105/6232] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:23 2022] GET /identity/v3/OS-TRUST/trusts/401e58ef27d0456683ede8e5f773268f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:23.728346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49fc7-d723-44c9-a3d0-7199f1b61189 tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:23.746389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:23.747207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:23.747498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:23.747775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/e87765b327d14f0d977913f3d885f86a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:23.749273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e87765b327d14f0d977913f3d885f86a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:23.751364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:23.812232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role e87765b327d14f0d977913f3d885f86a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:23.812597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:23.813312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:23.817976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3128/6233] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:23 2022] DELETE /identity/v3/roles/e87765b327d14f0d977913f3d885f86a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:23.822117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:23.823947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:23.852743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92669895-2af4-41b4-acf0-ed9e5f50565f tempest-TrustsV3TestJSON-23996631 tempest-user-378372327] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:24.008948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:24.010034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:24.010382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:24.010721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/a30e3fec24694b1389b9991b5dde7c6c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:24.012316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a30e3fec24694b1389b9991b5dde7c6c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:24.014141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:24.089619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role a30e3fec24694b1389b9991b5dde7c6c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:24.089923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.091897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.096781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3106/6234] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:23 2022] DELETE /identity/v3/roles/a30e3fec24694b1389b9991b5dde7c6c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:24.100956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:24.124042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52c2d-76b8-4361-8588-4038de300770 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:24.232767 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:24.242218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:24.244196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:24.245155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:24.245606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/5000c6afeae041148228671cab6c461e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:24.247366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5000c6afeae041148228671cab6c461e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:24.250374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:24.336001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5000c6afeae041148228671cab6c461e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.347067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5000c6afeae041148228671cab6c461e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.381142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5000c6afeae041148228671cab6c461e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.382684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5000c6afeae041148228671cab6c461e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.398707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5000c6afeae041148228671cab6c461e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.472497 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3129/6235] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:24 2022] DELETE /identity/v3/users/5000c6afeae041148228671cab6c461e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:24.476410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:24.478026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:24.511881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb920ff-0cef-4d58-a105-a9f51498be80 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:24.687452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:24.688922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:24.700011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:24.701873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:24.702387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:24.706077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:24.710787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5bfa10c48b7e4a2b9c6b125a4d2d5e4a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:24.730351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:24.856250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a0242-5a00-4ccc-9ab2-eccfe1c4b959 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:24.881911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'request_id': 'req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.885715 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:24.915276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'request_id': 'req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:24.957792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfa10c48b7e4a2b9c6b125a4d2d5e4a', 'request_id': 'req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.020654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project 5bfa10c48b7e4a2b9c6b125a4d2d5e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:25.021063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.023854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.036712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3107/6236] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:24 2022] DELETE /identity/v3/projects/5bfa10c48b7e4a2b9c6b125a4d2d5e4a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:25.043246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.045537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:25.046568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:25.046859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:25.047136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:25.050171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:25.058288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:25.082269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:25.083902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:25.100781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3130/6237] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:25:25.101746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.103958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:25.125054 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:25.241700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cc4d-81ee-4e6f-b94b-c64dd1c8d8ec tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:25.260829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6e1e87b6b134af2af85899605553992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28da7f2f544b476aaab588c6dd8c1835', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:25.261901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:25.261998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:25.265054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:25.265889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:25.269724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:25.273270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:25.293883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f93b-7f52-442c-9184-bd3404279cb0 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:25.304374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:25.305147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:25.306301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:25.306678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:25.307485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:25.309684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:25.333362 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3108/6238] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:25.334700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.342705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:25.379596 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3131/6239] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:25 2022] POST /identity/v3/projects => generated 329 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:25.382283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.565047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d42-69ec-487a-9f36-6778677b425d tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:25.590768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221768d-5021-4042-b4db-64a6e8e20868 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:25.610583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6e1e87b6b134af2af85899605553992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28da7f2f544b476aaab588c6dd8c1835', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:25.618029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:25.618029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:25.618029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:25.619882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:25.630887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:25.716575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:25.717306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:25.717616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:25.717896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] PATH_INFO: `/v3/users/5eb4a7652e4c4f16833ab002da950f02` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:25.721734 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3132/6240] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:25 2022] POST /identity/v3/projects => generated 348 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:25.724979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb4a7652e4c4f16833ab002da950f02)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:25.725904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:25.737500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.786666 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:25.833861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb4a7652e4c4f16833ab002da950f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.834622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb4a7652e4c4f16833ab002da950f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.850165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb4a7652e4c4f16833ab002da950f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.875642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb4a7652e4c4f16833ab002da950f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.876535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb4a7652e4c4f16833ab002da950f02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:25.898280 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3109/6241] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:25 2022] DELETE /identity/v3/users/5eb4a7652e4c4f16833ab002da950f02 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:25.900290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:25.902649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:25.924091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d076d-ec54-46a1-9ff7-02b6d0053ec1 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:25.967537 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:26.069316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.070067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.070740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.072189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.072873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.078140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.083884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8d79a-584a-4ce1-bbcf-ca7acd00e27c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.098989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6e1e87b6b134af2af85899605553992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28da7f2f544b476aaab588c6dd8c1835', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.100163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.100721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.102358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.104362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:26.105875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.110846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.131158 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3133/6242] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:25 2022] POST /identity/v3/users => generated 413 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:26.136774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.138903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:26.153597 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3110/6243] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:26.167325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9185f74-8bbd-4ca6-89a3-5ffd8a176771 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.174215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.174831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.175113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.175385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.176053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.177875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.198985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3134/6244] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:26 2022] POST /identity/v3/roles => generated 243 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:26.203599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.217627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad31b7-ec11-4ba9-8c1a-2c4f2ebb0595 tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.223105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.223731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.224065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.224781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.225515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.227170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.252126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3111/6245] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:26 2022] POST /identity/v3/roles => generated 247 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:26.253473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.272284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534635-b270-425c-921c-644bed1d123b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.306371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.307128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.307424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.307708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/0fba6b22121843fc87149e989b073d3a/users/87e7530633614709b69c8aadd17a44ac/roles/12fad5ff6a1b4b59ade945e3abdd3355` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.348342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0fba6b22121843fc87149e989b073d3a, user_id=87e7530633614709b69c8aadd17a44ac, role_id=12fad5ff6a1b4b59ade945e3abdd3355)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.352635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.373277 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3135/6246] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:26 2022] PUT /identity/v3/projects/0fba6b22121843fc87149e989b073d3a/users/87e7530633614709b69c8aadd17a44ac/roles/12fad5ff6a1b4b59ade945e3abdd3355 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:26.377690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.407715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc57f-e103-4686-ac7e-6018dedacd4f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.573555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.576023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:26.687648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.688516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.688813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.689265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/0fba6b22121843fc87149e989b073d3a/users/87e7530633614709b69c8aadd17a44ac/roles/00ad28591051474eaa414af5df8129f4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.698470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0fba6b22121843fc87149e989b073d3a, user_id=87e7530633614709b69c8aadd17a44ac, role_id=00ad28591051474eaa414af5df8129f4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.705134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.740888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3112/6247] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:26 2022] PUT /identity/v3/projects/0fba6b22121843fc87149e989b073d3a/users/87e7530633614709b69c8aadd17a44ac/roles/00ad28591051474eaa414af5df8129f4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:26.745724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:26.771228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da5b1-b724-4806-a2b9-d7c51b13e3ee tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.788135 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:26.915260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.915948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.916233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.916507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] PATH_INFO: `/v3/projects/9423abf226924bda908336987ed1ef5f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.918024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9423abf226924bda908336987ed1ef5f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.920744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.922987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc04b7-2033-4ebf-9ba1-8b18ab009a88 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:26.930133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:26.930955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:26.931438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:26.931720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:26.932402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:26.935226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b69d7-eb3c-4026-b809-f2535c5a691c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:26.994608 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:27.028917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9423abf226924bda908336987ed1ef5f', 'request_id': 'req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.034865 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3113/6248] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:26 2022] GET /identity/v3/users => generated 8624 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:27.040735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215e0c-26e8-4c11-b9fd-04fc261c0ded None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:27.044963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215e0c-26e8-4c11-b9fd-04fc261c0ded None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:27.045264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215e0c-26e8-4c11-b9fd-04fc261c0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:27.048073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9423abf226924bda908336987ed1ef5f', 'request_id': 'req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.068485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9423abf226924bda908336987ed1ef5f', 'request_id': 'req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.107546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] The token cache is being invalidate because project 9423abf226924bda908336987ed1ef5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:27.108438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.110572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.113975 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3136/6249] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:26 2022] DELETE /identity/v3/projects/9423abf226924bda908336987ed1ef5f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:27.121580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:27.124474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.170458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d1215e0c-26e8-4c11-b9fd-04fc261c0ded None None] MFA Rules not processed for user `87e7530633614709b69c8aadd17a44ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:27.172320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1215e0c-26e8-4c11-b9fd-04fc261c0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.302879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da09dd-8444-4d2d-b74e-ab5cff05ab6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:27.310101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:27.311503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:27.311953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:27.312381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] PATH_INFO: `/v3/users/6ba73048e8e94c36823562113114e0be` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:27.327627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba73048e8e94c36823562113114e0be)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:27.332182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:27.343374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3114/6250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:27.355389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734920e-ca4e-405a-aa10-7906b75a5b00 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:27.358433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734920e-ca4e-405a-aa10-7906b75a5b00 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:27.358890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734920e-ca4e-405a-aa10-7906b75a5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:27.450599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b734920e-ca4e-405a-aa10-7906b75a5b00 None None] MFA Rules not processed for user `87e7530633614709b69c8aadd17a44ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:27.454604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b734920e-ca4e-405a-aa10-7906b75a5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.468061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba73048e8e94c36823562113114e0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.485958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3115/6251] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:27.486973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:27.487323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:27.487757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:27.488594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba73048e8e94c36823562113114e0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.540875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:27.546107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba73048e8e94c36823562113114e0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.547266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba73048e8e94c36823562113114e0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.548810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba73048e8e94c36823562113114e0be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:27.551111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.573826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3137/6252] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:27 2022] DELETE /identity/v3/users/6ba73048e8e94c36823562113114e0be => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:27.575039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:27.577684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.638368 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:27.688451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4505d-70b5-4ca0-b0cc-6701b7d79787 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:27.688750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3116/6253] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:27.695143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87e7530633614709b69c8aadd17a44ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fba6b22121843fc87149e989b073d3a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1359195606', 'tempest-DelegatedRole-843646752'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:27.696302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:27.696704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:27.697450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:27.701728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] RBAC: Authorizing `identity:create_trust()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:27.704482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:27.856210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:27.857890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Sep 25 01:25:27.861085 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise ValueError(str(e)) Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Sep 25 01:25:27.862413 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 25 01:25:27.863824 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:27.864996 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3138/6254] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:27 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 290 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:25:27.870050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:27.872395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:27.932064 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:27.998752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c3367-39a1-44ad-88e9-acd9a5286725 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.024777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fba9-ea99-4c21-b82a-c5fea12af10b tempest-TrustsV3TestJSON-1840363748 tempest-user-356214290] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.040350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.041013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.041301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.041592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/00ad28591051474eaa414af5df8129f4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.047595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=00ad28591051474eaa414af5df8129f4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.050691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.124820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6e1e87b6b134af2af85899605553992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28da7f2f544b476aaab588c6dd8c1835', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.125989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.126278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.126678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] PATH_INFO: `/v3/projects/d79cc21461244ebcbdc601940a09adfc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.136288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d79cc21461244ebcbdc601940a09adfc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.140333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role 00ad28591051474eaa414af5df8129f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:28.140637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.141437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.143902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.152225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3139/6255] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:27 2022] DELETE /identity/v3/roles/00ad28591051474eaa414af5df8129f4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:28.153344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.156248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.268037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79cc21461244ebcbdc601940a09adfc', 'request_id': 'req-055000c9-9aa1-4984-9b39-40fd7eaf268e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.284191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79cc21461244ebcbdc601940a09adfc', 'request_id': 'req-055000c9-9aa1-4984-9b39-40fd7eaf268e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.298688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79cc21461244ebcbdc601940a09adfc', 'request_id': 'req-055000c9-9aa1-4984-9b39-40fd7eaf268e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.305888 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:28.323312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] The token cache is being invalidate because project d79cc21461244ebcbdc601940a09adfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:28.323617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.331330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.336633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3117/6256] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:27 2022] DELETE /identity/v3/projects/d79cc21461244ebcbdc601940a09adfc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:28.337554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.349692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf42e0-d513-4519-8a8e-771f20b6f817 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.349896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.467533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.468260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.468565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.468843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/12fad5ff6a1b4b59ade945e3abdd3355` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.472588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12fad5ff6a1b4b59ade945e3abdd3355)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.474305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.475378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055000c9-9aa1-4984-9b39-40fd7eaf268e tempest-RoutersAdminTest-185705509 tempest-RoutersAdminTest-185705509-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.481809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.482476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.482854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.483195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] PATH_INFO: `/v3/projects/62fc68ffd9554380913f6abd8a1c92fa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.484517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fc68ffd9554380913f6abd8a1c92fa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.487372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.502519 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:28.541498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role 12fad5ff6a1b4b59ade945e3abdd3355 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:28.541931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.543128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.545795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3140/6257] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:28 2022] DELETE /identity/v3/roles/12fad5ff6a1b4b59ade945e3abdd3355 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:28.550491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.552546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.577765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fc68ffd9554380913f6abd8a1c92fa', 'request_id': 'req-1a479cde-64af-4de2-9656-135751bf4f2a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.594095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fc68ffd9554380913f6abd8a1c92fa', 'request_id': 'req-1a479cde-64af-4de2-9656-135751bf4f2a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.604842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fc68ffd9554380913f6abd8a1c92fa', 'request_id': 'req-1a479cde-64af-4de2-9656-135751bf4f2a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.630069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] The token cache is being invalidate because project 62fc68ffd9554380913f6abd8a1c92fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:28.631184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.634585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:28.642699 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3118/6258] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:28 2022] DELETE /identity/v3/projects/62fc68ffd9554380913f6abd8a1c92fa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:28.644241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.645943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.685368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae24e-4e8e-4f02-9872-b06aafc979fe tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.695125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.698194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.698738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.699254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.703837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.803312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479cde-64af-4de2-9656-135751bf4f2a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:28.816733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:28.818326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:28.818716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:28.819091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:28.822363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.839964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.841730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.882092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3119/6259] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:28.884946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.886444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:28.890009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:28.893784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.919415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3141/6260] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:28.923223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:28.928515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:28.987070 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:29.078617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11676-bddf-470e-b5bd-3285e0e91812 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:29.079850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf965-84af-46f7-b7d0-24af07f03fd1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:29.086741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:29.087693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:29.088148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:29.088737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:29.091445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:29.096570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:29.098413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:29.099201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:29.099651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/87e7530633614709b69c8aadd17a44ac` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:29.105832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=87e7530633614709b69c8aadd17a44ac)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:29.110541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:29.181543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:29.184456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:29.216041 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3142/6261] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:29.219277 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:29.226747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e7530633614709b69c8aadd17a44ac'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.229755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e7530633614709b69c8aadd17a44ac'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.251598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e7530633614709b69c8aadd17a44ac'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.282136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e7530633614709b69c8aadd17a44ac'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.282915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e7530633614709b69c8aadd17a44ac'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.315768 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3120/6262] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:28 2022] DELETE /identity/v3/users/87e7530633614709b69c8aadd17a44ac => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:29.324258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:29.344451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a483b-6424-4030-9942-1e10bb8b35b3 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:29.468531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:29.469513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:29.469513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:29.469797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/0fba6b22121843fc87149e989b073d3a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:29.474750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0fba6b22121843fc87149e989b073d3a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:29.486204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:29.607564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fba6b22121843fc87149e989b073d3a', 'request_id': 'req-6d080168-705c-4a0e-bd25-c618035c8455'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.623311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fba6b22121843fc87149e989b073d3a', 'request_id': 'req-6d080168-705c-4a0e-bd25-c618035c8455'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.633621 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:29.639704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fba6b22121843fc87149e989b073d3a', 'request_id': 'req-6d080168-705c-4a0e-bd25-c618035c8455'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.673730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project 0fba6b22121843fc87149e989b073d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:29.674132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.674819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:29.681606 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3143/6263] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:29 2022] DELETE /identity/v3/projects/0fba6b22121843fc87149e989b073d3a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:29.682929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:29.684987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:29.705357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da235-f885-42a3-b7b4-4bab3bf3fc8e tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:29.790813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:29.791474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:29.791770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:29.792027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:29.792687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:29.794874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:29.858596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:29.862412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:29.873763 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3121/6264] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:29 2022] POST /identity/v3/projects => generated 329 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:29.895253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080168-705c-4a0e-bd25-c618035c8455 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.038085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.045872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.046407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.046802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.047653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.051222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.099397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3144/6265] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:29 2022] POST /identity/v3/users => generated 416 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:30.106060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:30.135341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f160-57cd-48d4-9f6f-73a706899f05 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.148439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.149673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.150013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.150515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.151205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.152848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01924e-dec8-40d1-a06c-64190c74923d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.191936 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3122/6266] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/roles => generated 243 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:30.195700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:30.219242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5594-8636-460f-ac83-e8cbc3b15ae0 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.235156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7214ff-73bc-4f95-9f45-92aa680d7b54 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.235428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7214ff-73bc-4f95-9f45-92aa680d7b54 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.235789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7214ff-73bc-4f95-9f45-92aa680d7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.235965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.237319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.237878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.238412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.239423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.241543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.260808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0e7214ff-73bc-4f95-9f45-92aa680d7b54 None None] MFA Rules not processed for user `45ae26af1d0d4104850875f565485d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:30.264346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0e7214ff-73bc-4f95-9f45-92aa680d7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:30.275006 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3145/6267] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/roles => generated 246 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:30.276907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:30.295731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef95263-213e-4ff3-b7ed-c89778f8fda9 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.305517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.306750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.307414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.308233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/e48c45d529124bcb84b39c907d0d85d1/users/4fc6d321a70c4768aa17feacae67f8fd/roles/687c9cc0f0ff4381bc68f5b9b29f134a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.338529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e48c45d529124bcb84b39c907d0d85d1, user_id=4fc6d321a70c4768aa17feacae67f8fd, role_id=687c9cc0f0ff4381bc68f5b9b29f134a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.342198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.369029 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3146/6268] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:30 2022] PUT /identity/v3/projects/e48c45d529124bcb84b39c907d0d85d1/users/4fc6d321a70c4768aa17feacae67f8fd/roles/687c9cc0f0ff4381bc68f5b9b29f134a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:30.373383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:30.408379 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3123/6269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:30.421449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cf9e-6ce6-4ff7-b22c-ba9aebff3e39 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.421847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cf9e-6ce6-4ff7-b22c-ba9aebff3e39 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.422200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cf9e-6ce6-4ff7-b22c-ba9aebff3e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.449534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d543cf9e-6ce6-4ff7-b22c-ba9aebff3e39 None None] MFA Rules not processed for user `45ae26af1d0d4104850875f565485d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:30.450761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d543cf9e-6ce6-4ff7-b22c-ba9aebff3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:30.472601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff229f2-ce62-44a7-a5f3-854cdec46a56 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.479116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.479897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.480256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.480613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/e48c45d529124bcb84b39c907d0d85d1/users/4fc6d321a70c4768aa17feacae67f8fd/roles/fcf5217a793a4e4c9bd9bea81eae09d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.483620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e48c45d529124bcb84b39c907d0d85d1, user_id=4fc6d321a70c4768aa17feacae67f8fd, role_id=fcf5217a793a4e4c9bd9bea81eae09d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.486993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.497505 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:30.514230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3147/6270] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:30 2022] PUT /identity/v3/projects/e48c45d529124bcb84b39c907d0d85d1/users/4fc6d321a70c4768aa17feacae67f8fd/roles/fcf5217a793a4e4c9bd9bea81eae09d7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:30.515335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:30.555204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3124/6271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:30.584206 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=91,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:30.630506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9cb8-d61e-4322-9e84-9f8feea749fa tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:30.636800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:30.638336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.638712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.638911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.639596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:30.641537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f848-43a9-4c75-8cd3-1b6f82b6045f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:30.681664 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3148/6272] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:30 2022] GET /identity/v3/users => generated 8341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:30.689521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.689845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.690072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.777862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] MFA Rules not processed for user `4fc6d321a70c4768aa17feacae67f8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:30.779675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:30.894714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3125/6273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:30.906276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:30.906780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:30.907608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:30.947730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] MFA Rules not processed for user `4fc6d321a70c4768aa17feacae67f8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:30.949107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:30.965331 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3149/6274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:25:30.977974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.010653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f16b1-458b-40f3-9eca-aac14a8ae288 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.019951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.021497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.021727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.022001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.025703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:create_trust()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.029683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.124986 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3126/6275] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:30 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:31.129013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.141129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfd38-232a-4b81-894f-1267ff3a9fa9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.146699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.147894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.148501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.149467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.157689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:get_trust(trust_id=88205eb2791a4550a1266e7a54059672)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.159629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.173152 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3150/6276] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:31 2022] GET /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672 => generated 833 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:31.181181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.198012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4106-afa8-4362-8bb8-d0861732a4ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.213981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.214780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.215516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.216040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.225789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=88205eb2791a4550a1266e7a54059672)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.228086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.239611 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3127/6277] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:25:31 2022] GET /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:31.244296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.256149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d3f0-519a-49a9-83ad-0a65e2a16834 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.262025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.263202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.263668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.264107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/687c9cc0f0ff4381bc68f5b9b29f134a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.271142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:get_role_for_trust(trust_id=88205eb2791a4550a1266e7a54059672, role_id=687c9cc0f0ff4381bc68f5b9b29f134a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.273149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.283213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3151/6278] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:31 2022] GET /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/687c9cc0f0ff4381bc68f5b9b29f134a => generated 243 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:31.287616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.308056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229abc-801e-4a5c-a0ca-f20c880f1e91 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.317260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.317980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.318234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.318902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/687c9cc0f0ff4381bc68f5b9b29f134a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.341856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:get_role_for_trust(trust_id=88205eb2791a4550a1266e7a54059672, role_id=687c9cc0f0ff4381bc68f5b9b29f134a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.343342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.360387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3128/6279] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:31 2022] HEAD /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/687c9cc0f0ff4381bc68f5b9b29f134a => generated 0 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 25 01:25:31.364827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.391106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd51bad-15a2-465f-829a-19ced5b2ea37 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.397166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.398142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.398421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.398695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/fcf5217a793a4e4c9bd9bea81eae09d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.408111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:get_role_for_trust(trust_id=88205eb2791a4550a1266e7a54059672, role_id=fcf5217a793a4e4c9bd9bea81eae09d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.409906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7.: keystone.exception.RoleNotFound: Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7. Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:31.422414 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7. Sep 25 01:25:31.426967 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:31.426967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3152/6280] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:31 2022] GET /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/fcf5217a793a4e4c9bd9bea81eae09d7 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:31.427917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.440436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d2e1-78fd-4866-b032-b150b99e2c53 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.453884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.454721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.455110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.455415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/fcf5217a793a4e4c9bd9bea81eae09d7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.464136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:get_role_for_trust(trust_id=88205eb2791a4550a1266e7a54059672, role_id=fcf5217a793a4e4c9bd9bea81eae09d7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.465848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7.: keystone.exception.RoleNotFound: Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7. Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:31.480504 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fcf5217a793a4e4c9bd9bea81eae09d7. Sep 25 01:25:31.481791 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:31.485256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3129/6281] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:31 2022] HEAD /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672/roles/fcf5217a793a4e4c9bd9bea81eae09d7 => generated 0 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 25 01:25:31.487507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.500110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a51cc-e973-43fa-a261-3a514163f7ab tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.505268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.505955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.506271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.506548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.514451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorizing `identity:delete_trust(trust_id=88205eb2791a4550a1266e7a54059672)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.516312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.542478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '88205eb2791a4550a1266e7a54059672', 'request_id': 'req-3bccde17-007f-4f6d-8586-7152d04e17d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:31.548253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '88205eb2791a4550a1266e7a54059672', 'request_id': 'req-3bccde17-007f-4f6d-8586-7152d04e17d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:31.549451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '88205eb2791a4550a1266e7a54059672', 'request_id': 'req-3bccde17-007f-4f6d-8586-7152d04e17d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:31.594163 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3153/6282] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:25:31 2022] DELETE /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:31.598854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.607993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:31.619069 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:31.627633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfcf7-2261-4555-8bd8-a5e63cdebd6d tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.635615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc6d321a70c4768aa17feacae67f8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e48c45d529124bcb84b39c907d0d85d1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-789907410', 'tempest-NotDelegatedRole-529384369'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.636405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.636673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.637024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] PATH_INFO: `/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Could not find trust: 88205eb2791a4550a1266e7a54059672.: keystone.exception.TrustNotFound: Could not find trust: 88205eb2791a4550a1266e7a54059672. Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 25 01:25:31.647343 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 88205eb2791a4550a1266e7a54059672. Sep 25 01:25:31.649446 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:31.654436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.656083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:31.658425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3130/6283] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:31 2022] GET /identity/v3/OS-TRUST/trusts/88205eb2791a4550a1266e7a54059672 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:31.676303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccde17-007f-4f6d-8586-7152d04e17d8 tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.682279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.682895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.683244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.683669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/fcf5217a793a4e4c9bd9bea81eae09d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.685951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fcf5217a793a4e4c9bd9bea81eae09d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.687731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:31.780421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role fcf5217a793a4e4c9bd9bea81eae09d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:31.780781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:31.781544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:31.783832 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3154/6284] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:31 2022] DELETE /identity/v3/roles/fcf5217a793a4e4c9bd9bea81eae09d7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:31.788129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:31.790913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:31.815563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fa930-2c6c-40c2-aff8-42f5d8b59e0e tempest-TrustsV3TestJSON-1079410898 tempest-user-2122831367] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:31.931775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:31.932440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:31.932652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:31.932941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/687c9cc0f0ff4381bc68f5b9b29f134a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:31.936071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=687c9cc0f0ff4381bc68f5b9b29f134a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:31.940173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:32.015705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role 687c9cc0f0ff4381bc68f5b9b29f134a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:32.016096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.024528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.029817 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3131/6285] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:31 2022] DELETE /identity/v3/roles/687c9cc0f0ff4381bc68f5b9b29f134a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:32.031219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:32.061199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7c0e-4072-4e0b-a33a-f319cef8d960 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:32.178885 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:32.204572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:32.205802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:32.206256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:32.206767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/4fc6d321a70c4768aa17feacae67f8fd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:32.208730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4fc6d321a70c4768aa17feacae67f8fd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:32.213822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:32.300402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc6d321a70c4768aa17feacae67f8fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.312535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc6d321a70c4768aa17feacae67f8fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.346351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc6d321a70c4768aa17feacae67f8fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.352314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc6d321a70c4768aa17feacae67f8fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.353877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc6d321a70c4768aa17feacae67f8fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.387956 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3155/6286] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:32 2022] DELETE /identity/v3/users/4fc6d321a70c4768aa17feacae67f8fd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:32.393455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:32.394718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:32.431288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977e908-6d68-485f-b7ed-05560ce37fac tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:32.580177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:32.583051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:32.583589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:32.584113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/e48c45d529124bcb84b39c907d0d85d1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:32.587095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e48c45d529124bcb84b39c907d0d85d1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:32.590407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:32.704514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48c45d529124bcb84b39c907d0d85d1', 'request_id': 'req-400324c1-1aa3-47f8-a333-f233cd096af5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.712853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48c45d529124bcb84b39c907d0d85d1', 'request_id': 'req-400324c1-1aa3-47f8-a333-f233cd096af5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.718571 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:32.721087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48c45d529124bcb84b39c907d0d85d1', 'request_id': 'req-400324c1-1aa3-47f8-a333-f233cd096af5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.741819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project e48c45d529124bcb84b39c907d0d85d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:32.742203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.743833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:32.760265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3132/6287] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:32 2022] DELETE /identity/v3/projects/e48c45d529124bcb84b39c907d0d85d1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:32.767422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:32.768916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:32.786004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee92c-67c2-4ef4-9d0f-fda30fe1aebc tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:32.870631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:32.871268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:32.871761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:32.872044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:32.872684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:32.874861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:32.952129 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3156/6288] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:25:32 2022] POST /identity/v3/projects => generated 329 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:32.956225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:32.958057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:33.011532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400324c1-1aa3-47f8-a333-f233cd096af5 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.150612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.153529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.153853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.154139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.154830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.158270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.234831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.247318 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3133/6289] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:32 2022] POST /identity/v3/users => generated 416 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:33.254581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46681f03-c906-47dd-8274-c2aab1ba5e9f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.264746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.266350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.266826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.267268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.268109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.269970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.310547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.311002 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3157/6290] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:33 2022] POST /identity/v3/roles => generated 243 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:33.332890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67c06c-5bb2-489c-8318-866419f6fd8b tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.338790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.339516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.340241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.340241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.341012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.342762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.365630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3134/6291] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:33 2022] POST /identity/v3/roles => generated 246 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:33.367295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.385361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a90f79-07b7-41dd-b461-dda934896ccb tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.391966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.394206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.394714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.395241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/10663e8d72a646e2860ddd55cf67cca8/users/d9aa1adbbdce4151ac0e3915ec3b85b4/roles/8ba90b53431749618cc33d52af20416e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.418265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10663e8d72a646e2860ddd55cf67cca8, user_id=d9aa1adbbdce4151ac0e3915ec3b85b4, role_id=8ba90b53431749618cc33d52af20416e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.421723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.439687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3158/6292] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:33 2022] PUT /identity/v3/projects/10663e8d72a646e2860ddd55cf67cca8/users/d9aa1adbbdce4151ac0e3915ec3b85b4/roles/8ba90b53431749618cc33d52af20416e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:33.443819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.460659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a7c6-66d2-4e99-86ef-37e21904ef5c tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.549203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.550653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.550942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.551226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/10663e8d72a646e2860ddd55cf67cca8/users/d9aa1adbbdce4151ac0e3915ec3b85b4/roles/a6aaa26e7a144cea95b75addcebf1440` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.553671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10663e8d72a646e2860ddd55cf67cca8, user_id=d9aa1adbbdce4151ac0e3915ec3b85b4, role_id=a6aaa26e7a144cea95b75addcebf1440)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.558077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4bca-80e6-452b-9859-870c5ccc0c92 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.576746 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3135/6293] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:33 2022] PUT /identity/v3/projects/10663e8d72a646e2860ddd55cf67cca8/users/d9aa1adbbdce4151ac0e3915ec3b85b4/roles/a6aaa26e7a144cea95b75addcebf1440 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:33.581434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.603069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e720b-f180-4891-ab62-a2ecc4ee5e44 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:33.625629 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:33.718012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:33.719253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.719543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.719825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.722118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:33.726488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da7ba-cd44-4b37-9779-502ad4f158ea tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:33.790250 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3159/6294] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:33 2022] GET /identity/v3/users => generated 8341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:33.792557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.793251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.793770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.838308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] MFA Rules not processed for user `d9aa1adbbdce4151ac0e3915ec3b85b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:33.839338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:33.894779 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:33.951611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:33.951986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:33.952903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:33.958454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3136/6295] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:33.979234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] MFA Rules not processed for user `d9aa1adbbdce4151ac0e3915ec3b85b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:33.980862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:33.993322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:33.999658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3160/6296] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:34.003447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b504f-be8c-4920-8c36-97335b733081 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.013158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.014356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.014654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.014932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.015610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:create_trust()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.017047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.185023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3137/6297] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:25:33 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:34.189596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.202163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5a73f-ef1c-429e-8a14-4a0515779d43 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.208802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.210345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.210963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.213151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.226960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:get_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.230510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.247223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.248025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3161/6298] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:34 2022] GET /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e => generated 834 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:34.261895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe419-c3c3-491f-94da-f52dd5605134 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.280500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.281995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.282499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.282957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.314684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.316466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.334619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.334835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3138/6299] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:25:34 2022] GET /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles => generated 370 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:34.354049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea162-8ddd-405f-b6da-8a5bf04d12d2 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.370263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.373368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.373967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.374696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/8ba90b53431749618cc33d52af20416e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.392719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e, role_id=8ba90b53431749618cc33d52af20416e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.404657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.441925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3162/6300] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:34 2022] GET /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/8ba90b53431749618cc33d52af20416e => generated 243 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:34.443806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.456736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f823-d5b7-47f6-a498-2087927664fb tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.470052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.470893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.471176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.471495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/8ba90b53431749618cc33d52af20416e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.490093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e, role_id=8ba90b53431749618cc33d52af20416e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.491522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.513439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3139/6301] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:34 2022] HEAD /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/8ba90b53431749618cc33d52af20416e => generated 0 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:34.519299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.536011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60787-caa9-4cdc-add3-6f8c5bbf5d03 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.550320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.551119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.551507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.551894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/a6aaa26e7a144cea95b75addcebf1440` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.567003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e, role_id=a6aaa26e7a144cea95b75addcebf1440)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.568642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Could not find role: a6aaa26e7a144cea95b75addcebf1440.: keystone.exception.RoleNotFound: Could not find role: a6aaa26e7a144cea95b75addcebf1440. Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:34.596800 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a6aaa26e7a144cea95b75addcebf1440. Sep 25 01:25:34.598189 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:25:34.603912 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3163/6302] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 25 01:25:34 2022] GET /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/a6aaa26e7a144cea95b75addcebf1440 => generated 110 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:34.604910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.616963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55babe2-0fb6-4441-9ec9-b67b032b2a3a tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.627306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.627903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.628177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.628447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/a6aaa26e7a144cea95b75addcebf1440` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.642258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e, role_id=a6aaa26e7a144cea95b75addcebf1440)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.645768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Could not find role: a6aaa26e7a144cea95b75addcebf1440.: keystone.exception.RoleNotFound: Could not find role: a6aaa26e7a144cea95b75addcebf1440. Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 25 01:25:34.660019 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a6aaa26e7a144cea95b75addcebf1440. Sep 25 01:25:34.661195 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:34.664752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3140/6303] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 25 01:25:34 2022] HEAD /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e/roles/a6aaa26e7a144cea95b75addcebf1440 => generated 0 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:34.666136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.678189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bba2-9008-41d5-b13a-ab0ea876948b tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.685700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.686637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.688613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.689104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.699562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorizing `identity:delete_trust(trust_id=09b3659b10ac4ac4a9882e8fb55fbd0e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.702622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.743863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '09b3659b10ac4ac4a9882e8fb55fbd0e', 'request_id': 'req-d151cc58-ee9c-42e1-b46f-9f0de77a9164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:34.754421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '09b3659b10ac4ac4a9882e8fb55fbd0e', 'request_id': 'req-d151cc58-ee9c-42e1-b46f-9f0de77a9164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:34.756786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '09b3659b10ac4ac4a9882e8fb55fbd0e', 'request_id': 'req-d151cc58-ee9c-42e1-b46f-9f0de77a9164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:34.777456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3164/6304] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:25:34 2022] DELETE /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:34.781614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.783474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:34.797988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa391f-50ab-4fe0-9940-06a525372805 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.802466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9aa1adbbdce4151ac0e3915ec3b85b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10663e8d72a646e2860ddd55cf67cca8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-708285633', 'tempest-DelegatedRole-315085641'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.803195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.803543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.803820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] PATH_INFO: `/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Could not find trust: 09b3659b10ac4ac4a9882e8fb55fbd0e.: keystone.exception.TrustNotFound: Could not find trust: 09b3659b10ac4ac4a9882e8fb55fbd0e. Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 25 01:25:34.813783 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 09b3659b10ac4ac4a9882e8fb55fbd0e. Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:25:34.817717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3141/6305] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:25:34 2022] GET /identity/v3/OS-TRUST/trusts/09b3659b10ac4ac4a9882e8fb55fbd0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:25:34.822510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.824412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:34.842598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151cc58-ee9c-42e1-b46f-9f0de77a9164 tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:34.847689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:34.848338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:34.848741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:34.849089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/a6aaa26e7a144cea95b75addcebf1440` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:34.850695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a6aaa26e7a144cea95b75addcebf1440)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:34.853181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:34.902500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role a6aaa26e7a144cea95b75addcebf1440 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:34.902841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:34.903720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:34.910217 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3165/6306] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:34 2022] DELETE /identity/v3/roles/a6aaa26e7a144cea95b75addcebf1440 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:34.912009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:34.913866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:34.932431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0470e-a4e6-4c46-912e-ebb65fe4c68d tempest-TrustsV3TestJSON-1006560909 tempest-user-1260919488] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:35.043647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:35.044491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:35.044909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:35.045663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/roles/8ba90b53431749618cc33d52af20416e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:35.047452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ba90b53431749618cc33d52af20416e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:35.049666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:35.067727 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:35.141740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invalidating the token cache because role 8ba90b53431749618cc33d52af20416e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:35.142669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.145038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.151518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3142/6307] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:34 2022] DELETE /identity/v3/roles/8ba90b53431749618cc33d52af20416e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:35.155631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:35.176220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21773e-01e3-4f47-81e5-e7a7f6416f9d tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:35.230440 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:35.275227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:35.276011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:35.276699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:35.277079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/users/d9aa1adbbdce4151ac0e3915ec3b85b4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:35.278896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d9aa1adbbdce4151ac0e3915ec3b85b4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:35.281355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:35.347064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9aa1adbbdce4151ac0e3915ec3b85b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.361647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9aa1adbbdce4151ac0e3915ec3b85b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.379999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9aa1adbbdce4151ac0e3915ec3b85b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.382343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9aa1adbbdce4151ac0e3915ec3b85b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.383866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9aa1adbbdce4151ac0e3915ec3b85b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.422420 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3166/6308] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:35 2022] DELETE /identity/v3/users/d9aa1adbbdce4151ac0e3915ec3b85b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:35.424910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:35.426699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:35.464863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f74-2750-4ca1-9fd2-6bc6efba3f79 tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:35.575887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53999c962d8f4f1c8b36f718ddff6b18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:35.577320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:35.577862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:35.578369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] PATH_INFO: `/v3/projects/10663e8d72a646e2860ddd55cf67cca8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:35.579846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10663e8d72a646e2860ddd55cf67cca8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:35.582515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:35.717723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10663e8d72a646e2860ddd55cf67cca8', 'request_id': 'req-2a2801a4-8716-4855-8660-ec734cd8d39f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.738570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10663e8d72a646e2860ddd55cf67cca8', 'request_id': 'req-2a2801a4-8716-4855-8660-ec734cd8d39f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.747650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10663e8d72a646e2860ddd55cf67cca8', 'request_id': 'req-2a2801a4-8716-4855-8660-ec734cd8d39f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.768129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] The token cache is being invalidate because project 10663e8d72a646e2860ddd55cf67cca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:35.768544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.769428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2a2801a4-8716-4855-8660-ec734cd8d39f tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:35.771585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3143/6309] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:35 2022] DELETE /identity/v3/projects/10663e8d72a646e2860ddd55cf67cca8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:35.782408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:35.785270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:35.915032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe4e5f-3d1f-4e6d-ad72-fc4aff46b16a tempest-TrustsV3TestJSON-2133213503 tempest-TrustsV3TestJSON-2133213503-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:35.995759 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:36.006304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:36.007660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:36.008837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:36.010162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] PATH_INFO: `/v3/users/b6f0e2a4028e4e21a8f139855fc32213` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:36.011669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f0e2a4028e4e21a8f139855fc32213)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:36.029265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:36.112582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f0e2a4028e4e21a8f139855fc32213'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:36.123344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f0e2a4028e4e21a8f139855fc32213'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:36.140259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f0e2a4028e4e21a8f139855fc32213'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:36.141000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f0e2a4028e4e21a8f139855fc32213'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:36.141764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f0e2a4028e4e21a8f139855fc32213'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:36.158709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3167/6310] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:35 2022] DELETE /identity/v3/users/b6f0e2a4028e4e21a8f139855fc32213 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:36.163175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:36.164001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:36.164655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:36.186486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:36.188037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:36.277095 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3144/6311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:36.326368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:36.327967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:36.432081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddda8c-ba51-4c9f-9a98-809cab5212c9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:36.436675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:36.437301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:36.437636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:36.437873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:36.449008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:36.451975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:36.463385 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3168/6312] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:37.436878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:37.439456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:37.449253 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:37.464479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee6986-53df-4643-a225-33ab4f85148a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:37.480322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:37.481000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:37.481285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:37.481589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] PATH_INFO: `/v3/projects/6bbb9daca35e4a86956a0831ccae50fa` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:37.482761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbb9daca35e4a86956a0831ccae50fa)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:37.490254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:37.579012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbb9daca35e4a86956a0831ccae50fa', 'request_id': 'req-dfdf94ee-400c-4c0d-a02e-434e5df85c28'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.586063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbb9daca35e4a86956a0831ccae50fa', 'request_id': 'req-dfdf94ee-400c-4c0d-a02e-434e5df85c28'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.598041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbb9daca35e4a86956a0831ccae50fa', 'request_id': 'req-dfdf94ee-400c-4c0d-a02e-434e5df85c28'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.613016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] The token cache is being invalidate because project 6bbb9daca35e4a86956a0831ccae50fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:37.613907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.614415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.620899 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3145/6313] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:37 2022] DELETE /identity/v3/projects/6bbb9daca35e4a86956a0831ccae50fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:37.621116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:37.636288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841f23-e9f6-45e0-a286-8f5ec0e351d0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:37.720008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:37.721119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:37.721718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:37.722503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] PATH_INFO: `/v3/users/53999c962d8f4f1c8b36f718ddff6b18` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:37.724045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53999c962d8f4f1c8b36f718ddff6b18)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:37.726793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:37.761478 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:37.815322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53999c962d8f4f1c8b36f718ddff6b18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.829939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53999c962d8f4f1c8b36f718ddff6b18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.847390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53999c962d8f4f1c8b36f718ddff6b18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.848526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53999c962d8f4f1c8b36f718ddff6b18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.849348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-02cc446d-b531-4f1b-85b4-81fd8f09fc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53999c962d8f4f1c8b36f718ddff6b18'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:37.875076 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3169/6314] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:37 2022] DELETE /identity/v3/users/53999c962d8f4f1c8b36f718ddff6b18 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:39.186897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:39.188980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:39.204997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ee-400c-4c0d-a02e-434e5df85c28 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:39.312157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:39.312904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:39.313122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:39.313737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] PATH_INFO: `/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:39.316914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=648a2e1ce4934d2ab4ab476a8ec5fcda)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:39.318884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:39.434175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'request_id': 'req-ce248440-6821-4bc9-ac7f-7b7619767046'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:39.443449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'request_id': 'req-ce248440-6821-4bc9-ac7f-7b7619767046'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:39.457268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648a2e1ce4934d2ab4ab476a8ec5fcda', 'request_id': 'req-ce248440-6821-4bc9-ac7f-7b7619767046'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:39.481329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] The token cache is being invalidate because project 648a2e1ce4934d2ab4ab476a8ec5fcda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:39.481624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:39.495424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce248440-6821-4bc9-ac7f-7b7619767046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:39.503678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3146/6315] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:39 2022] DELETE /identity/v3/projects/648a2e1ce4934d2ab4ab476a8ec5fcda => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:39.505180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:39.505688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:39.505808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:39.536753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:39.538579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:39.632223 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3170/6316] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:25:39.635734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:39.636254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:39.636687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:39.674963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:39.677713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:39.692387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3147/6317] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:39.693647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:39.713445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249255-786c-432c-ab00-53ee3e2dc15d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:39.728265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:39.729743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:39.730409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:39.730964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:39.732506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:39.733124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:39.736669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:39.769969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3171/6318] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:39.771694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:39.787022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af3fc-1028-4d26-8338-c3bec33760e3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:39.801236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:39.801892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:39.802170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:39.802435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:39.803068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:39.805570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:39.826322 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:39.872157 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3148/6319] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:39 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:39.872814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:39.892583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e8ff-cf28-48d7-affe-63fea027f365 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.077996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.078548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.078835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.079115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.079838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.087046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.181515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.188122 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3172/6320] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:39 2022] POST /identity/v3/users => generated 284 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:40.197834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a685-0cb7-4114-95da-c626a9f9edea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.210069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.212285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.212954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.213508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.214988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.217199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.257017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.257548 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3149/6321] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:40.269797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fcd53-7b0f-4453-bbf8-32ee0faf5439 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.278967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.279906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.280384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.280870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.282042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.284396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.312556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3173/6322] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:40.314973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.331161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d81f-7356-42ba-a8c0-b81ff1f34649 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.345649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.347822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.348987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.349494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] PATH_INFO: `/v3/projects/83c71b46ebf342a58f2cab99d49bec75/users/2a30da1bb8fd493faaa1d37acdc75e46/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.353901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.356175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:40.363294 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:40.405645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c71b46ebf342a58f2cab99d49bec75, user_id=2a30da1bb8fd493faaa1d37acdc75e46, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.409689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e042ff-6d3e-4605-98ac-943112a300d7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.438963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3150/6323] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:40 2022] PUT /identity/v3/projects/83c71b46ebf342a58f2cab99d49bec75/users/2a30da1bb8fd493faaa1d37acdc75e46/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:40.450328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.451066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.451753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.493852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88178-cce2-45d2-9dd7-0a828b9e6f77 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.511029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] MFA Rules not processed for user `2a30da1bb8fd493faaa1d37acdc75e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:40.515411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:40.595032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.595751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.596038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.596305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.602291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:40.665701 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3151/6324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:40.668302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.781912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.783408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.802310 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3174/6325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:40.808974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a0355-7b15-4b54-9393-5e6f989f1ded None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:40.822983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:40.823612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:40.823892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:40.824166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:40.824798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:40.826964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:40.902217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:40.902568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3152/6326] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:40 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:40.923495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9472-3f73-4898-aeff-ebbd5b4075b9 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.055855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.057010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.059219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.059578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.060261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.062278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.084243 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:41.106940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.121983 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3175/6327] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:40 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:41.123951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.128728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93df2d-51fc-4989-9faf-3eb3f66868a1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.129353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:41.143028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.143843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.144826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.146250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.149754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.153215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.184277 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3153/6328] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:41.186979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.225085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152fc5-b906-498d-aaa7-b9bfdee7f535 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.243448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.244209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.244492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.244766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] PATH_INFO: `/v3/projects/306821a7620446628d9a4114fa6024ab/users/38f3f33cd6a146fcbb959daeaea0111a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.301175 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:41.314612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306821a7620446628d9a4114fa6024ab, user_id=38f3f33cd6a146fcbb959daeaea0111a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.317325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.335374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f460-6098-4600-80c8-47866b807560 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.351003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.352758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.353029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.355335 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3154/6329] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:41 2022] PUT /identity/v3/projects/306821a7620446628d9a4114fa6024ab/users/38f3f33cd6a146fcbb959daeaea0111a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:41.355675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.361722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:41.362180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.568789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dbe18-3517-4202-ab7b-4c1d5689ffd7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.583431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.585990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.589416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.589740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.590417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.596422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.599186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.600659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1afc9c-c442-43d0-a20c-103f9f3d4649 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.618702 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3155/6330] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:41.621256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.635163 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3176/6331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:41.639675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53875-76fa-47a7-8801-03e1abd4ea6f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.645044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.645842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.647513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.648293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] PATH_INFO: `/v3/projects/306821a7620446628d9a4114fa6024ab/users/38f3f33cd6a146fcbb959daeaea0111a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.651069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306821a7620446628d9a4114fa6024ab, user_id=38f3f33cd6a146fcbb959daeaea0111a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.654559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:41.667470 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3156/6332] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:41 2022] PUT /identity/v3/projects/306821a7620446628d9a4114fa6024ab/users/38f3f33cd6a146fcbb959daeaea0111a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:41.680858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.681256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.681651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.745470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] MFA Rules not processed for user `38f3f33cd6a146fcbb959daeaea0111a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:41.749236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:41.948151 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3177/6333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:41.953105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:41.974341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169116-e675-4f31-ba81-5d5daeb0afd9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:41.994134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:41.994923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:41.995333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:41.995810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:41.996539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:41.998651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:42.075134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3157/6334] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:41 2022] POST /identity/v3/projects => generated 358 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:42.076932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:42.092421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308c642-bda5-4c32-831c-bd40b905e9ff None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:42.126191 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:42.261222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:42.262340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:42.263346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:42.263852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:42.266305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:42.268514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:42.357666 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3178/6335] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:42 2022] POST /identity/v3/users => generated 373 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:42.360326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:42.380304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2d3d-b95e-43e9-b561-63f92c5864f0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:42.398148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:42.399676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:42.401618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:42.402319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/4b5a9dc1cbf44d3e9123570b59aa8ac4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:42.447952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_user(user_id=4b5a9dc1cbf44d3e9123570b59aa8ac4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:42.451574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:42.454909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3158/6336] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:25:42 2022] GET /identity/v3/users/4b5a9dc1cbf44d3e9123570b59aa8ac4 => generated 373 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:42.458971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:42.479033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308053-8bbe-4fa8-8cfc-03ab5ccdc4a7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:42.511686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:42.513466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:42.513872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:42.515622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/4b5a9dc1cbf44d3e9123570b59aa8ac4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:42.518432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4b5a9dc1cbf44d3e9123570b59aa8ac4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:42.531357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:42.664757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5a9dc1cbf44d3e9123570b59aa8ac4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:42.685392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5a9dc1cbf44d3e9123570b59aa8ac4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:42.715514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5a9dc1cbf44d3e9123570b59aa8ac4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:42.716830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5a9dc1cbf44d3e9123570b59aa8ac4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:42.717817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5a9dc1cbf44d3e9123570b59aa8ac4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:42.743678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3179/6337] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:42 2022] DELETE /identity/v3/users/4b5a9dc1cbf44d3e9123570b59aa8ac4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:42.747918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:42.750579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:42.775003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149281e-86d7-47c6-9e6e-2b98bc4fad8e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:42.918628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:42.919294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:42.919561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:42.919836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/f176144e39554274894f625870fad5c8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:42.923122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f176144e39554274894f625870fad5c8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:42.926997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.019572 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:43.038417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f176144e39554274894f625870fad5c8', 'request_id': 'req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:43.054309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f176144e39554274894f625870fad5c8', 'request_id': 'req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:43.070475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f176144e39554274894f625870fad5c8', 'request_id': 'req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:43.099526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] The token cache is being invalidate because project f176144e39554274894f625870fad5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:43.099811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:43.102725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:43.106333 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3159/6338] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:42 2022] DELETE /identity/v3/projects/f176144e39554274894f625870fad5c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:43.111608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.124557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360597f2-3981-41e2-818f-cce98f150a3f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.213629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.214692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.215292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.217583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.218588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.220696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.284146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3180/6339] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:43 2022] POST /identity/v3/projects => generated 359 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:43.287901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.291834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:43.320984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9076-5935-4ad9-9a4b-2c68c3b523d7 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.479334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.480420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.480832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.481205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.482270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.485230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.535981 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3160/6340] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:43 2022] POST /identity/v3/users => generated 414 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:43.540736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.556002 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:43.569110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e5ce-e8df-4934-8ae5-33c2efef15b1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.579546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.592825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.593814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.594342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.596752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.599804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.645469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3181/6341] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:43 2022] POST /identity/v3/roles => generated 240 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:43.651249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.674547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab87d-83ab-4db9-93e6-08399a2370d5 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.687764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.689425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.689875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.690865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/e652bf554a3f401aad8857ee49c40107` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.716401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_user(user_id=e652bf554a3f401aad8857ee49c40107)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.720732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.723156 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3161/6342] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:25:43 2022] GET /identity/v3/users/e652bf554a3f401aad8857ee49c40107 => generated 414 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:43.729566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.761559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4865-647c-4b84-8402-e5df406095e1 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.782455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.783129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.783417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.783698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/roles/179bc0e7c7a04d9884d2a89fb658d902` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.797758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_role(role_id=179bc0e7c7a04d9884d2a89fb658d902)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.799179 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:25:43.799179 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:25:43.799179 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:25:43.800343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.802408 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3182/6343] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:25:43 2022] GET /identity/v3/roles/179bc0e7c7a04d9884d2a89fb658d902 => generated 240 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:43.806333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.818649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede315-f6e0-4054-8873-aa3fc5043004 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:43.829034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:43.838326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:43.838876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:43.839299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:43.840068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:43.842433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:43.919272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3162/6344] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:43 2022] POST /identity/v3/projects => generated 358 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:25:43.922938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:43.938659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60ecc-2e31-4fab-b6d8-7eb60b3dbcec tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.084717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:44.085587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:44.086127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:44.086686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/c00c71669b12416e9b8b79190d16cbae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:44.089714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_project(project_id=c00c71669b12416e9b8b79190d16cbae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:44.092226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:44.098403 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3183/6345] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:25:43 2022] GET /identity/v3/projects/c00c71669b12416e9b8b79190d16cbae => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:44.100714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:44.123572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ccee-4777-4c6b-a32a-382820d44636 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.188584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:44.189872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:44.190149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:44.190433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/c00c71669b12416e9b8b79190d16cbae/users/e652bf554a3f401aad8857ee49c40107/roles/179bc0e7c7a04d9884d2a89fb658d902` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:44.202662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c00c71669b12416e9b8b79190d16cbae, user_id=e652bf554a3f401aad8857ee49c40107, role_id=179bc0e7c7a04d9884d2a89fb658d902)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:44.207974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:44.247021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3163/6346] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:44 2022] PUT /identity/v3/projects/c00c71669b12416e9b8b79190d16cbae/users/e652bf554a3f401aad8857ee49c40107/roles/179bc0e7c7a04d9884d2a89fb658d902 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:44.251221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:44.270953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfb51-fa54-48f4-8ef0-eb61b14c2cea tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.457623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:44.458946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:44.459549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:44.460103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:44.468252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:44.472145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:44.549366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:44.565561 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3184/6347] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:44 2022] POST /identity/v3/projects => generated 359 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:44.567850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61f43-672d-40d9-8cde-582a5843622d tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.692027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:44.692994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:44.693464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:44.693913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/0eda7c07a8d2442893a7bea5c88eff81` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:44.695251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eda7c07a8d2442893a7bea5c88eff81)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:44.698302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:44.700202 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3164/6348] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:25:44 2022] GET /identity/v3/projects/0eda7c07a8d2442893a7bea5c88eff81 => generated 359 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:25:44.704860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:44.722950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201265-9736-4c3c-bcec-4e555fcfca2b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.732350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:44.733078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:44.733307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:44.733615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/0eda7c07a8d2442893a7bea5c88eff81/users/e652bf554a3f401aad8857ee49c40107/roles/179bc0e7c7a04d9884d2a89fb658d902` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:44.740879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0eda7c07a8d2442893a7bea5c88eff81, user_id=e652bf554a3f401aad8857ee49c40107, role_id=179bc0e7c7a04d9884d2a89fb658d902)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:44.745105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:44.857493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3185/6349] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:44 2022] PUT /identity/v3/projects/0eda7c07a8d2442893a7bea5c88eff81/users/e652bf554a3f401aad8857ee49c40107/roles/179bc0e7c7a04d9884d2a89fb658d902 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:44.861471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:44.886868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265d17-7580-4370-9fe3-2edde90bc17a tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:44.906100 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:45.052944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:45.053641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:45.054853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:45.055285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/e652bf554a3f401aad8857ee49c40107/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:45.058221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=e652bf554a3f401aad8857ee49c40107)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:45.060376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:45.137842 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3165/6350] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:25:44 2022] GET /identity/v3/users/e652bf554a3f401aad8857ee49c40107/projects => generated 841 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:45.139544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:45.154987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d92c-78b1-4639-9fd4-dce39d15cb47 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:45.170439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:45.174457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:45.174758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:45.175036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/0eda7c07a8d2442893a7bea5c88eff81` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:45.176346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0eda7c07a8d2442893a7bea5c88eff81)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:45.178346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:45.274636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eda7c07a8d2442893a7bea5c88eff81', 'request_id': 'req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.292664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eda7c07a8d2442893a7bea5c88eff81', 'request_id': 'req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.296824 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:45.309542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eda7c07a8d2442893a7bea5c88eff81', 'request_id': 'req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.333963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] The token cache is being invalidate because project 0eda7c07a8d2442893a7bea5c88eff81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:45.334685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.337474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.341037 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3186/6351] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:45 2022] DELETE /identity/v3/projects/0eda7c07a8d2442893a7bea5c88eff81 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:45.346395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:45.349336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:45.376727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52535617-fdf1-4618-bf67-ba0e6e594b51 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:45.481063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:45.481758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:45.482038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:45.482309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/c00c71669b12416e9b8b79190d16cbae` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:45.483493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c00c71669b12416e9b8b79190d16cbae)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:45.490588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:45.579086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00c71669b12416e9b8b79190d16cbae', 'request_id': 'req-7911a9b5-ba1c-413b-9502-5d982d965184'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.591241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00c71669b12416e9b8b79190d16cbae', 'request_id': 'req-7911a9b5-ba1c-413b-9502-5d982d965184'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.599390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00c71669b12416e9b8b79190d16cbae', 'request_id': 'req-7911a9b5-ba1c-413b-9502-5d982d965184'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.622331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] The token cache is being invalidate because project c00c71669b12416e9b8b79190d16cbae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:45.622830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.624073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.629015 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3166/6352] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:45 2022] DELETE /identity/v3/projects/c00c71669b12416e9b8b79190d16cbae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:45.634068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:45.650633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400e1fa-8c3c-4e98-b391-75fa358a9fa0 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:45.786139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:45.786835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:45.787065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:45.787342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/roles/179bc0e7c7a04d9884d2a89fb658d902` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:45.799969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=179bc0e7c7a04d9884d2a89fb658d902)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:45.801740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:45.871360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invalidating the token cache because role 179bc0e7c7a04d9884d2a89fb658d902 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:45.871679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.872530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:45.874651 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3187/6353] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:45 2022] DELETE /identity/v3/roles/179bc0e7c7a04d9884d2a89fb658d902 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:45.878436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:45.880841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:45.903359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a9b5-ba1c-413b-9502-5d982d965184 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:45.918432 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:46.049878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:46.050744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:46.051675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:46.051966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/e652bf554a3f401aad8857ee49c40107` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:46.055986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e652bf554a3f401aad8857ee49c40107)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:46.057970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:46.170439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e652bf554a3f401aad8857ee49c40107'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.170439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e652bf554a3f401aad8857ee49c40107'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.178978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e652bf554a3f401aad8857ee49c40107'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.216692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e652bf554a3f401aad8857ee49c40107'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.217626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e652bf554a3f401aad8857ee49c40107'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.253809 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3167/6354] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:45 2022] DELETE /identity/v3/users/e652bf554a3f401aad8857ee49c40107 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:46.257602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:46.260015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:46.283045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33bea-4aae-49b0-8bb1-0351efd7d969 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:46.439986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:46.440665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:46.440948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:46.441224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/91103b63fb80475fa6d19b6f3c6b4348` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:46.449963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91103b63fb80475fa6d19b6f3c6b4348)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:46.452481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:46.546777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91103b63fb80475fa6d19b6f3c6b4348', 'request_id': 'req-9b54cec6-535a-4202-ba89-e8f679574967'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.554683 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:46.563334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91103b63fb80475fa6d19b6f3c6b4348', 'request_id': 'req-9b54cec6-535a-4202-ba89-e8f679574967'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.581005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91103b63fb80475fa6d19b6f3c6b4348', 'request_id': 'req-9b54cec6-535a-4202-ba89-e8f679574967'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.602486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] The token cache is being invalidate because project 91103b63fb80475fa6d19b6f3c6b4348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:46.602900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.608034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b54cec6-535a-4202-ba89-e8f679574967 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:46.614113 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3188/6355] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:46 2022] DELETE /identity/v3/projects/91103b63fb80475fa6d19b6f3c6b4348 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:46.615351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:46.617366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:46.643341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7318a-b7fd-42e6-934e-ce469e2e5873 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:46.904200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:46.904878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:46.905167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:46.905532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/2a30da1bb8fd493faaa1d37acdc75e46` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:46.909054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:update_user(user_id=2a30da1bb8fd493faaa1d37acdc75e46)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:46.910182 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:25:46.910182 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:25:46.910182 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:25:46.911448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.003676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.025077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invalidating the token cache because user 2a30da1bb8fd493faaa1d37acdc75e46 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:47.026033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.026346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.058828 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3168/6356] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:25:46 2022] PATCH /identity/v3/users/2a30da1bb8fd493faaa1d37acdc75e46 => generated 297 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:25:47.061491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.061964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.062054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.153488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] MFA Rules not processed for user `2a30da1bb8fd493faaa1d37acdc75e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:47.155208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.173091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.174360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3189/6357] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:25:47.175233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.195185 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:47.202396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea97b1-74b2-4b61-aa55-b66141b8f2c3 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:47.214078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:47.217047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.219579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.220252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/2a30da1bb8fd493faaa1d37acdc75e46` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.224219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:update_user(user_id=2a30da1bb8fd493faaa1d37acdc75e46)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:47.232411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.348783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.368073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invalidating the token cache because user 2a30da1bb8fd493faaa1d37acdc75e46 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:47.368797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.370448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.372872 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3169/6358] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:25:47 2022] PATCH /identity/v3/users/2a30da1bb8fd493faaa1d37acdc75e46 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:47.377041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.394482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa56ce-6a3d-4adf-9f02-facf9e4cebc6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:47.400770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:47.401514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.401808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.402144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/2a30da1bb8fd493faaa1d37acdc75e46` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.446545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:update_user(user_id=2a30da1bb8fd493faaa1d37acdc75e46)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:47.450440 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:25:47.450440 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:25:47.450440 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:25:47.452899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.458752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.460702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.527071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.541210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invalidating the token cache because user 2a30da1bb8fd493faaa1d37acdc75e46 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:47.541817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.542706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-993a12c6-bd78-4842-bad5-abdc5f736328 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.545703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3190/6359] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:25:47 2022] PATCH /identity/v3/users/2a30da1bb8fd493faaa1d37acdc75e46 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:47.551147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.552113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.553217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.628336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] MFA Rules not processed for user `2a30da1bb8fd493faaa1d37acdc75e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:47.629602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.637199 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3191/6360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:25:47.639995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.641621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.643857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dbc89-e9aa-47b1-b09d-310344c56e64 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:47.654425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:47.655172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.655535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.655884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] PATH_INFO: `/v3/users/d4b32b37164a44f3a6ab4f0b4335cfbb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.658772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236065-6ba8-41d1-8c0b-4ac85d4b0c52 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:47.659741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b32b37164a44f3a6ab4f0b4335cfbb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:47.661932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.664991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:47.665898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.666244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.666578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/2a30da1bb8fd493faaa1d37acdc75e46` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.667897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:update_user(user_id=2a30da1bb8fd493faaa1d37acdc75e46)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:47.670493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.731245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.748178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invalidating the token cache because user 2a30da1bb8fd493faaa1d37acdc75e46 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:47.748778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.749660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.752871 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3192/6361] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:25:47 2022] PATCH /identity/v3/users/2a30da1bb8fd493faaa1d37acdc75e46 => generated 297 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:47.757443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.760893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:47.778061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b32b37164a44f3a6ab4f0b4335cfbb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.779255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b32b37164a44f3a6ab4f0b4335cfbb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.793278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c920be-67fa-45e3-9c29-a4e81f92a590 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:47.798219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b32b37164a44f3a6ab4f0b4335cfbb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.807672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:47.810601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:47.811004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:47.811380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:47.813726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:47.818496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:47.830514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b32b37164a44f3a6ab4f0b4335cfbb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.831298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b32b37164a44f3a6ab4f0b4335cfbb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:47.869450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3170/6362] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:47 2022] DELETE /identity/v3/users/d4b32b37164a44f3a6ab4f0b4335cfbb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:47.883210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3193/6363] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 25 01:25:47 2022] POST /identity/v3/users => generated 265 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:47.887714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:47.891486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:48.018463 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:48.053237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc393582-4ac4-4724-8e59-52afc4c425b4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:48.070593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789ebc-17f8-48ff-95f9-d36bf58314a6 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:48.071660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789ebc-17f8-48ff-95f9-d36bf58314a6 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:48.071952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789ebc-17f8-48ff-95f9-d36bf58314a6 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:48.072230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789ebc-17f8-48ff-95f9-d36bf58314a6 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/a8a171b1394e4dbca5934fe54c867bf7/password` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:48.254549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-00789ebc-17f8-48ff-95f9-d36bf58314a6 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:48.270621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3171/6364] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 25 01:25:47 2022] POST /identity/v3/users/a8a171b1394e4dbca5934fe54c867bf7/password => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:48.977868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:48.981704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.025152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa2a-2f3c-43f2-a90d-ef695ea4dedd tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:49.209278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:49.210240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.212783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.213298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] PATH_INFO: `/v3/projects/10fa7c775d924acda02fb364a1818ba2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.214960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fa7c775d924acda02fb364a1818ba2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:49.223289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:49.257130 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:49.276922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.277479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.277479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.322483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] MFA Rules not processed for user `a8a171b1394e4dbca5934fe54c867bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:49.324174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.333887 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3172/6365] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:49 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:25:49.338491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:49.362093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fa7c775d924acda02fb364a1818ba2', 'request_id': 'req-0400b183-32b4-4a26-b395-64e32dd43292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.380056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fa7c775d924acda02fb364a1818ba2', 'request_id': 'req-0400b183-32b4-4a26-b395-64e32dd43292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.400213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fa7c775d924acda02fb364a1818ba2', 'request_id': 'req-0400b183-32b4-4a26-b395-64e32dd43292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.433521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] The token cache is being invalidate because project 10fa7c775d924acda02fb364a1818ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:49.436454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.437507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0400b183-32b4-4a26-b395-64e32dd43292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.441963 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3194/6366] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:48 2022] DELETE /identity/v3/projects/10fa7c775d924acda02fb364a1818ba2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:49.466583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d024c-2613-4023-b80f-c6c66062a913 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.466890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d024c-2613-4023-b80f-c6c66062a913 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.467154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d024c-2613-4023-b80f-c6c66062a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.504103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378cfb6-d7a6-47c4-97b3-71e3f8c17383 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:49.521645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:49.523120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.524445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.524895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.540503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.545098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-053d024c-2613-4023-b80f-c6c66062a913 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:49.546347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-053d024c-2613-4023-b80f-c6c66062a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.571428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:49.579740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:49.599849 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3173/6367] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 25 01:25:49 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:49.601086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:49.604904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.631941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa258a-f7ba-4fe2-a56b-7ed8162c6672 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:49.650785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:49.651412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.651701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.651982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/a8a171b1394e4dbca5934fe54c867bf7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.653149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a8a171b1394e4dbca5934fe54c867bf7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:49.656703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:49.673376 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3195/6368] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:49.683127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.683582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.683853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.733747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:49.735160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.761267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3196/6369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:49.767313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:49.780503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.782963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.795850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11733fda-8298-430a-8ee4-cc08e7596abc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:49.803348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.807708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:49.808340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:49.808617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:49.808889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:49.809575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:25:49.809876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:49.813356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:49.835717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.836752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a171b1394e4dbca5934fe54c867bf7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:49.843600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3197/6370] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:49.847542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:49.850938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.871005 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3174/6371] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:49 2022] DELETE /identity/v3/users/a8a171b1394e4dbca5934fe54c867bf7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:49.877866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:49.885874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:49.912429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20700-79d2-4e9b-9730-0c6dc72d7ded admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:49.937928 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:50.091431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.092376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.092659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.092936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.093606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.095632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.140282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df222-cde8-415f-9813-7bb373cf8b5f tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.162325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.163082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.163247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.163518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.164726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.173254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.217122 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3198/6372] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:49 2022] POST /identity/v3/projects => generated 391 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:50.218238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.247562 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:50.278481 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3175/6373] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:49 2022] POST /identity/v3/users => generated 364 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:50.282683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.314417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bfdb-cea9-4b9a-b287-65bfd4f8fd9b tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.403608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e75c7-1b49-4d6d-877e-c26eadc4afe7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.421735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.422548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.422694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.422919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.423572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.425576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.460608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.477513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.477513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.477513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.477513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.478226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3199/6374] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:25:50 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:50.478330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.478429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.491964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c923-05cf-4442-9fbe-a9719b336bb8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.509045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.509870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.510155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.510431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.511096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.512730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.549714 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3200/6375] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:50.550752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.590608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060e55-96bc-46ee-94e6-5d632482bd70 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.603907 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3176/6376] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:25:50 2022] POST /identity/v3/projects => generated 360 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:25:50.608194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.776436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ff73-07df-4ef0-a497-fa7aea46f82e tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.781558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.782195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.782473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.782747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.783397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.785731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.794638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.795307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.795587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.795860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/c3a3510203b648669155dfa99ad7eb6d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.848370 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3201/6377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:25:50.854285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:50.890248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea550-8c5d-47a5-bfe5-20e6e11e8faa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:50.894164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:update_user(user_id=c3a3510203b648669155dfa99ad7eb6d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.896380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.910118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:50.910890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:50.911331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:50.911722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] PATH_INFO: `/v3/projects/24b293fd2bf248f0a714067e48ea0792/users/88a281617be64d1b85a6b7d8a708876a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:50.952586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b293fd2bf248f0a714067e48ea0792, user_id=88a281617be64d1b85a6b7d8a708876a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:50.959886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f962bbd-892c-4abc-923b-170b81f7bf30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:50.981132 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:50.997825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3177/6378] 10.222.0.16 () {60 vars in 1244 bytes} [Sun Sep 25 01:25:50 2022] PATCH /identity/v3/users/c3a3510203b648669155dfa99ad7eb6d => generated 524 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:25:51.011935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:51.033876 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3202/6379] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:25:50 2022] PUT /identity/v3/projects/24b293fd2bf248f0a714067e48ea0792/users/88a281617be64d1b85a6b7d8a708876a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:51.037617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499faf1-5724-476c-8400-87268fe9924c tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:51.038917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b6b-eb4c-42eb-967d-12f0030c5742 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.039320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b6b-eb4c-42eb-967d-12f0030c5742 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.039595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b6b-eb4c-42eb-967d-12f0030c5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.065794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f1e77b6b-eb4c-42eb-967d-12f0030c5742 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:51.067347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f1e77b6b-eb4c-42eb-967d-12f0030c5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.163289 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:51.174731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:51.175538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.175928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.176331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/c3a3510203b648669155dfa99ad7eb6d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.179350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3203/6380] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:51.182123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.182416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.182694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.207515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] MFA Rules not processed for user `c1c655b1afc54b6c98d771d6acf81ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:51.209188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.218852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:get_user(user_id=c3a3510203b648669155dfa99ad7eb6d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:51.221263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:51.227874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3178/6381] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:25:51 2022] GET /identity/v3/users/c3a3510203b648669155dfa99ad7eb6d => generated 390 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:25:51.229278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:51.239040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.311296 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3204/6382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:51.312297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:51.330030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027532-9ba7-4d5f-ad46-80142d574bbe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:51.335758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:51.337040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.338351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.338702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/projects/0a83abf91bd64ca4b08c54968ea95706` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.341050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a83abf91bd64ca4b08c54968ea95706)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:51.343786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:51.440549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9758d5-a338-40fb-a579-ff3cd2f739ed tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:51.482643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a83abf91bd64ca4b08c54968ea95706', 'request_id': 'req-2c7588aa-6e70-4794-8617-636f111278a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.491413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a83abf91bd64ca4b08c54968ea95706', 'request_id': 'req-2c7588aa-6e70-4794-8617-636f111278a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.499326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a83abf91bd64ca4b08c54968ea95706', 'request_id': 'req-2c7588aa-6e70-4794-8617-636f111278a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.517886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] The token cache is being invalidate because project 0a83abf91bd64ca4b08c54968ea95706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:51.518473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.520076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.524611 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3205/6383] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:51 2022] DELETE /identity/v3/projects/0a83abf91bd64ca4b08c54968ea95706 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:51.529047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:51.531269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.563105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:51.563814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.564101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.564390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.572488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.671361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7588aa-6e70-4794-8617-636f111278a4 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:51.690482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f3f33cd6a146fcbb959daeaea0111a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306821a7620446628d9a4114fa6024ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:51.691265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:51.693675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:51.694121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] PATH_INFO: `/v3/users/c3a3510203b648669155dfa99ad7eb6d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:51.695727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3a3510203b648669155dfa99ad7eb6d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:51.701158 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:51.705829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:51.709628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:51.723537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:51.746443 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:51.756680 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3179/6384] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:51.779348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a3510203b648669155dfa99ad7eb6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.793320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a3510203b648669155dfa99ad7eb6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.809116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a3510203b648669155dfa99ad7eb6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.809902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a3510203b648669155dfa99ad7eb6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.810542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ce36252d-2d50-4ae4-9019-59caa6056341 tempest-UsersV3TestJSON-174335649 tempest-UsersV3TestJSON-174335649-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a3510203b648669155dfa99ad7eb6d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:51.834499 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3206/6385] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:51 2022] DELETE /identity/v3/users/c3a3510203b648669155dfa99ad7eb6d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:25:51.836493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:51.841476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:51.873093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a5d0-77e9-4bf3-a011-94cc25d7d1d1 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:52.011714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:52.012506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:52.012904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:52.013274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] PATH_INFO: `/v3/users/2a30da1bb8fd493faaa1d37acdc75e46` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:52.045947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a30da1bb8fd493faaa1d37acdc75e46)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:52.048007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:52.136388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:52.137627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:52.167837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:52.202710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:52.206771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a30da1bb8fd493faaa1d37acdc75e46'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:52.237085 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3180/6386] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:51 2022] DELETE /identity/v3/users/2a30da1bb8fd493faaa1d37acdc75e46 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:52.242674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bad24-82ef-475f-af50-6828c482947c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:52.243756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bad24-82ef-475f-af50-6828c482947c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:52.244301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bad24-82ef-475f-af50-6828c482947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:52.280959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-960bad24-82ef-475f-af50-6828c482947c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:52.283414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-960bad24-82ef-475f-af50-6828c482947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:52.439428 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3207/6387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:25:52.574086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:52.576466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:52.755826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b2cb-63f7-4842-abd4-5ce600eb8c72 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:52.765289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:52.766636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:52.766919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:52.767256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:52.799123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:52.801227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:52.847049 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3181/6388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:25:54.745469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bad24-82ef-475f-af50-6828c482947c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:54.747084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-960bad24-82ef-475f-af50-6828c482947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:54.772437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bad24-82ef-475f-af50-6828c482947c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:54.788441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:54.790091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:54.790475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:54.790767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] PATH_INFO: `/v3/projects/83c71b46ebf342a58f2cab99d49bec75` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:54.793155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c71b46ebf342a58f2cab99d49bec75)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:54.795108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:54.934604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c71b46ebf342a58f2cab99d49bec75', 'request_id': 'req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:54.943492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c71b46ebf342a58f2cab99d49bec75', 'request_id': 'req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:54.950319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c71b46ebf342a58f2cab99d49bec75', 'request_id': 'req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:54.989635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] The token cache is being invalidate because project 83c71b46ebf342a58f2cab99d49bec75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:54.990488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:54.991681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:54.994447 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3208/6389] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:54 2022] DELETE /identity/v3/projects/83c71b46ebf342a58f2cab99d49bec75 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:54.998235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:55.004533 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:55.013931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28c13-f00c-436d-a482-22dbd7a2ca88 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:55.183098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:55.183771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:55.184059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:55.184337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] PATH_INFO: `/v3/users/38f3f33cd6a146fcbb959daeaea0111a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:55.189656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f3f33cd6a146fcbb959daeaea0111a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:55.193267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:55.332115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f3f33cd6a146fcbb959daeaea0111a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:55.333361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f3f33cd6a146fcbb959daeaea0111a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:55.344061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f3f33cd6a146fcbb959daeaea0111a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:55.378064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f3f33cd6a146fcbb959daeaea0111a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:55.378639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ad78e2bf-38ea-4108-b41d-91d5f52f9aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f3f33cd6a146fcbb959daeaea0111a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:55.410887 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3182/6390] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:25:54 2022] DELETE /identity/v3/users/38f3f33cd6a146fcbb959daeaea0111a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:59.329632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:25:59.331701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:25:59.361818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33aa27-27d0-4e58-99c7-fa36ce0c9caf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:25:59.426469 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:59.653161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:25:59.653853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:59.654133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:59.654408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] PATH_INFO: `/v3/projects/306821a7620446628d9a4114fa6024ab` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:59.655545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306821a7620446628d9a4114fa6024ab)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:25:59.657603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:25:59.769541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306821a7620446628d9a4114fa6024ab', 'request_id': 'req-bd91f43a-a744-46ed-be5b-ab9533ce9311'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:59.785215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306821a7620446628d9a4114fa6024ab', 'request_id': 'req-bd91f43a-a744-46ed-be5b-ab9533ce9311'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:59.813207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306821a7620446628d9a4114fa6024ab', 'request_id': 'req-bd91f43a-a744-46ed-be5b-ab9533ce9311'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:59.837228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] The token cache is being invalidate because project 306821a7620446628d9a4114fa6024ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:25:59.837922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:59.840671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd91f43a-a744-46ed-be5b-ab9533ce9311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:25:59.847633 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3209/6391] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:25:59 2022] DELETE /identity/v3/projects/306821a7620446628d9a4114fa6024ab => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:25:59.848414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:25:59.848938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:25:59.849047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:25:59.879368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:25:59.882952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:00.018661 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3183/6392] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:00.029953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.030316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.030594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.086013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:00.090136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:00.114667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3210/6393] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:00.120198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.136304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2323d-1fd1-462d-b627-b3ae851c2255 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.156388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.157029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.157952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.158243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.158906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:00.159579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.160848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.194535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3184/6394] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:00.195026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.210392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f40c0-3407-4a09-a2de-7e5e4b4a82b3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.224451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.225247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.225501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.225878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.226712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.232671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.306670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3211/6395] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:00 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:00.307881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.329560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3020cfb-8336-47f5-b4b4-f89821b1f2a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.349534 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:00.451982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.452923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.453424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.454568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.455410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.457736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.489568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3185/6396] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:00 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:00.494474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.506062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e673b-4d05-47a7-8d43-3edb9a36b4b3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.522141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.523076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.523366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.524305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.524679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.526541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.539830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3212/6397] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:00.542893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.554981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c322-fdbc-42db-b598-62dbc9eb2b79 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.561186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.561942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.562287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.562661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.563385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.565429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ecee0-8354-4581-b346-b163289fa2f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.582714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3186/6398] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:00.583228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:00.594417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe83d5-9c45-4016-b62a-f517e987fe3c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:00.600575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:00.601906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.602368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.602850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] PATH_INFO: `/v3/projects/8b895952844a4d3b94afab90920ea6e9/users/29b5b56446fd4f0fa100191f2c25bb9d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.622669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b895952844a4d3b94afab90920ea6e9, user_id=29b5b56446fd4f0fa100191f2c25bb9d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:00.625379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:00.685574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3213/6399] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:00 2022] PUT /identity/v3/projects/8b895952844a4d3b94afab90920ea6e9/users/29b5b56446fd4f0fa100191f2c25bb9d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:00.699402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:00.699687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:00.700012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:00.769898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] MFA Rules not processed for user `29b5b56446fd4f0fa100191f2c25bb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:00.771929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:00.965857 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3187/6400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:00.970308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.073119 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:01.079067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9834-abb1-4cd2-b3f1-2775aacf4b87 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.087177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.088192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.088692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.089192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.089977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.094614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.139332 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3214/6401] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:00 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:01.143205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.162788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294af143-bc19-4587-b0ec-9dd08c85f1df None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.250725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.251350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.251628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.251897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.252540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.255033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.298187 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3188/6402] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:01 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:01.302015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.322777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce158e-cfcd-490e-959f-a3f0a410907b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.337097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.337768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.338046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.338320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.338978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.345028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.371631 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3215/6403] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:01.376121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.390716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cfcf-bfed-41b3-bd70-84e3027a2f2d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.406268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.407328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.407831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.408341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] PATH_INFO: `/v3/projects/f0e30e958e564ddfa55c67211ee9dc29/users/369358fed65f490992c347902d05ac69/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.419768 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:01.448380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e30e958e564ddfa55c67211ee9dc29, user_id=369358fed65f490992c347902d05ac69, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.461491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.522039 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3189/6404] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:01 2022] PUT /identity/v3/projects/f0e30e958e564ddfa55c67211ee9dc29/users/369358fed65f490992c347902d05ac69/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:01.527764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.540986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd18-8849-4d99-a0d3-477b33f679c9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.767321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.768331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.768863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.769317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.787076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.791191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e871e4b-c4db-4bd5-aa67-f2f435e52f86 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.827508 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3216/6405] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:01.831736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:01.850682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455e19-3663-4970-bec9-c3ee314bf384 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:01.866055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:01.867545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.867715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.867915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] PATH_INFO: `/v3/projects/f0e30e958e564ddfa55c67211ee9dc29/users/369358fed65f490992c347902d05ac69/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.870098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e30e958e564ddfa55c67211ee9dc29, user_id=369358fed65f490992c347902d05ac69, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:01.872959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:01.899155 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3190/6406] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:01 2022] PUT /identity/v3/projects/f0e30e958e564ddfa55c67211ee9dc29/users/369358fed65f490992c347902d05ac69/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:01.910989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:01.911279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:01.911537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:01.994458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] MFA Rules not processed for user `369358fed65f490992c347902d05ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:01.995851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:02.174811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3217/6407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:02.180020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:02.196520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d3f-4527-4d13-8112-4700d998a0cd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:02.211411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:02.212190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.212660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.212906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.217844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:02.220517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:02.288949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:02.301051 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3191/6408] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:02 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:02.303751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b881c9-d3ac-4430-9227-0049b3972de5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:02.434085 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:02.451466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:02.452555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.453120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.453701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.455475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:02.458728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:02.503904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3218/6409] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:02 2022] POST /identity/v3/users => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:02.508521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:02.526596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466c674-4b66-4409-882a-e0063c49e8d0 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:02.539244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:02.539884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.540171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.540448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.541287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:02.541512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:02.543588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64690d-664b-48aa-92e6-0bf5f60c3491 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:02.608701 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3192/6410] 10.222.0.16 () {58 vars in 1157 bytes} [Sun Sep 25 01:26:02 2022] GET /identity/v3/users?domain_id=default => generated 8019 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:02.613447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:02.634397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f44c3-ea9f-4808-8875-1025cded82aa tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:02.648856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:02.649849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.650520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.651295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/users/458d189553ae497ab9d11e7e20c74183` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.683706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:update_user(user_id=458d189553ae497ab9d11e7e20c74183)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:02.686235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:02.760887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:02.775610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invalidating the token cache because user 458d189553ae497ab9d11e7e20c74183 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:02.776296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:02.777321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:02.779929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3219/6411] 10.222.0.16 () {60 vars in 1244 bytes} [Sun Sep 25 01:26:02 2022] PATCH /identity/v3/users/458d189553ae497ab9d11e7e20c74183 => generated 485 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:02.785000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.785639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.786094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.817429 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.auth.plugins.core [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] User is disabled: 458d189553ae497ab9d11e7e20c74183: AssertionError: User is disabled: 458d189553ae497ab9d11e7e20c74183 Sep 25 01:26:02.829620 n-d-master-1 devstack@keystone.service[81862]: WARNING keystone.server.flask.application [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 25 01:26:02.831475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3193/6412] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:02 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 48 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 25 01:26:02.835914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:02.838117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:02.865805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c70d8-c0f2-4589-844d-5ea9799d0da8 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:02.874668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:02.876161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:02.876754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:02.879338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/users/458d189553ae497ab9d11e7e20c74183` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:02.917259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:delete_user(user_id=458d189553ae497ab9d11e7e20c74183)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:02.919415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:03.069797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.083156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.118392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.119452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.120209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458d189553ae497ab9d11e7e20c74183'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.169534 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3220/6413] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:02 2022] DELETE /identity/v3/users/458d189553ae497ab9d11e7e20c74183 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:03.173088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:03.175886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:03.271531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a603bf-352c-4f8b-a0b7-51b26d91812c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:03.278283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:03.278600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:03.278823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:03.279097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/projects/f2ca799c3a2146abbb565c337e43d13f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:03.280261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2ca799c3a2146abbb565c337e43d13f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:03.282765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:03.360531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ca799c3a2146abbb565c337e43d13f', 'request_id': 'req-426b4c31-2120-4cb9-9660-5c57a896ae1c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.368696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ca799c3a2146abbb565c337e43d13f', 'request_id': 'req-426b4c31-2120-4cb9-9660-5c57a896ae1c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.380139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ca799c3a2146abbb565c337e43d13f', 'request_id': 'req-426b4c31-2120-4cb9-9660-5c57a896ae1c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.417469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] The token cache is being invalidate because project f2ca799c3a2146abbb565c337e43d13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:03.417469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.417469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.418835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3194/6414] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:03 2022] DELETE /identity/v3/projects/f2ca799c3a2146abbb565c337e43d13f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:03.424098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:03.442560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45ea3-e748-4f93-82da-02f12b1e5336 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:03.614222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369358fed65f490992c347902d05ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0e30e958e564ddfa55c67211ee9dc29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:03.614883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:03.615231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:03.615666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:03.616491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:03.620328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:03.635120 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ba4e7940-906d-44c2-a158-369bef3591f1 tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Could not find domain: 08c400dad59345a09a65f02d8b512b88.: keystone.exception.DomainNotFound: Could not find domain: 08c400dad59345a09a65f02d8b512b88. Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08c400dad59345a09a65f02d8b512b88. Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:26:03.660715 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 25 01:26:03.662295 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:26:03.663776 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:26:03.669234 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 25 01:26:03.669234 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 25 01:26:03.669234 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08c400dad59345a09a65f02d8b512b88. Sep 25 01:26:03.669234 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:26:03.669234 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3221/6415] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:03 2022] POST /identity/v3/users => generated 112 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:26:03.670067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:03.671735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:03.711165 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:03.773113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c31-2120-4cb9-9660-5c57a896ae1c tempest-UsersNegativeTest-1813791195 tempest-UsersNegativeTest-1813791195-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:03.778603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:03.779269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:03.779547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:03.780615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] PATH_INFO: `/v3/users/29b5b56446fd4f0fa100191f2c25bb9d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:03.781612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b5b56446fd4f0fa100191f2c25bb9d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:03.783680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:03.858940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b5b56446fd4f0fa100191f2c25bb9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.859627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b5b56446fd4f0fa100191f2c25bb9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.870663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b5b56446fd4f0fa100191f2c25bb9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.889370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b5b56446fd4f0fa100191f2c25bb9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.890394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b5b56446fd4f0fa100191f2c25bb9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:03.908500 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3195/6416] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:03 2022] DELETE /identity/v3/users/29b5b56446fd4f0fa100191f2c25bb9d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:03.915733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:03.917855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:03.918372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:03.951985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:03.953767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:04.043058 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3222/6417] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:04.164727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:04.166995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:04.302342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324081-0486-4e2a-8bdf-0707424bfaa4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:04.314848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:04.315478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:04.315764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:04.316020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:04.349435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:04.349435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:04.394201 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3196/6418] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:05.914378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:05.916109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:05.939512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6d33-af8d-48aa-a8d4-4460a132b145 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:05.951039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:05.951962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:05.952223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:05.952602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] PATH_INFO: `/v3/projects/8b895952844a4d3b94afab90920ea6e9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:05.958064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b895952844a4d3b94afab90920ea6e9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:05.960419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:06.058830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b895952844a4d3b94afab90920ea6e9', 'request_id': 'req-4b023111-9d1c-4c02-bb2f-2673a09e53aa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.073304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b895952844a4d3b94afab90920ea6e9', 'request_id': 'req-4b023111-9d1c-4c02-bb2f-2673a09e53aa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.086169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b895952844a4d3b94afab90920ea6e9', 'request_id': 'req-4b023111-9d1c-4c02-bb2f-2673a09e53aa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.107000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] The token cache is being invalidate because project 8b895952844a4d3b94afab90920ea6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:06.107503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.114052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.118363 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3223/6419] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:05 2022] DELETE /identity/v3/projects/8b895952844a4d3b94afab90920ea6e9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:06.122207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:06.135998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62ea5-6d6a-4542-a2db-1e2e3301d050 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:06.248279 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:06.310294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:06.311014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:06.311302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:06.311583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] PATH_INFO: `/v3/users/369358fed65f490992c347902d05ac69` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:06.312866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=369358fed65f490992c347902d05ac69)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:06.314885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:06.500247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369358fed65f490992c347902d05ac69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.501149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369358fed65f490992c347902d05ac69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.522639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369358fed65f490992c347902d05ac69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.548122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369358fed65f490992c347902d05ac69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.549150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369358fed65f490992c347902d05ac69'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:06.579671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3197/6420] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:06 2022] DELETE /identity/v3/users/369358fed65f490992c347902d05ac69 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:07.860863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:07.864947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:07.888993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:07.890462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:07.912608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023111-9d1c-4c02-bb2f-2673a09e53aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:08.113319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:08.114021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.114308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.114596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] PATH_INFO: `/v3/projects/f0e30e958e564ddfa55c67211ee9dc29` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.124739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e30e958e564ddfa55c67211ee9dc29)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:08.137029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:08.170626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9354b76-8b4c-4e7e-9d7b-4ca8774ac76d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:08.176491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:08.177201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.177881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.177881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] PATH_INFO: `/v3/users/a448e3982db840189af1a6af4464dbe4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.179119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a448e3982db840189af1a6af4464dbe4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:08.181838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:08.261808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a448e3982db840189af1a6af4464dbe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.263528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a448e3982db840189af1a6af4464dbe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.269156 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:08.287856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a448e3982db840189af1a6af4464dbe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.300211 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:08.316064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a448e3982db840189af1a6af4464dbe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.317035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-708dc1e1-69b6-40a2-b4d6-60df785848a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a448e3982db840189af1a6af4464dbe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.335137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e30e958e564ddfa55c67211ee9dc29', 'request_id': 'req-824d010c-c9ce-49b2-bd1a-db66f8d574be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.349501 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3198/6421] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:07 2022] DELETE /identity/v3/users/a448e3982db840189af1a6af4464dbe4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:08.350462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e30e958e564ddfa55c67211ee9dc29', 'request_id': 'req-824d010c-c9ce-49b2-bd1a-db66f8d574be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.354790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.355222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.355604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.358604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e30e958e564ddfa55c67211ee9dc29', 'request_id': 'req-824d010c-c9ce-49b2-bd1a-db66f8d574be'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.386639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] The token cache is being invalidate because project f0e30e958e564ddfa55c67211ee9dc29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:08.387244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.388190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-824d010c-c9ce-49b2-bd1a-db66f8d574be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:08.391536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3224/6422] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:07 2022] DELETE /identity/v3/projects/f0e30e958e564ddfa55c67211ee9dc29 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:08.396765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d8ed0-e6c0-4f17-b104-6930d52483ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.397304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d8ed0-e6c0-4f17-b104-6930d52483ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.398128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d8ed0-e6c0-4f17-b104-6930d52483ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.404584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:08.405981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:08.446775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f16d8ed0-e6c0-4f17-b104-6930d52483ce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:08.447950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f16d8ed0-e6c0-4f17-b104-6930d52483ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:08.561586 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3199/6423] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:08.639851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:08.641988 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3225/6424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:08.642241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:08.650860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.651200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.651402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.702247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:08.703413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:08.733145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3226/6425] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:08.740341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:08.757885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118fcc1-9283-4566-8b96-23638dfe6e6a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:08.764793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:08.765672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.766143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.766592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.767438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:08.767920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:08.770421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:08.778833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3ab67-b7a0-4d04-9c51-0538c431f32f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:08.793644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:08.797804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.798223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.798609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.814018 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3227/6426] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:08.815492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:08.823187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:08.824818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:08.827546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa1c01-f0d8-478f-a99b-48aa5d0c4c27 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:08.833597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:08.834652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:08.836090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:08.836584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:08.837544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:08.839777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:08.847934 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3200/6427] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:26:08.900529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3228/6428] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:08 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:08.905553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:08.922551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec96a4-a227-4079-97f5-09e76f962c53 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.060346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.061282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.061768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.062227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.063053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.065795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.104301 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3201/6429] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:08 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:09.108290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.143074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bd191-2ca1-4b78-8c64-a1498d98261f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.174407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.175613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.176229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.176667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.177822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.182239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.220276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3229/6430] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:26:09.227262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.244051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ac0b-e78b-4a37-bb0f-4e5ebf6283b7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.267822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.268471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.268754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.269031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.269725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.271344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501e2bd-10e3-4f0a-a2d7-eccd08243675 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.291462 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3202/6431] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:09.295551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.309383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44859a0-2c3b-4322-8c3c-3cbc933f52e1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.314832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.315791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.316142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.316507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] PATH_INFO: `/v3/projects/c33910b53a614566bd9e0f6807e926d7/users/77779a448c694c25b9db5519526be896/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.334393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33910b53a614566bd9e0f6807e926d7, user_id=77779a448c694c25b9db5519526be896, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.338188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.362653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3230/6432] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:09 2022] PUT /identity/v3/projects/c33910b53a614566bd9e0f6807e926d7/users/77779a448c694c25b9db5519526be896/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:09.373893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513e3a-0892-4702-b762-9477aed9431b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.374184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513e3a-0892-4702-b762-9477aed9431b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.374471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513e3a-0892-4702-b762-9477aed9431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.392828 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:09.432020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-86513e3a-0892-4702-b762-9477aed9431b None None] MFA Rules not processed for user `77779a448c694c25b9db5519526be896`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:09.433585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86513e3a-0892-4702-b762-9477aed9431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:09.443243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.555571 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3203/6433] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:09.556580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513e3a-0892-4702-b762-9477aed9431b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.560068 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:09.579025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513e3a-0892-4702-b762-9477aed9431b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.596673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77779a448c694c25b9db5519526be896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c33910b53a614566bd9e0f6807e926d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.599666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.599983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.600260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.603914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.605273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.610873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42d14-f9bc-4508-aa97-fee3352ad187 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.623039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.623801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.624191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.624593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.635104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3204/6434] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:26:09 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:09.635940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:09.647563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:09.673044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.675508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259610e-17e6-4843-84bc-2767fa913948 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.712817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3231/6435] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:09.802383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dce48-9698-4aec-90c0-cc642d7bab70 tempest-IdentityCatalogTest-29100916 tempest-IdentityCatalogTest-29100916-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:09.820093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:09.821834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:09.822612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:09.823301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] PATH_INFO: `/v3/users/77779a448c694c25b9db5519526be896` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:09.824743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77779a448c694c25b9db5519526be896)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:09.826950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:09.947315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77779a448c694c25b9db5519526be896'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:09.949463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77779a448c694c25b9db5519526be896'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:09.975721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77779a448c694c25b9db5519526be896'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.004083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77779a448c694c25b9db5519526be896'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.006697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77779a448c694c25b9db5519526be896'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.031741 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3205/6436] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:09 2022] DELETE /identity/v3/users/77779a448c694c25b9db5519526be896 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:10.036998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.037558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.037723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.080703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:10.088547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:10.211658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3232/6437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:10.268474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:10.270175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:10.298397 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:10.346689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:10.348592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:10.370744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2eb4-4d95-4dc3-82b8-0cb399053465 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:10.384080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:10.384080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.384744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.384878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] PATH_INFO: `/v3/projects/ab8c2da638164e929e966afb207f226a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.386285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8c2da638164e929e966afb207f226a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:10.388337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:10.404945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2baee-46da-4a6c-8144-367765cab882 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:10.418159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:10.421370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.421890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.424202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.460107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:10.464570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bf591-8db8-4ecb-a9b6-bd3dd0c79330 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:10.481173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8c2da638164e929e966afb207f226a', 'request_id': 'req-944c2b3c-5656-46e9-8652-3972ed977e9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.492812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3206/6438] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:10.497281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8c2da638164e929e966afb207f226a', 'request_id': 'req-944c2b3c-5656-46e9-8652-3972ed977e9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.512608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8c2da638164e929e966afb207f226a', 'request_id': 'req-944c2b3c-5656-46e9-8652-3972ed977e9b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.547351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] The token cache is being invalidate because project ab8c2da638164e929e966afb207f226a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:10.548076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.550660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-944c2b3c-5656-46e9-8652-3972ed977e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:10.553845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3233/6439] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:10 2022] DELETE /identity/v3/projects/ab8c2da638164e929e966afb207f226a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:10.559005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.559305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.559586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.605305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:10.608829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:10.738794 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3207/6440] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:10.746220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.747510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.747943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.770780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:10.772017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:10.784389 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3234/6441] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:10.785604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:10.814348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227efc9-10b2-48f1-a20e-0e097a08a0aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:10.829260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:10.830243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.830692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.831137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.831964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:10.832453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:10.834780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:10.864640 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3208/6442] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:26:10.865881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:10.880152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c274e-0659-49ae-889a-35e55ab8488b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:10.885592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:10.886309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:10.886672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:10.887022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:10.887722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:10.889774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:10.935122 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3235/6443] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:10 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:26:10.935835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:10.951111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547650-fee7-47ea-bb6b-d929dcf7f185 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:11.055590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:11.056209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.056486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.056758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.057423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:11.059980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:11.107375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3209/6444] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:10 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:26:11.108609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:11.131734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eaabc-8925-49e4-93d8-84d3bacab942 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:11.156488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:11.157929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.158998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.159469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.160305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:11.162145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:11.178639 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3236/6445] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:11.182757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:11.201079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad628ac9-8d68-4a7c-a1bf-b51856d8e758 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:11.211815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:11.213042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.213548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.213985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.214802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:11.218103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a86b8-d09c-4c4b-8c76-e2e957325742 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:11.236667 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3210/6446] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:26:11.239366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:11.268706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74199-67d1-4fa8-940b-bb2bd9d11931 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:11.281093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:11.281724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.282008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.282282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] PATH_INFO: `/v3/projects/157891898c1d4b6ea0d7dbb11950ea0b/users/87ebff0be86d4a26a45c383cc5fc8f08/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.377584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157891898c1d4b6ea0d7dbb11950ea0b, user_id=87ebff0be86d4a26a45c383cc5fc8f08, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:11.380314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:11.407274 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:11.417253 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3237/6447] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:11 2022] PUT /identity/v3/projects/157891898c1d4b6ea0d7dbb11950ea0b/users/87ebff0be86d4a26a45c383cc5fc8f08/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:11.519342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.519753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.520150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.568090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] MFA Rules not processed for user `87ebff0be86d4a26a45c383cc5fc8f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:11.569393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:11.576510 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:11.694331 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3211/6448] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:11.717482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:11.719894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:11.814041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0935-618a-4f1e-b341-13fe6c0e7bc9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:11.819169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:11.820144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:11.820615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:11.821050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:11.835121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:11.836958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aa7a5-eed7-4169-9b13-9454b61e0cad service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:11.854709 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3238/6449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:12.141632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.143210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:12.216403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edeff-14a9-4264-81b6-cd181a1bc18c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.221622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.222266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.222546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.222819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] PATH_INFO: `/v3/projects/c33910b53a614566bd9e0f6807e926d7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.224235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33910b53a614566bd9e0f6807e926d7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.226971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.297510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33910b53a614566bd9e0f6807e926d7', 'request_id': 'req-2c818205-a903-4186-8c61-487ff513c8ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:12.307038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33910b53a614566bd9e0f6807e926d7', 'request_id': 'req-2c818205-a903-4186-8c61-487ff513c8ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:12.314097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33910b53a614566bd9e0f6807e926d7', 'request_id': 'req-2c818205-a903-4186-8c61-487ff513c8ce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:12.333302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] The token cache is being invalidate because project c33910b53a614566bd9e0f6807e926d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:12.333655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:12.334662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c818205-a903-4186-8c61-487ff513c8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:12.341313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3212/6450] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:12 2022] DELETE /identity/v3/projects/c33910b53a614566bd9e0f6807e926d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:12.343513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.344079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.344214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.381883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:12.383976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:12.504033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3239/6451] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:12.512522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.512811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.513090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.546930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:12.548827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:12.558722 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3213/6452] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:12.563964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.576837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49499-bb27-4e3c-a564-ad3ef337795e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.581859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.582538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.582960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.583243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.584007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:12.584314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.586215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.605423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3240/6453] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:12.609563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.620511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d15a11-0165-428b-885b-be54a1634bc8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.626270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.626883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.627160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.627427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.628055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.630316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.663939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3214/6454] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:12 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:12.669759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.682118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba83d9-9ec7-422a-8db0-425954bc9eb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.795877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.796905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.797572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.798022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.798845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.802520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.843920 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3241/6455] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:12 2022] POST /identity/v3/users => generated 280 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:12.848032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.870641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205c55-50f8-4842-aca6-5b323c26c1c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.880027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.881082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.881703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.882241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.883583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.885453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.888382 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:12.900344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3215/6456] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:26:12.904375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.918838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc776af2-69d7-4cc2-ae21-929be6dac870 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.925787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.927464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.928389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.928847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.929873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:12.931719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a6f8-2ba2-4a64-8e7c-a1699cc0a94d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:12.948375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3242/6457] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:12.953067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:12.968287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c039-5493-4c46-a431-5353376b869b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:12.973250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:12.974326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:12.974785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:12.975248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] PATH_INFO: `/v3/projects/f049daf99cb841f5bc65fa240429286c/users/06b9edac381d4d91b23a890a13667b2c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:12.997226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f049daf99cb841f5bc65fa240429286c, user_id=06b9edac381d4d91b23a890a13667b2c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.000715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e0de-64db-47c4-82fe-d4472086f6ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.028578 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3216/6458] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:12 2022] PUT /identity/v3/projects/f049daf99cb841f5bc65fa240429286c/users/06b9edac381d4d91b23a890a13667b2c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:13.039639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372017e-8d1a-414b-8601-494f77760a22 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.040322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372017e-8d1a-414b-8601-494f77760a22 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.040780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372017e-8d1a-414b-8601-494f77760a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.074734 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:13.093731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3372017e-8d1a-414b-8601-494f77760a22 None None] MFA Rules not processed for user `06b9edac381d4d91b23a890a13667b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:13.094952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3372017e-8d1a-414b-8601-494f77760a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.218995 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3243/6459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:13.223937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.224491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.224491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.256143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] MFA Rules not processed for user `06b9edac381d4d91b23a890a13667b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:13.257465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.272307 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3217/6460] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:13 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:26:13.275193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.275894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.278563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.344875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] MFA Rules not processed for user `06b9edac381d4d91b23a890a13667b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:13.347928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.354400 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3244/6461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:13 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 25 01:26:13.358722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.371250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a500bb-69d9-4d17-a2ab-21a123eecfa0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.386325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.387749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.388258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.388746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.405680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorizing `identity:check_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.409616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.426469 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3218/6462] 10.222.0.16 () {56 vars in 1264 bytes} [Sun Sep 25 01:26:13 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Sep 25 01:26:13.430638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.442686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e063f-46c7-488b-aaf8-f44d42ca7188 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.450961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.451791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.452590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.452590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.465229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.467331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.476240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.480581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.485893 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3245/6463] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 25 01:26:13 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:13.486967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.513025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836d6e0-ce16-4acd-bd24-bbbf3971bcb8 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.528229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.528777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.529166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.529903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.543098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.544910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.584985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3246/6464] 10.222.0.16 () {56 vars in 1266 bytes} [Sun Sep 25 01:26:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:13.586809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.609894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61fc56-c5ab-43b1-bc48-993f79785920 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.622912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.623729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `HEAD` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.624126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.624513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.626554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-96e978df-fc93-47b6-811e-97d3228e707f tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Sep 25 01:26:13.661840 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 25 01:26:13.663336 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:26:13.664808 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:26:13.669329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d273f-d78a-4e46-a4e1-f07bd367d168 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.669541 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3247/6465] 10.222.0.16 () {56 vars in 1264 bytes} [Sun Sep 25 01:26:13 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Sep 25 01:26:13.671080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.671373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.671647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.682541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.683662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.684169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.684654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.690627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.699751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] MFA Rules not processed for user `06b9edac381d4d91b23a890a13667b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:13.701032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.708710 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3248/6466] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:13 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 25 01:26:13.709892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.724294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f414-a81a-4e16-9ba6-5f909760a90f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.725891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.728088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.737621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.738263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.738797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.739248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.750239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.752054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.759459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3219/6467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:13.770452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3249/6468] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 25 01:26:13 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:13.775940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.794654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fd19-1d46-4464-b987-fef4fbfaf2b3 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.812070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.813043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.813520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.813960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.830090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:13.832000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:13.854568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3220/6469] 10.222.0.16 () {56 vars in 1266 bytes} [Sun Sep 25 01:26:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:13.863017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:13.909175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ef5e-f904-421f-9374-87a73da96629 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:13.925998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b9edac381d4d91b23a890a13667b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f049daf99cb841f5bc65fa240429286c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:13.933173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:13.935967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:13.936350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:13.942005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6a98d32f-7f78-42b4-8c66-1229b9e4e743 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 25 01:26:13.973684 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 25 01:26:13.975104 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 25 01:26:13.976932 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:26:13.978245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3250/6470] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 25 01:26:13 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 25 01:26:13.982875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:14.075347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe6e1-bc87-4f7c-8603-108719d29b22 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:14.075660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe6e1-bc87-4f7c-8603-108719d29b22 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:14.075968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe6e1-bc87-4f7c-8603-108719d29b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:14.159467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85284a-7b8c-4dd0-a4b5-2927abb312b7 tempest-TokensV3Test-857412489 tempest-TokensV3Test-857412489-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:14.161047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf7fe6e1-bc87-4f7c-8603-108719d29b22 None None] MFA Rules not processed for user `88a281617be64d1b85a6b7d8a708876a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:14.162317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf7fe6e1-bc87-4f7c-8603-108719d29b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:14.174467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:14.175374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:14.175878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:14.176156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] PATH_INFO: `/v3/users/06b9edac381d4d91b23a890a13667b2c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:14.178150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b9edac381d4d91b23a890a13667b2c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:14.182782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:14.247920 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:14.301962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b9edac381d4d91b23a890a13667b2c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:14.302660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b9edac381d4d91b23a890a13667b2c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:14.323419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b9edac381d4d91b23a890a13667b2c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:14.359215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b9edac381d4d91b23a890a13667b2c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:14.359975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a27caf26-679f-40dd-8986-569f73308b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b9edac381d4d91b23a890a13667b2c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:14.369007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3251/6471] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:14.380268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:14.380992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:14.381580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:14.409168 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3221/6472] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:13 2022] DELETE /identity/v3/users/06b9edac381d4d91b23a890a13667b2c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:14.423184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:14.423861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:14.424377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:14.444164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] MFA Rules not processed for user `88a281617be64d1b85a6b7d8a708876a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:14.446215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:14.460380 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:14.496222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:14.501726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:14.571914 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3252/6473] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:14.594505 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3222/6474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:14.653119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:14.654611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:14.811211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67dad5-c002-4b1a-a474-e24072c86d07 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:14.818333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:14.818980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:14.819266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:14.819790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:14.842250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:14.843725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:14.869198 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3253/6475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:15.005368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:15.007454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:15.234439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d199ba2-15dc-47bf-be11-3976beae5d86 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:15.260784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:15.264256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:15.264828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:15.265395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:15.288850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:15.295162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7991f3-affa-44d9-8edb-eb26c440f06e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:15.354726 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3223/6476] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:15.943448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:15.946295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:15.982386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c40ee-d584-49af-95d0-eaa87ff05a5a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:15.989864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:15.991037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:15.992334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:15.992972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] PATH_INFO: `/v3/projects/f049daf99cb841f5bc65fa240429286c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:15.995290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f049daf99cb841f5bc65fa240429286c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:15.997433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:16.102448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f049daf99cb841f5bc65fa240429286c', 'request_id': 'req-744fc42c-b9ce-4da8-bb75-2e345794a89b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:16.118418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f049daf99cb841f5bc65fa240429286c', 'request_id': 'req-744fc42c-b9ce-4da8-bb75-2e345794a89b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:16.124974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f049daf99cb841f5bc65fa240429286c', 'request_id': 'req-744fc42c-b9ce-4da8-bb75-2e345794a89b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:16.155926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] The token cache is being invalidate because project f049daf99cb841f5bc65fa240429286c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:16.156493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:16.166869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-744fc42c-b9ce-4da8-bb75-2e345794a89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:16.175536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3254/6477] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:15 2022] DELETE /identity/v3/projects/f049daf99cb841f5bc65fa240429286c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:16.177166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.177478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.177754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.216600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:16.217914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:16.263702 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:16.392085 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3224/6478] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:16.401587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.401880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.402157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.458628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:16.461805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:16.488190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3255/6479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:16.490334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:16.510547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25a4d7-c4b0-4454-bb56-6b4d5d51d6f3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:16.534736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:16.535364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.535644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.535913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.536720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:16.537027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:16.539504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:16.582360 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3225/6480] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:16.586585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:16.608267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a83ca8-9ebb-44d2-b45f-6f02b46adfe7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:16.615045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:16.615688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.615972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.616277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.617069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:16.619745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:16.656431 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3256/6481] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:16.660989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:16.673896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd163f9-0394-4ce2-892d-177094e68fdf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:16.864764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:16.865397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.865706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.866069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.867450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:16.869444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:16.910605 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3226/6482] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:16 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:16.914948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:16.930113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847980-b085-49f8-8ea9-d8791c95cd93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:16.938429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:16.939345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:16.939887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:16.940646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:16.942531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:16.946160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:16.989323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3257/6483] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:16.993877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:17.006253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dd84-156b-43a2-912a-f15a4fc153fc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:17.013908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:17.014946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:17.015401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:17.015843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] PATH_INFO: `/v3/projects/6d5070cbeb3f47edb868c2818c070c17/users/3726ef8f1dd24861aed4c6f6926ff2a1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:17.035081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5070cbeb3f47edb868c2818c070c17, user_id=3726ef8f1dd24861aed4c6f6926ff2a1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:17.039457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:17.064775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:17.065597 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3227/6484] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:16 2022] PUT /identity/v3/projects/6d5070cbeb3f47edb868c2818c070c17/users/3726ef8f1dd24861aed4c6f6926ff2a1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:17.071741 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:17.081689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340a36-4f09-45ab-a657-5facadf9ce94 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:17.230617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:17.231764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:17.232224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:17.232718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:17.233853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:17.239014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db129-e821-4ba2-90d1-f1d3ef33854f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:17.269289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:17.270388 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3258/6485] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:17.283013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5142-69ac-435a-8bb8-ad184a2d4600 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:17.289112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:17.290279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:17.291166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:17.291603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] PATH_INFO: `/v3/projects/6d5070cbeb3f47edb868c2818c070c17/users/3726ef8f1dd24861aed4c6f6926ff2a1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:17.306480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5070cbeb3f47edb868c2818c070c17, user_id=3726ef8f1dd24861aed4c6f6926ff2a1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:17.309964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:17.331145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3228/6486] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:17 2022] PUT /identity/v3/projects/6d5070cbeb3f47edb868c2818c070c17/users/3726ef8f1dd24861aed4c6f6926ff2a1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:17.341374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:17.341690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:17.341965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:17.394459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] MFA Rules not processed for user `3726ef8f1dd24861aed4c6f6926ff2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:17.395697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:17.572445 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3259/6487] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:17.577171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:17.802418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab3c-8296-4635-83d1-cc2ab76aa162 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:17.823477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:17.824341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:17.824786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:17.825228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:17.826071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:17.829897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:17.877820 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:17.916103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3229/6488] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:17 2022] POST /identity/v3/projects => generated 379 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:17.920046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:17.938754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb989344-3fe4-4922-ba82-887ccc5cb115 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:18.150019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:18.158794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:18.199268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:18.202279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.207218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.209557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.213517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:18.215505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:18.303551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3260/6489] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:17 2022] POST /identity/v3/users => generated 290 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:18.308876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:18.329767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121a102-4ada-4bb0-95dd-9edc00447927 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:18.344164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:18.344792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.345068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.345341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.360333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:18.362209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:18.406522 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3261/6490] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:18.406522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:18.430314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928215e-9a56-40a2-bc39-4e9e5da4c8e6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:18.435354 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:18.446240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:18.447369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.447769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb08b1-4694-42ee-9fac-5eedf50a5186 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:18.448583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.449087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.458033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:18.468642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:18.469276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.469580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.469856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.470501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:18.472225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:18.495442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:18.497168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff69f3-adc0-4286-a571-c3c29c46bdc4 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:18.513967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3262/6491] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:18.515548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:18.534495 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3230/6492] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:18.563937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6499e-3b05-4767-b07c-2f8f4e660774 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:18.582756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:18.583793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.584684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.585442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] PATH_INFO: `/v3/projects/4bbec9e0521d47019cd0567cb0ea269a/users/e801aa2cdaa041c88aa0978c71b23b9c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.612637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bbec9e0521d47019cd0567cb0ea269a, user_id=e801aa2cdaa041c88aa0978c71b23b9c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:18.621360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b18d4-cf1a-47ef-b237-4cac101e4b55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:18.649928 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3263/6493] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:18 2022] PUT /identity/v3/projects/4bbec9e0521d47019cd0567cb0ea269a/users/e801aa2cdaa041c88aa0978c71b23b9c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:18.660514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.660890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.661073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.724324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] MFA Rules not processed for user `e801aa2cdaa041c88aa0978c71b23b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:18.726622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:18.776318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:18.776621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:18.776945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:18.833709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] MFA Rules not processed for user `88a281617be64d1b85a6b7d8a708876a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:18.835401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:18.896349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3231/6494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:18.908900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:18.911271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:19.015699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3264/6495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:19.103949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dc07-a5b5-4687-920b-fdfda05c0829 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:19.118949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:19.121942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:19.122213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:19.122495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:19.195915 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:19.327800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:19.332246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef69d-f492-4252-821b-e201d785567f service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:19.399740 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3232/6496] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:20.814428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:20.988426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e7939-6c8f-420d-b454-48bb7ad69c53 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:21.009224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:21.010134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:21.011228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:21.011817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] PATH_INFO: `/v3/users/3726ef8f1dd24861aed4c6f6926ff2a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:21.016070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3726ef8f1dd24861aed4c6f6926ff2a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:21.019635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:21.108125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3726ef8f1dd24861aed4c6f6926ff2a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:21.118173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3726ef8f1dd24861aed4c6f6926ff2a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:21.136193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3726ef8f1dd24861aed4c6f6926ff2a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:21.137168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3726ef8f1dd24861aed4c6f6926ff2a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:21.137984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3726ef8f1dd24861aed4c6f6926ff2a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:21.140090 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:21.163197 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3265/6497] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:20 2022] DELETE /identity/v3/users/3726ef8f1dd24861aed4c6f6926ff2a1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:21.167850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:21.168415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:21.168415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:21.216894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:21.218238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:21.354214 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3233/6498] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:21.464214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:21.467036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:21.470859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:21.473644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:21.624361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7278c-c2f5-4de5-8c0f-848da318d6e6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:21.628645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:21.629527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:21.629983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:21.630427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:21.632505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:21.646118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:21.648258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f6f6a-1238-47b6-a9f8-af7763853313 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:21.664207 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3234/6499] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:21.692329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b448-02d8-4da9-aeb7-049970a97dd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:21.698907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:21.699518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:21.699871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:21.700227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:21.713481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:21.730102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:21.762857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3266/6500] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:23.052429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:23.052959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:23.053358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:23.093373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:23.095072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:23.208362 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3235/6501] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:23.296229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:23.296702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:23.302401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:23.303673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:23.346882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d758c3a-9dad-4d99-a10c-8895f52d65d5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:23.361820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:23.364315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:23.364641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:23.364921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] PATH_INFO: `/v3/projects/6d5070cbeb3f47edb868c2818c070c17` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:23.366926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5070cbeb3f47edb868c2818c070c17)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:23.369193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:23.370996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:23.502888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5070cbeb3f47edb868c2818c070c17', 'request_id': 'req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.517147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5070cbeb3f47edb868c2818c070c17', 'request_id': 'req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.531869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367e274-d8cd-4ecd-945b-bedaa5a1297a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:23.533659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5070cbeb3f47edb868c2818c070c17', 'request_id': 'req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.564126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] The token cache is being invalidate because project 6d5070cbeb3f47edb868c2818c070c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:23.564430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.565356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.571340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3236/6502] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:23 2022] DELETE /identity/v3/projects/6d5070cbeb3f47edb868c2818c070c17 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:23.573256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:23.577454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:23.794165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:23.794790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:23.795067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:23.795227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af9f7f-fb7a-40fe-973f-8784fb1f8d81 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:23.796362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:23.807888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:23.808553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:23.808837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:23.809114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] PATH_INFO: `/v3/users/e801aa2cdaa041c88aa0978c71b23b9c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:23.809770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:23.814594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e801aa2cdaa041c88aa0978c71b23b9c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:23.816600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:23.888560 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:23.944677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:23.947090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:23.955211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e801aa2cdaa041c88aa0978c71b23b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.955976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e801aa2cdaa041c88aa0978c71b23b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:23.967036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3267/6503] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:26:23.977433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e801aa2cdaa041c88aa0978c71b23b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:24.026948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e801aa2cdaa041c88aa0978c71b23b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:24.027706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-35be9cf1-bdfa-4515-b5a6-90019825a49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e801aa2cdaa041c88aa0978c71b23b9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:24.060194 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3237/6504] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:23 2022] DELETE /identity/v3/users/e801aa2cdaa041c88aa0978c71b23b9c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:26.300801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:26.316591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700c-162c-4712-9552-7e27472164d7 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:26.434417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:26.435299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:26.435299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:26.435685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] PATH_INFO: `/v3/projects/4bbec9e0521d47019cd0567cb0ea269a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:26.446528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bbec9e0521d47019cd0567cb0ea269a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:26.448421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:26.539891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbec9e0521d47019cd0567cb0ea269a', 'request_id': 'req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:26.555991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbec9e0521d47019cd0567cb0ea269a', 'request_id': 'req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:26.564185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbec9e0521d47019cd0567cb0ea269a', 'request_id': 'req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:26.585857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] The token cache is being invalidate because project 4bbec9e0521d47019cd0567cb0ea269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:26.586190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:26.587628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf65a035-f2e5-47ee-8b82-3b1b2446c4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:26.612514 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3268/6505] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:26 2022] DELETE /identity/v3/projects/4bbec9e0521d47019cd0567cb0ea269a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:26.614195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:26.614668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:26.614794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:26.647706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:26.649398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:26.654716 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:26.779170 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3238/6506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:26.786810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:26.787154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:26.787384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:26.832433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:26.835752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:26.852984 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3269/6507] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:26.854210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:26.871144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b22a62-97a3-4f77-9ea6-f94b7707ebce None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:26.881016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:26.881882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:26.882267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:26.882652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:26.883749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:26.885580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:26.889268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:26.908128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:26.919631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d80daf-308c-4389-b1af-3e8b4887b66e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:26.920222 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3239/6508] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:26.931037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:26.931845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:26.932228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:26.932610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:26.933556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:26.935741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:26.996800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3270/6509] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:26:27.001134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:27.021834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd9be-b994-439f-9f91-5ea3b8140bda admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:27.107866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:27.108493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.108780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.109136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.109920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:27.113089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:27.160762 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3240/6510] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:27 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:27.165859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:27.182910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c1b03-463f-42e0-a4be-fe4dd7fbddea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:27.207495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:27.208154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.208444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.208727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.213832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:27.222768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:27.286792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:27.292550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3271/6511] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:27.307780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4012-9a5e-4e44-a4e0-45c0816d5665 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:27.315901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:27.316591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.316940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.317435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] PATH_INFO: `/v3/projects/0e88adfcae08472e958cac12273ba60e/users/bdb5e8260c8e4e4385e0f6d7e2061dff/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.340484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e88adfcae08472e958cac12273ba60e, user_id=bdb5e8260c8e4e4385e0f6d7e2061dff, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:27.350930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:27.370916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3241/6512] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:27 2022] PUT /identity/v3/projects/0e88adfcae08472e958cac12273ba60e/users/bdb5e8260c8e4e4385e0f6d7e2061dff/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:27.374921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:27.400889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9349f-9030-4b2b-bb25-9bb59dc9dded admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:27.452482 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:27.572807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:27.573478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.573766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.574043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.582353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:27.590689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70d16e-c414-408a-89a0-3f83d42a030d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:27.636582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3272/6513] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:27.642605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:27.670764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8428d3-7f05-43a9-b7ea-46959b6b73bd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:27.690761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:27.691448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.691730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.692003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] PATH_INFO: `/v3/projects/0e88adfcae08472e958cac12273ba60e/users/bdb5e8260c8e4e4385e0f6d7e2061dff/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.699589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e88adfcae08472e958cac12273ba60e, user_id=bdb5e8260c8e4e4385e0f6d7e2061dff, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:27.702300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:27.771835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3242/6514] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:27 2022] PUT /identity/v3/projects/0e88adfcae08472e958cac12273ba60e/users/bdb5e8260c8e4e4385e0f6d7e2061dff/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:27.787543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:27.787976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:27.788291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:27.858301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] MFA Rules not processed for user `bdb5e8260c8e4e4385e0f6d7e2061dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:27.859773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:28.021467 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3273/6515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:28.033158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:28.180596 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:28.203150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf74b70-15eb-4444-9134-d3c3f61ca4f8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:28.216244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:28.216916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.217197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.217529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:28.218962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:28.222496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:28.278550 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3243/6516] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:28 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:28.283576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:28.297358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53394d2-9115-485b-93d3-3005b179a454 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:28.558071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:28.560089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.560380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.560713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:28.561371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:28.569789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:28.651522 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3274/6517] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:28 2022] POST /identity/v3/users => generated 294 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:28.655874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:28.678015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23266-f61b-431e-8015-e0912687714f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:28.697837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:28.698890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.700468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.701871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:28.702739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:28.706896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:28.733186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3244/6518] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:28.737461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:28.752096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea09dc-4927-4aea-90f2-244d3edaa82c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:28.764148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:28.769027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.769027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.769027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:28.769382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:28.775353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7fbe2-8f0e-496d-83cc-6354eab2e2e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:28.826821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3275/6519] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:28.831781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:28.853945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc039-3c9b-4a0e-ae40-21d8b2f3f922 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:28.871077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:28.872253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.872928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.873442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] PATH_INFO: `/v3/projects/2e0a8412e1b84dcf81cd1d597ff27d0e/users/8013d64864814d5285da2b03c873e00d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:28.915004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a8412e1b84dcf81cd1d597ff27d0e, user_id=8013d64864814d5285da2b03c873e00d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:28.919246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:28.969319 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3245/6520] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:28 2022] PUT /identity/v3/projects/2e0a8412e1b84dcf81cd1d597ff27d0e/users/8013d64864814d5285da2b03c873e00d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:28.983325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:28.984011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:28.984552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:29.048127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] MFA Rules not processed for user `8013d64864814d5285da2b03c873e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:29.050623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:29.091080 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:29.227872 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3276/6521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:29.336547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:29.339545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:29.480217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6b60-90e1-4ed3-b10f-3366b317557a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:29.485992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:29.487334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:29.487721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:29.488154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:29.612701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:29.616665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba231bb-e2bf-43a3-b217-9a803285ae42 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:29.644593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3246/6522] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:30.235546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:30.403600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d310c-d8c5-41bb-9620-1cdaf5b677a4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:30.421587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:30.421587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:30.421587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:30.421587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] PATH_INFO: `/v3/users/bdb5e8260c8e4e4385e0f6d7e2061dff` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:30.422269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb5e8260c8e4e4385e0f6d7e2061dff)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:30.423697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:30.611033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb5e8260c8e4e4385e0f6d7e2061dff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:30.635077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb5e8260c8e4e4385e0f6d7e2061dff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:30.703525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb5e8260c8e4e4385e0f6d7e2061dff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:30.705779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb5e8260c8e4e4385e0f6d7e2061dff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:30.706447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb5e8260c8e4e4385e0f6d7e2061dff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:30.734167 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3277/6523] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:30 2022] DELETE /identity/v3/users/bdb5e8260c8e4e4385e0f6d7e2061dff => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:30.735919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:30.736464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:30.736464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:30.785107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:30.786452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:30.932876 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:30.970119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3247/6524] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:30.995827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:30.997960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:31.080525 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:31.120765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930ee-d595-461c-a88c-8813a8ef7c73 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:31.126849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:31.127637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:31.128038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:31.128414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:31.139586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:31.141371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:31.154954 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3278/6525] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:31.628336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:31.629989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:31.664338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f708e-1dea-48b7-af80-db831c04b849 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:31.668774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:31.669519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:31.669802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:31.670210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:31.680245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:31.697557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:31.701863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:31.741583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3248/6526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:32.830840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:32.832360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:32.864836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772eb84-cc6e-4339-b4cb-6cd7bd30cb12 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:32.880618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:32.881279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:32.882183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:32.883043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] PATH_INFO: `/v3/projects/0e88adfcae08472e958cac12273ba60e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:32.894615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e88adfcae08472e958cac12273ba60e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:32.896560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:33.014949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e88adfcae08472e958cac12273ba60e', 'request_id': 'req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.028046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e88adfcae08472e958cac12273ba60e', 'request_id': 'req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.044465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e88adfcae08472e958cac12273ba60e', 'request_id': 'req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.062538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] The token cache is being invalidate because project 0e88adfcae08472e958cac12273ba60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:33.062815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.065795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.067628 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3279/6527] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:32 2022] DELETE /identity/v3/projects/0e88adfcae08472e958cac12273ba60e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:33.071702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:33.093260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746d104-0fbe-4e6d-ab44-240d463a2b29 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:33.188044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:33.189014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:33.189661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:33.190110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] PATH_INFO: `/v3/users/8013d64864814d5285da2b03c873e00d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:33.191836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8013d64864814d5285da2b03c873e00d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:33.194386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:33.279269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8013d64864814d5285da2b03c873e00d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.280346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8013d64864814d5285da2b03c873e00d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.302371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8013d64864814d5285da2b03c873e00d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.324759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8013d64864814d5285da2b03c873e00d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.329664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0e90c62-470e-4bdf-807d-f08969656c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8013d64864814d5285da2b03c873e00d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:33.370507 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3249/6528] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:33 2022] DELETE /identity/v3/users/8013d64864814d5285da2b03c873e00d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:35.412525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:35.415150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:35.443551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b8cc-6384-410f-bd19-baf3bed7d62a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:35.620381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:35.621059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:35.621345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:35.623310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] PATH_INFO: `/v3/projects/2e0a8412e1b84dcf81cd1d597ff27d0e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:35.626307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0a8412e1b84dcf81cd1d597ff27d0e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:35.632068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:35.811907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0a8412e1b84dcf81cd1d597ff27d0e', 'request_id': 'req-23570597-dcbf-458b-b424-1f63401419da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:35.819589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0a8412e1b84dcf81cd1d597ff27d0e', 'request_id': 'req-23570597-dcbf-458b-b424-1f63401419da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:35.832316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0a8412e1b84dcf81cd1d597ff27d0e', 'request_id': 'req-23570597-dcbf-458b-b424-1f63401419da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:35.843817 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:35.863743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] The token cache is being invalidate because project 2e0a8412e1b84dcf81cd1d597ff27d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:35.864215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:35.868242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23570597-dcbf-458b-b424-1f63401419da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:35.869965 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3280/6529] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:35 2022] DELETE /identity/v3/projects/2e0a8412e1b84dcf81cd1d597ff27d0e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:35.875918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:35.876481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:35.876755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:35.917302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:35.919241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:35.998725 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:36.039039 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3250/6530] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:36.046518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.047099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.047570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.086482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:36.088669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:36.102924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3281/6531] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:36.107501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.123446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd13421-0298-4443-a7a4-fa31ab99a8b7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.171676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.176447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.181547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.181998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.187570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:36.189766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.198319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.260629 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3251/6532] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:36.263448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.275295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca42fd-1a89-418b-ba6e-db8a19471888 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.284600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.285652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.286452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.287146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.288316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.290610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.369355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3282/6533] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:36 2022] POST /identity/v3/projects => generated 359 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:36.373840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.394153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a607bc7-954d-4bd8-9f44-3485e87070b4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.518978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.518978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.519375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.520400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.523270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.525969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.573150 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3252/6534] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:36 2022] POST /identity/v3/users => generated 280 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:36.575487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.591022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfb84-c72c-4e34-8dff-8e7da5f274b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.626060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.626963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.627310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.627771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.628767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.632013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.654837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3283/6535] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:36.659498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.673773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551b17-5c1c-446a-a62f-0f5c4f3676ca admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.684434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.685184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.686251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.686603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.687516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.689785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75fcf2-fe1e-404a-966e-03500d4facfe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.725716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3253/6536] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:36.730002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:36.765138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46cc39-ff10-4480-bb3f-d43a08b95213 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:36.778115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:36.778919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.779260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.779946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] PATH_INFO: `/v3/projects/0390f0e5823c4aec93ecac02f138629d/users/a74d1bb367534484be95d6028e0d17d7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.813010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0390f0e5823c4aec93ecac02f138629d, user_id=a74d1bb367534484be95d6028e0d17d7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:36.819567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:36.853377 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3284/6537] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:36 2022] PUT /identity/v3/projects/0390f0e5823c4aec93ecac02f138629d/users/a74d1bb367534484be95d6028e0d17d7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:36.863729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756396-7ae3-4a90-b588-37c225f76365 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:36.864011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756396-7ae3-4a90-b588-37c225f76365 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:36.864288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756396-7ae3-4a90-b588-37c225f76365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:36.939231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fc756396-7ae3-4a90-b588-37c225f76365 None None] MFA Rules not processed for user `a74d1bb367534484be95d6028e0d17d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:36.940778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fc756396-7ae3-4a90-b588-37c225f76365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:37.083259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3254/6538] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:37.100203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:37.260507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddffef-7a45-4b7c-acb3-5e4d1fd66a4b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:37.275614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:37.278293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:37.278758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:37.280202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] PATH_INFO: `/v3/users/a74d1bb367534484be95d6028e0d17d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:37.283973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74d1bb367534484be95d6028e0d17d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:37.300220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:37.449731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74d1bb367534484be95d6028e0d17d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:37.463471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74d1bb367534484be95d6028e0d17d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:37.494312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74d1bb367534484be95d6028e0d17d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:37.495243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74d1bb367534484be95d6028e0d17d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:37.496262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74d1bb367534484be95d6028e0d17d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:37.535847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3285/6539] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:37 2022] DELETE /identity/v3/users/a74d1bb367534484be95d6028e0d17d7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:37.538338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:37.538736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:37.539276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:37.587211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:37.610480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:37.749546 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:37.784126 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3255/6540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:37.820535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:37.821939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:37.843522 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:37.948774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0afad3-e001-4243-961e-e7d9325bcc0d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:37.955033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:37.955676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:37.955961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:37.956499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:37.973441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:37.975744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a226f-623d-4cbf-947e-02f349458251 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:37.998178 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3286/6541] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:39.557728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:39.559298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:39.578520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea242d61-1a17-47cd-bc79-6e578efe4794 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:39.607127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:39.608034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:39.610836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:39.611085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] PATH_INFO: `/v3/projects/0390f0e5823c4aec93ecac02f138629d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:39.612952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0390f0e5823c4aec93ecac02f138629d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:39.615312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:39.742412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0390f0e5823c4aec93ecac02f138629d', 'request_id': 'req-e8863628-9bb9-492a-8baa-4a734331d0f6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:39.756231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0390f0e5823c4aec93ecac02f138629d', 'request_id': 'req-e8863628-9bb9-492a-8baa-4a734331d0f6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:39.764783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0390f0e5823c4aec93ecac02f138629d', 'request_id': 'req-e8863628-9bb9-492a-8baa-4a734331d0f6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:39.785559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] The token cache is being invalidate because project 0390f0e5823c4aec93ecac02f138629d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:39.785929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:39.788660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e8863628-9bb9-492a-8baa-4a734331d0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:39.791193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3256/6542] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:39 2022] DELETE /identity/v3/projects/0390f0e5823c4aec93ecac02f138629d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:39.797274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:39.797891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:39.797891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:39.836615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:39.838984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:39.947405 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3287/6543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:39.956495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:39.956967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:39.957431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:39.990454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:39.992833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:40.039994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3257/6544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:40.053736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.060014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a75e4-b7d4-4a7b-ab5e-8f63b2dc30b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.071451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.072103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.072390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.072674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.074995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:40.074995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.076539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.117299 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3288/6545] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:40.118328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.129767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878650a-fd4c-4953-b672-52b70c5e26c7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.151027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.163305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.163305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.163688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.164050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.166045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.221608 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3258/6546] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:40 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:40.226506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.242259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37fa38-25c9-459a-bad4-a1a84cb722fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.396754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.397980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.398518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.398796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.399443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.401995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.454340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3289/6547] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:40 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:40.458698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.470584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ea94-c983-40e0-aa4e-2ad94092ac8a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.486968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.487895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.487895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.488134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.489279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.493138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.516221 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3259/6548] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:40.517698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.536032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1065fce-9466-44fb-ac4d-d3461d5d14da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.544745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.545381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.545698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.545985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.546757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.548615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201781-630f-4412-ac32-e4c8d909fb96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.565646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3290/6549] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:40.567441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:40.585023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43014c30-d7c9-4f4d-b62d-8d59c9a3823a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:40.592900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:40.593748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.594129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.594504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] PATH_INFO: `/v3/projects/df99a7546b38483cab98e45d21b974b8/users/0b9ddf91169645c2ba97b8a15bd2a58e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.614855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df99a7546b38483cab98e45d21b974b8, user_id=0b9ddf91169645c2ba97b8a15bd2a58e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:40.617931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:40.658686 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3260/6550] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:40 2022] PUT /identity/v3/projects/df99a7546b38483cab98e45d21b974b8/users/0b9ddf91169645c2ba97b8a15bd2a58e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:40.676915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:40.677853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:40.678683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:40.739422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] MFA Rules not processed for user `0b9ddf91169645c2ba97b8a15bd2a58e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:40.740706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:40.751960 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:40.918211 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3291/6551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:40.922758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.282703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fa82b-88a2-4762-a91b-c43827a1a4c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:41.295552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:41.296101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:41.296387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:41.296658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:41.297307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:41.308738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:41.362707 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:41.399913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3261/6552] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:41.404384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.424667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce062d7-1239-4e2d-a114-88e43564f470 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:41.444418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.448264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:41.577881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:41.578672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:41.578967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:41.579668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:41.581769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:41.592072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:41.664766 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3292/6553] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:41 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:41.671206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.708339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc358e40-b553-4139-b4cd-cc3d47d01b5f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:41.730292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:41.730932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:41.731415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:41.731692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:41.732352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:41.734019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:41.765837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3293/6554] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:41.766810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.768962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe03b8-1b5d-4e2c-a4a8-2a0e63078aa3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:41.788970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b474-6c4d-4337-96be-c4d1a78e8903 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:41.794100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:41.795011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:41.795456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:41.795891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:41.801037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:41.801857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:41.802147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:41.802421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] PATH_INFO: `/v3/projects/3b9c328ac4154008b8729023e2561d66/users/91d30808d4c04972a02ff19405be6f4b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:41.803918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:41.839838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:41.844355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9c328ac4154008b8729023e2561d66, user_id=91d30808d4c04972a02ff19405be6f4b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:41.844670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:41.847227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:41.871495 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3294/6555] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:41 2022] PUT /identity/v3/projects/3b9c328ac4154008b8729023e2561d66/users/91d30808d4c04972a02ff19405be6f4b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:41.876708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:41.904249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3262/6556] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:42.124398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116110-241a-400a-bc63-75ffd21b97e8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:42.138969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:42.139868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:42.140330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:42.141556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:42.142410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:42.144237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508553-ad12-4152-a264-e2d97f448872 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:42.158181 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:42.176582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3295/6557] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:42.177498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:42.190644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84c7e0-6ca9-404e-9a94-57d424c3a33b service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:42.205824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:42.206478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:42.206762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:42.207038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] PATH_INFO: `/v3/projects/3b9c328ac4154008b8729023e2561d66/users/91d30808d4c04972a02ff19405be6f4b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:42.216690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9c328ac4154008b8729023e2561d66, user_id=91d30808d4c04972a02ff19405be6f4b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:42.219447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:42.276595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3263/6558] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:42 2022] PUT /identity/v3/projects/3b9c328ac4154008b8729023e2561d66/users/91d30808d4c04972a02ff19405be6f4b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:42.279246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:42.279905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:42.280464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:42.378909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] MFA Rules not processed for user `91d30808d4c04972a02ff19405be6f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:42.380332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:42.595146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3296/6559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:42.603494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:42.632126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82608fb2-ee75-493b-8f3c-c2bf81228581 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:42.644980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d30808d4c04972a02ff19405be6f4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b9c328ac4154008b8729023e2561d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:42.645634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:42.645937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:42.646195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:42.646895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:42.647678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:42.650256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:42.686536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3264/6560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:42.687104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:42.698984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ced0-4253-4eee-bd3d-c46077306186 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:42.717451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d30808d4c04972a02ff19405be6f4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b9c328ac4154008b8729023e2561d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:42.719351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:42.719670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:42.720557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:42.722571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:42.728780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:42.798728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3297/6561] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:42 2022] POST /identity/v3/projects => generated 349 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:42.804822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:42.831112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf23a-825d-43b8-88af-17e3e68bf59f tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:43.078047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d30808d4c04972a02ff19405be6f4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b9c328ac4154008b8729023e2561d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:43.082335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:43.082863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:43.083499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:43.084555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:43.085200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:43.087105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:43.132623 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3265/6562] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:43.143745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:43.146095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:43.288756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0f32-5fc8-4c9c-9235-b5d9563402ba tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:43.305629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:43.307075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:43.307075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:43.308078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:43.343526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:43.352505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:43.381008 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3298/6563] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:50.084110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:50.098261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c320967-4235-4b07-bff4-608406e12f85 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:50.110249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d30808d4c04972a02ff19405be6f4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b9c328ac4154008b8729023e2561d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:50.111063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:50.111641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:50.111641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] PATH_INFO: `/v3/projects/576dfa31652a4da881c053508ea6a7c6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:50.112847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorizing `identity:delete_project(project_id=576dfa31652a4da881c053508ea6a7c6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:50.116039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:50.167136 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:50.171876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576dfa31652a4da881c053508ea6a7c6', 'request_id': 'req-4f4ae27d-24d4-458e-b469-c6522b79b201'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.181653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576dfa31652a4da881c053508ea6a7c6', 'request_id': 'req-4f4ae27d-24d4-458e-b469-c6522b79b201'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.190540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576dfa31652a4da881c053508ea6a7c6', 'request_id': 'req-4f4ae27d-24d4-458e-b469-c6522b79b201'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.216934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] The token cache is being invalidate because project 576dfa31652a4da881c053508ea6a7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:50.217231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.218227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4f4ae27d-24d4-458e-b469-c6522b79b201 tempest-QuotasNegativeTest-564839609 tempest-QuotasNegativeTest-564839609-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.221454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3266/6564] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:50 2022] DELETE /identity/v3/projects/576dfa31652a4da881c053508ea6a7c6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:50.226840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:50.317656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab001-aed8-4534-ac3d-a719a319a390 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:50.331038 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:50.432935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:50.435097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:50.435714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:50.437009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] PATH_INFO: `/v3/users/0b9ddf91169645c2ba97b8a15bd2a58e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:50.440761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9ddf91169645c2ba97b8a15bd2a58e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:50.444544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:50.525637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9ddf91169645c2ba97b8a15bd2a58e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.539339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9ddf91169645c2ba97b8a15bd2a58e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.557029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9ddf91169645c2ba97b8a15bd2a58e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.563106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9ddf91169645c2ba97b8a15bd2a58e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.564184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9ddf91169645c2ba97b8a15bd2a58e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:50.583518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3299/6565] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:50 2022] DELETE /identity/v3/users/0b9ddf91169645c2ba97b8a15bd2a58e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:50.589993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:50.590376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:50.590660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:50.630714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:50.639096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:50.744712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3267/6566] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:50.753760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:50.755547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:50.911388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5df703-0968-46f0-9ae2-891b7c8e8b6f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:50.916177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:50.917080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:50.917611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:50.918071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:50.944361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:50.946383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ffab-6f7a-457f-a31c-45310bb3c249 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:50.967563 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3300/6567] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:51.020964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:51.024093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:51.051106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1a01-cb37-4df1-9b96-6d424bd25b89 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:51.064914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:51.065811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:51.066189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:51.066565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] PATH_INFO: `/v3/users/27d615d7d9af4b47bab1d5b1a5a17418` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:51.067863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d615d7d9af4b47bab1d5b1a5a17418)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:51.071171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:51.181474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d615d7d9af4b47bab1d5b1a5a17418'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.182540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d615d7d9af4b47bab1d5b1a5a17418'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.198863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d615d7d9af4b47bab1d5b1a5a17418'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.227504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d615d7d9af4b47bab1d5b1a5a17418'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.228178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d615d7d9af4b47bab1d5b1a5a17418'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.257512 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3268/6568] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:51 2022] DELETE /identity/v3/users/27d615d7d9af4b47bab1d5b1a5a17418 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:51.261930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:51.262963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:51.263469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:51.308661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:51.310779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:51.361670 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:51.447219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3301/6569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:51.459845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:51.462830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:51.559278 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:51.582786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e777-1092-4406-84d9-6e8bd7115b58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:51.595598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:51.596480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:51.597104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:51.597528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:51.610763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:51.612655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:51.624570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3269/6570] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:26:51.744984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:51.746798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:51.764452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0971a5-1a85-4aab-a288-ae35ad76a940 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:51.770333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:51.771039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:51.771407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:51.780720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] PATH_INFO: `/v3/projects/df99a7546b38483cab98e45d21b974b8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:51.784777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df99a7546b38483cab98e45d21b974b8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:51.788462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:51.862912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df99a7546b38483cab98e45d21b974b8', 'request_id': 'req-3ca96955-97c0-4a90-bbb5-18faf817da56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.877135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df99a7546b38483cab98e45d21b974b8', 'request_id': 'req-3ca96955-97c0-4a90-bbb5-18faf817da56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.883672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:51.885879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:51.887103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df99a7546b38483cab98e45d21b974b8', 'request_id': 'req-3ca96955-97c0-4a90-bbb5-18faf817da56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.917691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] The token cache is being invalidate because project df99a7546b38483cab98e45d21b974b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:51.917991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.919375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:51.922243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42c6e-3dc3-4c08-b233-c4fbb6057179 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:51.924079 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3302/6571] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:51 2022] DELETE /identity/v3/projects/df99a7546b38483cab98e45d21b974b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:51.925806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:51.929672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.025890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.026933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.027493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.027947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] PATH_INFO: `/v3/users/87ebff0be86d4a26a45c383cc5fc8f08` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.029295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ebff0be86d4a26a45c383cc5fc8f08)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.031290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.054905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96955-97c0-4a90-bbb5-18faf817da56 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:52.062578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.065699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.066133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.066411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] PATH_INFO: `/v3/users/91d30808d4c04972a02ff19405be6f4b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.067887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d30808d4c04972a02ff19405be6f4b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.070036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.103380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ebff0be86d4a26a45c383cc5fc8f08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.107296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ebff0be86d4a26a45c383cc5fc8f08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.119364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ebff0be86d4a26a45c383cc5fc8f08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.133833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d30808d4c04972a02ff19405be6f4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.143872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ebff0be86d4a26a45c383cc5fc8f08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.145070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-72eff892-1846-4f46-a5d5-84aa217f7308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ebff0be86d4a26a45c383cc5fc8f08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.153168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d30808d4c04972a02ff19405be6f4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.156568 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:52.175504 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3270/6572] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:51 2022] DELETE /identity/v3/users/87ebff0be86d4a26a45c383cc5fc8f08 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:52.185981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.188177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d30808d4c04972a02ff19405be6f4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.189207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.189889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d30808d4c04972a02ff19405be6f4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.190152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.191293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d30808d4c04972a02ff19405be6f4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.231837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:52.232693 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3303/6573] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:51 2022] DELETE /identity/v3/users/91d30808d4c04972a02ff19405be6f4b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:52.233898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.318117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:52.320412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.324287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3271/6574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:52.344006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21074-84ef-4d08-94cb-0324fdb76f5a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:52.351247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.352266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.352771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.353067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] PATH_INFO: `/v3/projects/4e1afcb71e834d0a818f8acac4cd2fa3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.354402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1afcb71e834d0a818f8acac4cd2fa3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.355101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:52.356657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.366868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.379293 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:52.445658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1afcb71e834d0a818f8acac4cd2fa3', 'request_id': 'req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.456605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1afcb71e834d0a818f8acac4cd2fa3', 'request_id': 'req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.466557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1afcb71e834d0a818f8acac4cd2fa3', 'request_id': 'req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.489923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] The token cache is being invalidate because project 4e1afcb71e834d0a818f8acac4cd2fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:52.491323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.492533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.497827 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3304/6575] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:52 2022] DELETE /identity/v3/projects/4e1afcb71e834d0a818f8acac4cd2fa3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:52.499171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d277e4-fae3-4360-b2e0-915a0a1d827d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:52.499691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:52.501291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.595908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0cc0-d7e4-4837-a85b-beb8ddfd8fd5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:52.621903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.623000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.623291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.624835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] PATH_INFO: `/v3/users/c6e1e87b6b134af2af85899605553992` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.625697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.628788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e1e87b6b134af2af85899605553992)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.629744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.631578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.632043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.632493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.642324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.668951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.670876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.693197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3272/6576] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:52.700398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:52.701938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:52.717709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0168-9842-40db-83a1-35e9fba8838c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:52.729618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:52.730308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.730590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.730864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] PATH_INFO: `/v3/projects/3b9c328ac4154008b8729023e2561d66` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.732240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9c328ac4154008b8729023e2561d66)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:52.734197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:52.748583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e1e87b6b134af2af85899605553992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.790700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e1e87b6b134af2af85899605553992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.801827 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:52.817230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e1e87b6b134af2af85899605553992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.818158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e1e87b6b134af2af85899605553992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.819021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecf1257e-3d0e-4456-bf37-21483ade6275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e1e87b6b134af2af85899605553992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.851511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9c328ac4154008b8729023e2561d66', 'request_id': 'req-1abee16d-a352-4c55-9c7a-bbea60a37127'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.855630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3305/6577] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:52 2022] DELETE /identity/v3/users/c6e1e87b6b134af2af85899605553992 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:52.859478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9c328ac4154008b8729023e2561d66', 'request_id': 'req-1abee16d-a352-4c55-9c7a-bbea60a37127'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.865960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9c328ac4154008b8729023e2561d66', 'request_id': 'req-1abee16d-a352-4c55-9c7a-bbea60a37127'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.886793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] The token cache is being invalidate because project 3b9c328ac4154008b8729023e2561d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:52.887377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.888322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1abee16d-a352-4c55-9c7a-bbea60a37127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:52.890545 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3273/6578] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:52 2022] DELETE /identity/v3/projects/3b9c328ac4154008b8729023e2561d66 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:26:52.895186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:52.895762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:52.896315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:52.940072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:52.941767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.041569 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3306/6579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:53.045761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.046234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.046699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.072934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:53.075418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.088640 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3274/6580] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:53.097279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.099033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.109855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.121472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659be37-47dd-469e-ad89-679506b44c03 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.133011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.133656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.133936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.134068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0880b-1ac7-49c9-891c-11044a9d2f55 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.135045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] PATH_INFO: `/v3/projects/157891898c1d4b6ea0d7dbb11950ea0b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.137304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157891898c1d4b6ea0d7dbb11950ea0b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.139591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.146086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.147573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.147791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.147942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.148947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:53.149248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.153064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.181129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3275/6581] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:53.185847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.204381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce53116-6c2f-4c3b-9e87-6f0630710889 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.220211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.221694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.221983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.222286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.222931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.227891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.241083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157891898c1d4b6ea0d7dbb11950ea0b', 'request_id': 'req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.256239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157891898c1d4b6ea0d7dbb11950ea0b', 'request_id': 'req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.282482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157891898c1d4b6ea0d7dbb11950ea0b', 'request_id': 'req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.295862 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3276/6582] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:26:53.297033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.299547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.300314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] The token cache is being invalidate because project 157891898c1d4b6ea0d7dbb11950ea0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:53.300623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.301602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.308367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3307/6583] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:53 2022] DELETE /identity/v3/projects/157891898c1d4b6ea0d7dbb11950ea0b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:53.308367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.309072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.318792 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:53.461712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9874bf-1ac7-4bd4-bc21-e9868efc6cb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.470320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.470966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.471384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.471527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.472142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.474156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169f2d-0928-4db8-bb64-44861c77f1f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.484301 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:53.490826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9c75-2039-4aa5-8d16-03038dd5043b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.504811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.505440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.505716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.506192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] PATH_INFO: `/v3/projects/28da7f2f544b476aaab588c6dd8c1835` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.511559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28da7f2f544b476aaab588c6dd8c1835)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.512414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3308/6584] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:53.513998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.514314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.514866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.516192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.545359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:53.546679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.559688 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3309/6585] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:53.560823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.579011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63264d-54f7-4ca5-b674-fe8995cf71e7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.594709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.595750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.596267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.596704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.597615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.600608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13979-eae3-4cce-8aec-843894a3f6be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.617237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3310/6586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:53.619089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5d7-717a-4e35-be4d-a7b93e3394e8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.619422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5d7-717a-4e35-be4d-a7b93e3394e8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.619701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5d7-717a-4e35-be4d-a7b93e3394e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.620147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28da7f2f544b476aaab588c6dd8c1835', 'request_id': 'req-0c00633a-da6c-4454-8026-0142708698c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.631726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28da7f2f544b476aaab588c6dd8c1835', 'request_id': 'req-0c00633a-da6c-4454-8026-0142708698c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.645231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d89b5d7-717a-4e35-be4d-a7b93e3394e8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:53.647260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d89b5d7-717a-4e35-be4d-a7b93e3394e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.650613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28da7f2f544b476aaab588c6dd8c1835', 'request_id': 'req-0c00633a-da6c-4454-8026-0142708698c2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.685066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] The token cache is being invalidate because project 28da7f2f544b476aaab588c6dd8c1835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:53.685593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.686437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:53.700314 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3277/6587] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:53 2022] DELETE /identity/v3/projects/28da7f2f544b476aaab588c6dd8c1835 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:53.702224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.703470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.760013 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3311/6588] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:53.766005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.766594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.767081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.809937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:53.811183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.830262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3312/6589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:53.831337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.839464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00633a-da6c-4454-8026-0142708698c2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.843507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b212d-7877-43bc-a81a-793de0f055b4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.844526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.845302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.845687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.846034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.846737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.848449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc4fd-d89a-4053-9d22-54105673735d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.850680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.851515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.851798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.852145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.852864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:53.853173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.856488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.864037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3278/6590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:53.865432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.865848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.866332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.877905 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3313/6591] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:53.879568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.903069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:53.903294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9dbb-f95a-4608-9e78-8935b1981e0e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.903427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:53.903848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.904552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.904801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.905077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] PATH_INFO: `/v3/projects/f814a99b3013415e8c0815fbb8581a47/users/17e45075b3ca4407a8372ac0c96c5481/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.910295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3279/6592] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:53.913931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.924361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360185b-caa7-4b51-83e8-c996d04e356b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:53.926648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f814a99b3013415e8c0815fbb8581a47, user_id=17e45075b3ca4407a8372ac0c96c5481, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.929576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.929846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:53.930587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.930874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.931140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.932312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:53.934495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71e3b0-75ed-402c-92c2-6d191f5d338b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:53.959039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3314/6593] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:53 2022] PUT /identity/v3/projects/f814a99b3013415e8c0815fbb8581a47/users/17e45075b3ca4407a8372ac0c96c5481/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:53.960708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:53.968726 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3280/6594] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:53.973862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:53.974149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:53.974568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:53.983996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:54.010548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] MFA Rules not processed for user `17e45075b3ca4407a8372ac0c96c5481`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:54.011854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:54.081680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedd1a-e7f7-434a-934e-13b56a563a5b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.149681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3281/6595] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:54.150551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.154281 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:54.201220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.202848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.205088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.206370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.207203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:54.208558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.213756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.224723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32032b33-64d9-4b6f-a017-04f006c250c8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.235174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.235867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.236168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.236468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.236922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3315/6596] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:54.238038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.238261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.244622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.250757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfc10c-3e13-4d87-b1dc-37b4aba4146e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.257356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.258213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.258510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.258965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.259632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.261909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.291386 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3282/6597] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:54.294571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.316393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa72d-36f6-4a84-b3b7-a3b4485fb607 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.325908 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3316/6598] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:54.327023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.335189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.336293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.336607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.336896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.337735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.340152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.450700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3283/6599] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:54.455318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.505228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb535b-8bc6-4e4a-9d9e-4385d0c95fc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.583263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.585980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.586458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.586838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.587613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.590013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.593504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91611e2-0500-4e08-ac02-cd3a4f4055e9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.600539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.601166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.601618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.601935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.602395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.604413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.608834 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3317/6600] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:54.608834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.619930 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:54.621139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102155-622d-43cb-9d21-497c5b0a6d33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.634277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.635248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.635675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.636276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.637354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.640163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.648991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3284/6601] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:54.648991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.666816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dfff8-dc53-431f-80af-002b4de7e576 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.670465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3318/6602] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:54.671520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.680353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.680822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.681108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.681458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.682117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.684061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.685102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c3f4-2b31-4848-b7fb-4cc8988a560a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.691461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.692492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.693182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.694164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.695039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.697056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.709582 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3285/6603] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:54.710669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.723946 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3319/6604] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:54.725208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.736399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6461135-edf0-4f5b-be7c-1fabf4309db6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.740436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6859b79-efb0-41c8-9ab2-fec185d8d748 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.745139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.746840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.747184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.747458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.748526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.750306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.752308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.752993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.753284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.753580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] PATH_INFO: `/v3/projects/8f8660f9c95a409c8b01dc581e8ff4a8/users/47326c399b0044218ebd30119c958ede/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.767059 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3286/6605] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:54.768403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.784093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf4dc6-bc63-4e9c-9d40-fc89d90a2cbe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:54.786721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8660f9c95a409c8b01dc581e8ff4a8, user_id=47326c399b0044218ebd30119c958ede, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.790632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.798432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:54.799114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.801389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.801598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] PATH_INFO: `/v3/projects/6436f84072154ceb9c1520cb7b048325/users/fc42a499260c419c8b082b64e13123c1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.812930 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:54.821726 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3320/6606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:54 2022] PUT /identity/v3/projects/8f8660f9c95a409c8b01dc581e8ff4a8/users/47326c399b0044218ebd30119c958ede/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:54.832614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:54.841948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6436f84072154ceb9c1520cb7b048325, user_id=fc42a499260c419c8b082b64e13123c1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:54.845669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927edd-341e-4dd2-b260-d10997e1a19e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:54.878230 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3287/6607] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:54 2022] PUT /identity/v3/projects/6436f84072154ceb9c1520cb7b048325/users/fc42a499260c419c8b082b64e13123c1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:54.878230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:54.878230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:54.878230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:54.953913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] MFA Rules not processed for user `47326c399b0044218ebd30119c958ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:54.953913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:54.979810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1f80-ed80-4064-8d74-ff23b0fc964c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.077198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.077852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.078134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.078407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.079048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.080778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.097189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3288/6608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:55.097367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3321/6609] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:55.097367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.097615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.113835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a0bc-81b0-430d-88f3-5e712f16fdbc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.116414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ff3c3-6e63-4516-86eb-3f9f9e8b30c3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.122729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.123585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.123798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.124081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] PATH_INFO: `/v3/projects/e9ce466f6d7647acbc9b22100d650827/users/206add31be9e488b8b9bb32b598835e3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.125573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.126322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.126610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.126881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.127528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.129151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.160652 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3289/6610] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:55.162092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.164334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ce466f6d7647acbc9b22100d650827, user_id=206add31be9e488b8b9bb32b598835e3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.167840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:55.171134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.200600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3322/6611] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:55 2022] PUT /identity/v3/projects/e9ce466f6d7647acbc9b22100d650827/users/206add31be9e488b8b9bb32b598835e3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:55.201994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.271610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a1774-4eb1-4ef9-bb97-79983d9a706c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.284410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a2bd-0535-4ea6-9a8a-006144513152 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.298546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.300137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.300663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.301322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] PATH_INFO: `/v3/projects/6436f84072154ceb9c1520cb7b048325/users/fc42a499260c419c8b082b64e13123c1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.305850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6436f84072154ceb9c1520cb7b048325, user_id=fc42a499260c419c8b082b64e13123c1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.310059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58aa11-0714-491a-92b7-06ba32aef8b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.332854 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:55.334800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3323/6612] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:55 2022] PUT /identity/v3/projects/6436f84072154ceb9c1520cb7b048325/users/fc42a499260c419c8b082b64e13123c1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:55.337299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.337871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.338702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.347558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.348196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.348732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.349138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.375489 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:55.379237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] MFA Rules not processed for user `206add31be9e488b8b9bb32b598835e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:55.381754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:55.443302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.446089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0851a1-87a9-4553-ad43-2240eb45aa64 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.459525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3290/6613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:55.461236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.461559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.461833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.480488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3324/6614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:55.487239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.488725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:55.530049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] MFA Rules not processed for user `fc42a499260c419c8b082b64e13123c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:55.531269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:55.640949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb3bf8-6a1e-4fcd-a86b-7afc2f99f514 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.652837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.653616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.654107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.654441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.674988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.676812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.696357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3325/6615] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:55.704282 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3291/6616] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:55.722918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:55.753743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bfb77-0ae0-42e7-9a45-68e85d01cd6f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:55.770021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:55.773655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:55.774522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:55.775228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:55.805152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:55.810313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77477fad-371f-4f25-b01b-95a68c711e6b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:55.825977 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3326/6617] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:56.525841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:56.650882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a49ef8-c03a-48e7-b8b7-2d264448488d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:56.658577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:56.659999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:56.660280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:56.661751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] PATH_INFO: `/v3/users/47326c399b0044218ebd30119c958ede` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:56.664642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47326c399b0044218ebd30119c958ede)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:56.668258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:56.699350 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:56.768877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47326c399b0044218ebd30119c958ede'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:56.770292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47326c399b0044218ebd30119c958ede'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:56.784600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47326c399b0044218ebd30119c958ede'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:56.802073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47326c399b0044218ebd30119c958ede'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:56.803777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47326c399b0044218ebd30119c958ede'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:56.823309 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3292/6618] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:56 2022] DELETE /identity/v3/users/47326c399b0044218ebd30119c958ede => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:56.828378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:56.828983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:56.828983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:56.866371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:56.867777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:57.030104 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3327/6619] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:57.056230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:57.057871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:57.155380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64658bd-ad35-4467-b7e7-d58af7df1367 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:57.159743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:57.160509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:57.160793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:57.161123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:57.173628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:57.176568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d245db-0759-411b-bd5f-2acfa8ada62b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:57.193260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3293/6620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:26:58.103848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.105464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:58.141717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dab2d-f487-4974-a47f-20e5462d8dc0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.154260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.154607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.155059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.162938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] PATH_INFO: `/v3/projects/8f8660f9c95a409c8b01dc581e8ff4a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.166570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8660f9c95a409c8b01dc581e8ff4a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.167473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.219379 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:58.247285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8660f9c95a409c8b01dc581e8ff4a8', 'request_id': 'req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.258616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8660f9c95a409c8b01dc581e8ff4a8', 'request_id': 'req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.266103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8660f9c95a409c8b01dc581e8ff4a8', 'request_id': 'req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.280886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] The token cache is being invalidate because project 8f8660f9c95a409c8b01dc581e8ff4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:26:58.281257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.282019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22a9e8ed-57b7-4c85-ba17-0a45eee7df42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.283728 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3328/6621] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:26:58 2022] DELETE /identity/v3/projects/8f8660f9c95a409c8b01dc581e8ff4a8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:58.288570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.289077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.289196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.309033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:58.310270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:58.392646 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3294/6622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:58.394503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.394804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.395313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.429449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:58.430827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:58.442592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3329/6623] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:26:58.445361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.455976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cde42-3b42-4deb-bc59-7aeb6a6332f7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.462433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.463020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.463306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.463753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.464429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:26:58.464806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.466621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.491256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3295/6624] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:26:58.491922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.501653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc057a-cb47-4195-995c-fa7116be53dc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.507498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.508158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.508438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.508706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.509337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.511339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.546098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3330/6625] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:26:58.552442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.563254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a88ee-04a9-4451-bf40-a6807728624f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.627343 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:58.696176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.697015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.697390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.697902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.698724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.701158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.737941 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3296/6626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:26:58.743875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.745321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.747686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:58.765187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b597a-b04e-42eb-9830-a5ebc5ac744a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.765751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a749d5-feb5-421e-a933-9051ff2a276f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.772696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.774190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.774324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.774626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] PATH_INFO: `/v3/users/17e45075b3ca4407a8372ac0c96c5481` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.776898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e45075b3ca4407a8372ac0c96c5481)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.777049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.779499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.780063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.780429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.780842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.781560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.783897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.797787 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3331/6627] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:26:58.799179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.811838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102b4b-65ba-4f12-b52f-a9384b19facb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.818029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.820323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.820323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.820596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.821855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.824525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.838196 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3332/6628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:26:58.841955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:58.848562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e45075b3ca4407a8372ac0c96c5481'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.850216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e45075b3ca4407a8372ac0c96c5481'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.854337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a7fa-9ac8-43f7-bfbd-f5eed40b0e9c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:58.860214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e45075b3ca4407a8372ac0c96c5481'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.866960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:58.868118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.868662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.869790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] PATH_INFO: `/v3/projects/8ba2a8f23ccc4faabd700f0cd9c106c9/users/0ddaad00a21b47afaf9798c9afb8d8f0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.897220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e45075b3ca4407a8372ac0c96c5481'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.898734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0a65b4bf-daaa-45e7-a0f6-c8ac957cf9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e45075b3ca4407a8372ac0c96c5481'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:26:58.909656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba2a8f23ccc4faabd700f0cd9c106c9, user_id=0ddaad00a21b47afaf9798c9afb8d8f0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:58.912450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3386b0-892c-4d1a-8f9d-04d1af4e7d11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:58.919580 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3297/6629] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:26:58 2022] DELETE /identity/v3/users/17e45075b3ca4407a8372ac0c96c5481 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:58.924393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.924699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.925117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.940078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3333/6630] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:26:58 2022] PUT /identity/v3/projects/8ba2a8f23ccc4faabd700f0cd9c106c9/users/0ddaad00a21b47afaf9798c9afb8d8f0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:26:58.951136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:58.951339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:58.951599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:58.960348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:58.961730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:58.994269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] MFA Rules not processed for user `0ddaad00a21b47afaf9798c9afb8d8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:26:58.995693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:59.048327 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3298/6631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:59.059755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:59.061291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:59.095991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3334/6632] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:26:59.107895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:26:59.110512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:26:59.125331 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:59.170399 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:59.203773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8c3f0-b7d5-4c11-a5e8-5781be2dc195 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:59.209122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871f444-47e7-4f42-82bd-4bdf5d91a3be None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:26:59.214550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:59.214771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:26:59.215284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:59.215901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:59.216581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:26:59.216713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:59.216936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:26:59.217227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:26:59.228698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:59.230335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:59.244493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3335/6633] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:26:59.249887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:26:59.251371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:26:59.268810 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3299/6634] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:00.160739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:00.162359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:00.190709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748977e-cca9-4fd2-be8a-88075c94bd89 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:00.225263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:00.225958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:00.226244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:00.226514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] PATH_INFO: `/v3/projects/f814a99b3013415e8c0815fbb8581a47` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:00.231373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f814a99b3013415e8c0815fbb8581a47)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:00.233681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:00.356976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f814a99b3013415e8c0815fbb8581a47', 'request_id': 'req-96b3a79b-499c-48fb-8bd8-07d943db4218'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.369983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f814a99b3013415e8c0815fbb8581a47', 'request_id': 'req-96b3a79b-499c-48fb-8bd8-07d943db4218'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.382686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f814a99b3013415e8c0815fbb8581a47', 'request_id': 'req-96b3a79b-499c-48fb-8bd8-07d943db4218'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.402956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] The token cache is being invalidate because project f814a99b3013415e8c0815fbb8581a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:00.403383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.404327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.406962 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3336/6635] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:00 2022] DELETE /identity/v3/projects/f814a99b3013415e8c0815fbb8581a47 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:00.410675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:00.424156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c477d6-9aba-492f-af79-2b2c742d04b6 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:00.518609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:00.519543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:00.519932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:00.520385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] PATH_INFO: `/v3/users/fc42a499260c419c8b082b64e13123c1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:00.522643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc42a499260c419c8b082b64e13123c1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:00.525129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:00.627692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc42a499260c419c8b082b64e13123c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.628898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc42a499260c419c8b082b64e13123c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.648127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc42a499260c419c8b082b64e13123c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.682987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc42a499260c419c8b082b64e13123c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.686443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4783856d-e58a-49de-8e16-adfb87b40fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc42a499260c419c8b082b64e13123c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:00.714083 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3300/6636] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:00 2022] DELETE /identity/v3/users/fc42a499260c419c8b082b64e13123c1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:01.192831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:01.195178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:01.223641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a79b-499c-48fb-8bd8-07d943db4218 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:01.328049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:01.329496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:01.330628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:01.330628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] PATH_INFO: `/v3/projects/6436f84072154ceb9c1520cb7b048325` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:01.331512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6436f84072154ceb9c1520cb7b048325)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:01.338239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:01.483098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6436f84072154ceb9c1520cb7b048325', 'request_id': 'req-f566c31f-38d2-482b-a651-9bad2f33a6e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:01.498887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6436f84072154ceb9c1520cb7b048325', 'request_id': 'req-f566c31f-38d2-482b-a651-9bad2f33a6e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:01.509818 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:01.513554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6436f84072154ceb9c1520cb7b048325', 'request_id': 'req-f566c31f-38d2-482b-a651-9bad2f33a6e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:01.531126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] The token cache is being invalidate because project 6436f84072154ceb9c1520cb7b048325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:01.531488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:01.532113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f566c31f-38d2-482b-a651-9bad2f33a6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:01.534350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3337/6637] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:01 2022] DELETE /identity/v3/projects/6436f84072154ceb9c1520cb7b048325 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:01.539937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:01.541625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:01.542177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:01.575436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:01.577977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:01.654482 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:01.691188 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3301/6638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:01.699210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:01.699736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:01.701592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:01.736881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:01.742222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:01.770967 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3338/6639] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:01.773021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:01.800867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da47f2-14fc-43b8-9b4d-ae8f2de6c8e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:01.834977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:01.836191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:01.838859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:01.839179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:01.839849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:01.843167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:01.846363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:01.888930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3302/6640] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:27:01.891816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:01.907120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc018be-8af8-4f64-936c-34384034a8b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:01.928125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:01.928763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:01.929548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:01.929850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:01.930519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:01.932467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:01.981450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3339/6641] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:01 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:01.985677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.002801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52d93-f5c9-4e04-aab3-bbf901bd1282 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.127722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.128390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.129230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.129230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.129621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.132214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.184073 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3303/6642] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:01 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:02.187237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.206784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609082a-129b-479d-af5d-501cd596f92d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.220504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.222059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.222337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.222605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.223597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.225518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.248676 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3340/6643] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:02.252576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.281122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921e28f-d802-4bcd-9672-506e1664a2be admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.300533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.301766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.302056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.302327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.303811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.305337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6f51-edbf-4bfe-a93e-32079ed5c6c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.340175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3304/6644] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:02.342316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.355300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396de5a-f322-4c67-8dd3-87f12e123abf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.398754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.399945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.402119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.403890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] PATH_INFO: `/v3/projects/630da1b1394a44eca31c6ac38931442a/users/3c804285e370452492accd3a4c178937/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.487017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630da1b1394a44eca31c6ac38931442a, user_id=3c804285e370452492accd3a4c178937, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.490100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.526262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3341/6645] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:02 2022] PUT /identity/v3/projects/630da1b1394a44eca31c6ac38931442a/users/3c804285e370452492accd3a4c178937/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:02.526910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.527194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.527472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.564429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] MFA Rules not processed for user `3c804285e370452492accd3a4c178937`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:02.566613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:02.701058 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3305/6646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:02.705376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.779621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5da2-c2a0-4634-99d8-e4d42ada20a7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.784894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.785533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.785814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.786080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.786729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.789622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.839283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3342/6647] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:02 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:02.841444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:02.860539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ca4c8-43f6-455d-9ce3-c023f18c124b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:02.944903 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:02.959480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:02.960253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:02.960543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:02.960820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:02.961665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:02.963619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:02.987663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3306/6648] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:02 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:02.993240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:03.007621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e4f23-002f-466c-aee0-bb45ba367a3f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:03.014533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:03.015700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.015700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.015700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.016341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:03.018428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:03.030722 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3343/6649] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:03.034987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:03.047507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a88be8-d91e-4f84-9961-af3b7794b987 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:03.054748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:03.055511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.055864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.056212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] PATH_INFO: `/v3/projects/22ca222215ca415ba8e938a72232f773/users/c10f8c3ea9a84219b2173e168298109e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.075183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca222215ca415ba8e938a72232f773, user_id=c10f8c3ea9a84219b2173e168298109e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:03.078939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:03.106938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3307/6650] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:03 2022] PUT /identity/v3/projects/22ca222215ca415ba8e938a72232f773/users/c10f8c3ea9a84219b2173e168298109e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:03.113229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:03.137354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0e7d-ef9a-47be-8f3e-b458b3212eb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:03.253831 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:03.274296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:03.274962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.275247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.275526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.276336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:03.278038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a6af-ab0b-420f-aa38-c52e5b574c31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:03.306636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:03.320188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac0014-ac6c-4abc-9184-791bb7e8f814 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:03.322365 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3344/6651] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:03.332676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:03.333384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.335855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.336376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] PATH_INFO: `/v3/projects/22ca222215ca415ba8e938a72232f773/users/c10f8c3ea9a84219b2173e168298109e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.341085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca222215ca415ba8e938a72232f773, user_id=c10f8c3ea9a84219b2173e168298109e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:03.347050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:03.389811 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3308/6652] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:03 2022] PUT /identity/v3/projects/22ca222215ca415ba8e938a72232f773/users/c10f8c3ea9a84219b2173e168298109e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:03.391984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.391984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.391984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.473020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] MFA Rules not processed for user `c10f8c3ea9a84219b2173e168298109e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:03.474645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:03.618295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3345/6653] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:03.642209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:03.648077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:03.841696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fc093-6949-411b-88a3-4a610ac3b298 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:03.865159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:03.866120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:03.866411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:03.866926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:03.900410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:03.902950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35a51-3743-40f8-af7f-e5edd317ca4d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:03.942896 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3309/6654] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:09.778532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:09.941833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18030-4978-487a-83d0-9bf340e2176c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:09.957927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:09.965051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:09.965850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:09.969631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] PATH_INFO: `/v3/users/3c804285e370452492accd3a4c178937` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:09.972084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c804285e370452492accd3a4c178937)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:09.980096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:10.176345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c804285e370452492accd3a4c178937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:10.245848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c804285e370452492accd3a4c178937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:10.298495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c804285e370452492accd3a4c178937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:10.299258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c804285e370452492accd3a4c178937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:10.299872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c804285e370452492accd3a4c178937'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:10.331601 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:10.359224 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3346/6655] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:09 2022] DELETE /identity/v3/users/3c804285e370452492accd3a4c178937 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:10.361054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:10.361579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:10.361993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:10.405370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:10.407056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:10.522884 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3310/6656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:10.534714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:10.536914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:10.620745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59aac-421c-47ba-9f5f-f220369b5965 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:10.625264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:10.626197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:10.626729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:10.627245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:10.638709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:10.640498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:10.664376 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3347/6657] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:11.115360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:11.116888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:11.130662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3500d1-9601-4a4a-b417-5c6f9c98af06 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:11.136545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:11.137302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:11.137732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:11.139469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] PATH_INFO: `/v3/projects/630da1b1394a44eca31c6ac38931442a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:11.139619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630da1b1394a44eca31c6ac38931442a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:11.141718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:11.200976 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:11.210712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630da1b1394a44eca31c6ac38931442a', 'request_id': 'req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.218153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630da1b1394a44eca31c6ac38931442a', 'request_id': 'req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.223970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630da1b1394a44eca31c6ac38931442a', 'request_id': 'req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.255823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] The token cache is being invalidate because project 630da1b1394a44eca31c6ac38931442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:11.256298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.257108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.259540 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3311/6658] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:11 2022] DELETE /identity/v3/projects/630da1b1394a44eca31c6ac38931442a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:11.263418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:11.276031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f914d-cc1c-4bdb-87ae-a8999d65fb35 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:11.357172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:11.357866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:11.358150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:11.358422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] PATH_INFO: `/v3/users/c10f8c3ea9a84219b2173e168298109e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:11.359567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10f8c3ea9a84219b2173e168298109e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:11.361764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:11.459003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10f8c3ea9a84219b2173e168298109e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.475086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10f8c3ea9a84219b2173e168298109e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.491350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10f8c3ea9a84219b2173e168298109e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.492673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10f8c3ea9a84219b2173e168298109e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.494206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ba4d4fb-dadf-4efc-86f6-28bd7d917c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10f8c3ea9a84219b2173e168298109e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:11.517059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3348/6659] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:11 2022] DELETE /identity/v3/users/c10f8c3ea9a84219b2173e168298109e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:11.764458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:11.767254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:11.792608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1b5c9-dd4a-4254-841f-38a2b42d3fe1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:11.949997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:11.953636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:11.955992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:11.956532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] PATH_INFO: `/v3/projects/22ca222215ca415ba8e938a72232f773` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:11.958125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ca222215ca415ba8e938a72232f773)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:11.960656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:12.049679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ca222215ca415ba8e938a72232f773', 'request_id': 'req-c186e6d7-fddc-41df-afd5-318aebbbed6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:12.081812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ca222215ca415ba8e938a72232f773', 'request_id': 'req-c186e6d7-fddc-41df-afd5-318aebbbed6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:12.088925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ca222215ca415ba8e938a72232f773', 'request_id': 'req-c186e6d7-fddc-41df-afd5-318aebbbed6c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:12.108983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] The token cache is being invalidate because project 22ca222215ca415ba8e938a72232f773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:12.109581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:12.110595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c186e6d7-fddc-41df-afd5-318aebbbed6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:12.117944 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3312/6660] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:11 2022] DELETE /identity/v3/projects/22ca222215ca415ba8e938a72232f773 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:12.123307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:12.123683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:12.124673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:12.157222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:12.158616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:12.179499 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:12.617907 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3349/6661] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:12.618555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:12.618801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:12.619053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:12.664143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:12.668416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:12.689259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3313/6662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:27:12.693865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:12.708770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b652bee-8779-40fb-9587-fbd20cbf5c6f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:12.718812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:12.719876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:12.720257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:12.720632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:12.723794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:12.724802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:12.730114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:12.758819 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3350/6663] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:27:12.763523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:12.779645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4523-aaf2-4844-a974-1eb33ce5873c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:12.793349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:12.795532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:12.796542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:12.796957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:12.799046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:12.805582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:12.870583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3314/6664] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:12 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:12.874980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:12.888973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:12.891802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:12.901027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4737e7-83b7-40a1-9172-0af07678d357 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:12.989461 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:13.074056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.074693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.074970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.075240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.077134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.078034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.111230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3641b-eee0-4b5a-9c34-723551a2f811 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.131375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3351/6665] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:12 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:13.135458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:13.136033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.136700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.136983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.137260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] PATH_INFO: `/v3/users/0ddaad00a21b47afaf9798c9afb8d8f0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.138468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddaad00a21b47afaf9798c9afb8d8f0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.140442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.152394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3344b-71ef-4a28-928f-c01467d4c2f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.158271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.159386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.159670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.159986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.160651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.165478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.188443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3352/6666] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:13.192407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:13.212753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca017-61bd-45f7-83f6-64a364ba1ab1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.219749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.220466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.220853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.221229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.222038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.225385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.239322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3353/6667] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:13.243941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:13.247075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddaad00a21b47afaf9798c9afb8d8f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:13.252242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddaad00a21b47afaf9798c9afb8d8f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:13.261452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf036948-905c-402a-8603-547e990d2a3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.267833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.268911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.270095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.270547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] PATH_INFO: `/v3/projects/77536d7b35e34f7ba78fe5b0bb1cc97d/users/58f25295b4324e4ebe7e8b589f95eac0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.275143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddaad00a21b47afaf9798c9afb8d8f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:13.293171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77536d7b35e34f7ba78fe5b0bb1cc97d, user_id=58f25295b4324e4ebe7e8b589f95eac0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.296446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671849fb-be6a-4a14-858b-d410295ada0b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.303052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddaad00a21b47afaf9798c9afb8d8f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:13.304150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-551e17ab-a47c-4192-ad57-6bbec5b4a8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddaad00a21b47afaf9798c9afb8d8f0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:13.359218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3354/6668] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:13 2022] PUT /identity/v3/projects/77536d7b35e34f7ba78fe5b0bb1cc97d/users/58f25295b4324e4ebe7e8b589f95eac0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:13.372456 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3315/6669] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:12 2022] DELETE /identity/v3/users/0ddaad00a21b47afaf9798c9afb8d8f0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:27:13.377287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.377622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.377896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.379495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.379797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.380071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.430617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:13.431858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:13.456975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] MFA Rules not processed for user `58f25295b4324e4ebe7e8b589f95eac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:13.457931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:13.539065 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:13.568452 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3316/6670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:13.576251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:13.580289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:13.583083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3355/6671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:13.666097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:13.669587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:13.690670 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:13.704988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681bc2-4cbe-46f8-9458-2a40d1cd7861 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.712970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.714041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.715114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.716174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.732843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.734905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.767123 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3317/6672] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:13.801128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43db8d-48de-45e3-8b96-17f9fdbabe7c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:13.805724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:13.806296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:13.806572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:13.806841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:13.818347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:13.820777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0500d9-472a-439b-ab52-d7816ea9bf97 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:13.831704 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3356/6673] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:14.007799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.009459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:14.026425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4a04-3273-49cf-b545-e89ec32dec1c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.032071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.033805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.034272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.034999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] PATH_INFO: `/v3/projects/8ba2a8f23ccc4faabd700f0cd9c106c9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.037170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba2a8f23ccc4faabd700f0cd9c106c9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.041443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.122842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba2a8f23ccc4faabd700f0cd9c106c9', 'request_id': 'req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.131113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba2a8f23ccc4faabd700f0cd9c106c9', 'request_id': 'req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.142240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba2a8f23ccc4faabd700f0cd9c106c9', 'request_id': 'req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.200276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] The token cache is being invalidate because project 8ba2a8f23ccc4faabd700f0cd9c106c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:14.217032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.222216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b3266be-10da-40e4-a0c4-35ebce1fd9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.225018 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3318/6674] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:14 2022] DELETE /identity/v3/projects/8ba2a8f23ccc4faabd700f0cd9c106c9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:27:14.230416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.230781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.230995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.276394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:14.278267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:14.396842 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3357/6675] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:14.405880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.406278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.406650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.437148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:14.439061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:14.457725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.492376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3319/6676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:14.498473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c311-04fe-4d38-bb74-eebbacca7b3e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.514432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.516188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.516723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.517189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.518305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:14.519797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.525021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.559593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3358/6677] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:27:14.563094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.579503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155b75-e0e4-4b44-8def-7a70114880b0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.599920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.602270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.603641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.604013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.604799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.611083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.657803 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3320/6678] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:14.658765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.670512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595263a-903a-4430-85a6-148661a5d95a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.743253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.744226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.744892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.745331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.746165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.749738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.771082 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:14.778162 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3359/6679] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:27:14.782454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.800695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545117-2e45-4bcb-8593-cd7037051921 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.808048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.809984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:14.812879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.813653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.813933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.814207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.814855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.816461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.835714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb367e5a-833d-4f2c-b7cf-d2b8a47942b8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.842439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.844347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.844665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.844923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] PATH_INFO: `/v3/users/206add31be9e488b8b9bb32b598835e3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.845624 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3321/6680] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:14.846570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.848441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=206add31be9e488b8b9bb32b598835e3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.851227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.869145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd237c-db79-48f3-80ba-b7b0d1be9b33 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.874575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.875318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.875695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.876065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.876829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.878714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.891671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3322/6681] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:14.896545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:14.908411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887886cd-bf7f-48dc-a99e-7e7e9b69adf6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:14.916974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:14.917855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.918140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.918561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] PATH_INFO: `/v3/projects/482cd6517cde4fddb2b52c10a4be29ff/users/32bdc8b9822b40fcbdd5fd0a85eb39a6/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.938572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482cd6517cde4fddb2b52c10a4be29ff, user_id=32bdc8b9822b40fcbdd5fd0a85eb39a6, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:14.941725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a52a4-0196-494c-81e3-77aae5137687 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:14.942679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206add31be9e488b8b9bb32b598835e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.955516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206add31be9e488b8b9bb32b598835e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.970299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3323/6682] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:14 2022] PUT /identity/v3/projects/482cd6517cde4fddb2b52c10a4be29ff/users/32bdc8b9822b40fcbdd5fd0a85eb39a6/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:14.971246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206add31be9e488b8b9bb32b598835e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.972189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206add31be9e488b8b9bb32b598835e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.972566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.972957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.973341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-76f997e0-1207-4315-9a9d-72711d53c160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206add31be9e488b8b9bb32b598835e3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:14.973630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:14.993063 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3360/6683] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:14 2022] DELETE /identity/v3/users/206add31be9e488b8b9bb32b598835e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:27:14.997316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:14.998133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:14.998813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:15.010273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] MFA Rules not processed for user `32bdc8b9822b40fcbdd5fd0a85eb39a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:15.012815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:15.046900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:15.048955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:15.085253 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:15.123327 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3324/6684] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:15.131869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:15.135611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:15.175128 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3361/6685] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:15.185910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:15.187471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:15.231508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c0ebc-9a5c-466a-8ca1-b0afe5d092aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:15.237118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:15.238331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:15.238636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:15.238886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:15.268280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:15.270249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:15.302627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3325/6686] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:15.329646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea9db-39a9-47a1-8c88-203f3fbb4205 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:15.341985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:15.342720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:15.343105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:15.343636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:15.356412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:15.358027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103289-6df8-4c2f-acb6-c61d5bd8646d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:15.371757 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3362/6687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:27:15.985541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:15.987278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:16.026542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9eb30-b62e-4471-b6a2-cff41180b758 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:16.043486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:16.044143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:16.044424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:16.044700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] PATH_INFO: `/v3/projects/e9ce466f6d7647acbc9b22100d650827` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:16.045899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ce466f6d7647acbc9b22100d650827)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:16.047816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:16.196686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ce466f6d7647acbc9b22100d650827', 'request_id': 'req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:16.204436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ce466f6d7647acbc9b22100d650827', 'request_id': 'req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:16.219644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ce466f6d7647acbc9b22100d650827', 'request_id': 'req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:16.246682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] The token cache is being invalidate because project e9ce466f6d7647acbc9b22100d650827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:16.247060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:16.248276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e35d9bbd-d39d-40e2-bb5c-11f9cf82edc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:16.256294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3326/6688] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:15 2022] DELETE /identity/v3/projects/e9ce466f6d7647acbc9b22100d650827 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:16.261013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:16.261875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:16.262323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:16.313849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:16.315282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:16.365198 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:16.549828 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3363/6689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:16.563491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:16.563965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:16.564301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:16.672323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:16.673946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:16.702710 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3327/6690] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:16.706535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:16.717246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be04ac-d34d-4134-bee2-5590acffba9d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:16.753040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:16.753713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:16.754184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:16.754623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:16.755748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:16.756317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:16.758159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:16.820322 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3364/6691] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:27:16.824361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:16.838283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d48f-66c3-4549-a163-5b8dbdd8d5fc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:16.858226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:16.858866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:16.859154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:16.859433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:16.860097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:16.866026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:16.925338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3328/6692] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:16.929227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:16.947953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a753-a2ba-40f0-b790-e29dba15e8ce admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:17.116441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:17.117067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.117345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.117679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.118326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:17.120232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:17.179502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3365/6693] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:16 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:17.181512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:17.220654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9ac08-bfa0-4095-a959-fff507cc6b82 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:17.244049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:17.245111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.245437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.248711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.252883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:17.262959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:17.299169 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3329/6694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:17.300451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:17.314743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aae6-6241-49d5-a814-57b09eea9f8c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:17.327078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:17.327716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.327992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.328467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.329487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:17.331910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8f6e1-bd7a-412e-9b89-25e7651a4086 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:17.358976 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3366/6695] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:27:17.363456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:17.378005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2ee8-c4ed-404b-b62d-5b5821158247 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:17.396453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:17.397510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.397905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.398292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] PATH_INFO: `/v3/projects/2f4229cfef9549dfa75fd9ed73322326/users/610e18eeab4844619a1a1b464b0900d3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.439983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4229cfef9549dfa75fd9ed73322326, user_id=610e18eeab4844619a1a1b464b0900d3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:17.443364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:17.478340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3330/6696] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:17 2022] PUT /identity/v3/projects/2f4229cfef9549dfa75fd9ed73322326/users/610e18eeab4844619a1a1b464b0900d3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:17.479917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3591-197f-402c-ab19-5d5d54454eeb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.480203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3591-197f-402c-ab19-5d5d54454eeb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.480595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3591-197f-402c-ab19-5d5d54454eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.555466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e44f3591-197f-402c-ab19-5d5d54454eeb None None] MFA Rules not processed for user `610e18eeab4844619a1a1b464b0900d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:17.558654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e44f3591-197f-402c-ab19-5d5d54454eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:17.717452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3367/6697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:17.758063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:17.760204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:17.797257 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:17.879270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64659431-a9d2-4672-b651-56ef22ecbe3c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:17.905870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:17.906785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:17.907251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:17.907684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:17.932545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:17.934330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:17.951953 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3331/6698] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:21.442440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:21.443619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:21.443850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:21.495471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:21.500042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:21.519259 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:21.700020 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3368/6699] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:21.715286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:21.717671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:21.874237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99080-c971-4a2a-ab7e-a3a3197d0eef service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:21.886814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:21.889788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:21.890335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:21.891759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:21.918153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:21.920572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:21.951082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3332/6700] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:24.708300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:24.709828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:24.970334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f30d2-5883-4e3d-8076-286f0301875d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:25.011798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:25.012450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:25.012735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:25.013005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:25.027235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:25.094065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:25.107570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a025-cf6d-444f-b61b-6d36ef067f0d service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:25.127452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3369/6701] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:31.931674 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=53 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:33.033913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:33.041383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:33.252874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a69cf-3f55-463b-8f26-8d9601aa7f4c service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:33.267542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:33.268515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:33.273853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:33.274455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] PATH_INFO: `/v3/users/32bdc8b9822b40fcbdd5fd0a85eb39a6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:33.276322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bdc8b9822b40fcbdd5fd0a85eb39a6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:33.279688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:33.358482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bdc8b9822b40fcbdd5fd0a85eb39a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:33.359940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bdc8b9822b40fcbdd5fd0a85eb39a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:33.371836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bdc8b9822b40fcbdd5fd0a85eb39a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:33.428583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bdc8b9822b40fcbdd5fd0a85eb39a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:33.429349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bdc8b9822b40fcbdd5fd0a85eb39a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:33.447299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3333/6702] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:33 2022] DELETE /identity/v3/users/32bdc8b9822b40fcbdd5fd0a85eb39a6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:33.451925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:33.452425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:33.452580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:33.487610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:33.492194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:33.613494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3370/6703] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:33.624019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:33.626130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:33.798112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6cba4-0ac7-4da6-b432-de8638f3d29d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:33.812652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:33.813816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:33.814978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:33.814978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:33.856663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:33.859334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b622472-7c0b-4d74-8add-2a3df6bed561 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:33.901239 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3334/6704] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:34.486060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:34.488368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:34.527533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9adb-b986-4dad-b186-30a2c8076b67 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:34.547081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:34.548166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:34.548637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:34.549141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] PATH_INFO: `/v3/projects/482cd6517cde4fddb2b52c10a4be29ff` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:34.562840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482cd6517cde4fddb2b52c10a4be29ff)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:34.566747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:34.701845 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:34.719035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482cd6517cde4fddb2b52c10a4be29ff', 'request_id': 'req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:34.746869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482cd6517cde4fddb2b52c10a4be29ff', 'request_id': 'req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:34.761754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482cd6517cde4fddb2b52c10a4be29ff', 'request_id': 'req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:34.813042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] The token cache is being invalidate because project 482cd6517cde4fddb2b52c10a4be29ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:34.813561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:34.814689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84ea3e51-86d6-4ccf-90fd-f8054bc860e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:34.817161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3371/6705] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:34 2022] DELETE /identity/v3/projects/482cd6517cde4fddb2b52c10a4be29ff => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:34.823163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:34.824665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:34.825380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:34.886001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:34.887898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:34.921241 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:35.031197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3335/6706] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:35.040069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.040815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.041277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.082455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:35.084966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:35.122208 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3372/6707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:35.126263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.144061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9712aed-b731-4fa2-909c-19c3d443d0d3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.162057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.163021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.163502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.163960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.164806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:35.165280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.167146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.192602 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3336/6708] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:27:35.197601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.212936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209222ad-a6a4-4342-acd1-c7a1982a662f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.225452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.226099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.226373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.226642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.230020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.246571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.326060 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3373/6709] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:35 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:35.327148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.343257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4df5-4cda-491e-919e-cfb488a076da admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.492347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.493313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.493887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.494473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.496176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.498971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.573785 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3337/6710] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:35 2022] POST /identity/v3/users => generated 280 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:35.577368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.594424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b512-9f3e-442a-aa5e-8754bbc9bf24 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.604941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.606148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.606691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.607133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.608121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.610559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.625835 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3374/6711] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:35.631771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.647973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3c984-1e0c-4012-b56f-cdfdf6b32e21 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.664557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.665322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.665559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.665844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.666503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.669615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca60c2-50e0-4c0c-8360-a62277bbb76b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.715782 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3338/6712] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:35.718953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:35.739157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc036-4b44-4d2e-9b1b-126d24b333e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:35.747812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:35.750624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.750890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.751175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] PATH_INFO: `/v3/projects/14e59956d0274675812f52e11884bf64/users/b5ba12d75e1748298b10cbf02fb7f3bd/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.798437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e59956d0274675812f52e11884bf64, user_id=b5ba12d75e1748298b10cbf02fb7f3bd, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:35.801684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:35.848793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3375/6713] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:35 2022] PUT /identity/v3/projects/14e59956d0274675812f52e11884bf64/users/b5ba12d75e1748298b10cbf02fb7f3bd/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:27:35.860798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:35.861270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:35.862130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:35.911915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] MFA Rules not processed for user `b5ba12d75e1748298b10cbf02fb7f3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:35.913914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:36.032596 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3339/6714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:36.048653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:36.052247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:36.124603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e290c-16e4-4776-9e82-88b4ec7a31af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:36.132156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:36.132886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:36.133249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:36.133875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:36.144810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:36.146102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:36.159876 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3376/6715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:46.028769 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:46.154771 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:46.588680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:46.602719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9af57-b380-472a-9a57-831767bb1a7d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:46.606672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:46.607571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:46.608149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:46.609301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:46.611566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:46.708239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:46.710973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:46.735507 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3340/6716] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:49.107421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:49.109213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:49.131276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca6cb-b8e7-4fff-96ef-2731de5a64b9 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:49.136073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:49.136734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:49.137237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:49.137860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] PATH_INFO: `/v3/users/2f080bae0ec94a5b88128dd69c8a3e74` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:49.139055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f080bae0ec94a5b88128dd69c8a3e74)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:49.143543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:49.208526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f080bae0ec94a5b88128dd69c8a3e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.218886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f080bae0ec94a5b88128dd69c8a3e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.238298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f080bae0ec94a5b88128dd69c8a3e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.239524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f080bae0ec94a5b88128dd69c8a3e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.241397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f080bae0ec94a5b88128dd69c8a3e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.272258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3377/6717] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:49 2022] DELETE /identity/v3/users/2f080bae0ec94a5b88128dd69c8a3e74 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:49.725333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:49.757927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114f91a-481b-4dbc-adc0-124172ce9eb7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:49.883023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:49.884537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:49.885022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:49.885503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] PATH_INFO: `/v3/projects/31367060596548b59603860aafed267f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:49.886908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31367060596548b59603860aafed267f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:49.889307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:49.965152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31367060596548b59603860aafed267f', 'request_id': 'req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.974749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31367060596548b59603860aafed267f', 'request_id': 'req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.981596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31367060596548b59603860aafed267f', 'request_id': 'req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.997312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] The token cache is being invalidate because project 31367060596548b59603860aafed267f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:49.998479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:49.999818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:50.002176 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3341/6718] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:49 2022] DELETE /identity/v3/projects/31367060596548b59603860aafed267f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:51.845680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:51.848197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:51.943031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3fa71-9b23-4e2e-9c07-a7ab8cf885d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:52.046932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:52.047816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:52.048109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:52.048462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:52.051967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:52.199833 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:52.249876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:52.251367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5927b7-3513-4e53-947d-c070a76febe7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:52.266998 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3378/6719] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:56.368852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:56.374701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:56.424062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b6ee-568e-4b9f-aec3-1e498fb7d7e9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:56.435744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:56.437306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:56.438453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:56.438879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] PATH_INFO: `/v3/users/b5ba12d75e1748298b10cbf02fb7f3bd` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:56.443768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ba12d75e1748298b10cbf02fb7f3bd)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:56.447623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:56.498383 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:56.546924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ba12d75e1748298b10cbf02fb7f3bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:56.548406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ba12d75e1748298b10cbf02fb7f3bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:56.573060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ba12d75e1748298b10cbf02fb7f3bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:56.596938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ba12d75e1748298b10cbf02fb7f3bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:56.611767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ba12d75e1748298b10cbf02fb7f3bd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:56.639114 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3342/6720] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:27:56 2022] DELETE /identity/v3/users/b5ba12d75e1748298b10cbf02fb7f3bd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:56.643913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:56.644431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:56.644687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:56.715059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:56.717488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:56.845506 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3379/6721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:56.859457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:56.861752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:56.961000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9ab4-ef1b-4e56-b288-c2b0fd1fa8be admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:56.968733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:56.970173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:56.970948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:56.971605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:56.996005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:56.998503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2445-68f7-48d7-9fcb-bc05c81da7b4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:57.016547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3343/6722] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:27:57.453225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:57.455568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:57.471467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af4338-3d6f-4537-9b79-0e31f3ece203 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:57.478171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:57.479721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:57.480411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:57.480882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] PATH_INFO: `/v3/projects/14e59956d0274675812f52e11884bf64` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:57.483194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e59956d0274675812f52e11884bf64)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:57.486744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:57.575829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e59956d0274675812f52e11884bf64', 'request_id': 'req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:57.586443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e59956d0274675812f52e11884bf64', 'request_id': 'req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:57.596996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e59956d0274675812f52e11884bf64', 'request_id': 'req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:57.618754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] The token cache is being invalidate because project 14e59956d0274675812f52e11884bf64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:27:57.619385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:57.620586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ae4611f3-07d5-4fa1-8f72-dfc4782b2524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:27:57.631691 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3380/6723] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:27:57 2022] DELETE /identity/v3/projects/14e59956d0274675812f52e11884bf64 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:57.633872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:57.634791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:57.635289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:57.676529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:57.679656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:57.795473 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3344/6724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:57.797794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:57.798318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:57.798550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:57.823562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:57.825711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:57.837630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3381/6725] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:57.842332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:57.856069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66d01-d0f5-46e8-a713-91d5db3ca8bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:57.868449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:57.869938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:57.871822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:57.872352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:57.873265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:27:57.873816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:57.876054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:57.901382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3345/6726] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:27:57.906866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:57.918103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd40d-935b-46c4-8020-57a03e67aea7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:57.929749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:57.930770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:57.931296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:57.931807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:57.932749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:57.935107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.016436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3382/6727] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:57 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:58.017840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.033459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658e3e-1a43-4a42-baaa-264484009e24 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.083709 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:58.171135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.175710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.177827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.179414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.180367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.183075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.210547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3346/6728] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:58 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:58.214741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.229712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f964a8-688f-491e-9742-214e1c14748e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.236608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.237599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.238323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.239378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.240402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.243315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.259752 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3383/6729] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:58.264176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.277731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80717f9-9f09-4689-b68f-f8a587440453 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.284583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.286177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.286553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.286729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.287433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.289509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef36d5-e2f3-4595-952e-c0e6a423bbfb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.309040 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3347/6730] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:58.315498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.329327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f583-6c0e-4800-896d-29d59ad5259d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.335256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.336060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.336413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.336928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] PATH_INFO: `/v3/projects/b834faf6ccd346118618d537725be36f/users/29cc824eb5d341fea568dbb05e060292/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.360344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b834faf6ccd346118618d537725be36f, user_id=29cc824eb5d341fea568dbb05e060292, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.364977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.375719 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:58.395799 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3384/6731] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:58 2022] PUT /identity/v3/projects/b834faf6ccd346118618d537725be36f/users/29cc824eb5d341fea568dbb05e060292/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:58.401066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.401636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.402009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.448179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] MFA Rules not processed for user `29cc824eb5d341fea568dbb05e060292`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:58.449677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:58.574756 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3348/6732] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:58.580280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.675036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11b21-b164-4f59-8d9c-1edcb774b60b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.688657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.689743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.689743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.690234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.690988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.694130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.755814 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3385/6733] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:27:58 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:27:58.759731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.776332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038b2ee-1b05-41fb-9ab3-210a0cf60aee None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.902810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.903585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.904415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.904926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.907392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.910333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:58.952000 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3349/6734] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:27:58 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:27:58.956611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:58.976570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6580-e9e7-4386-b719-e42f247ae509 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:58.982550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:58.983225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:58.983509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:58.983782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:58.984818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:58.990310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:59.009660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3386/6735] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:59.009851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:59.026340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca962-09ed-4b77-91a5-1076aacc24dc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:59.031811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:59.032600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:59.032997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:59.033372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] PATH_INFO: `/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c/users/d33a368d77fc4a559eafd4ba69a7d70a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:59.056112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec636569c93e4d9abbfe8ad43d0e854c, user_id=d33a368d77fc4a559eafd4ba69a7d70a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:59.059021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:59.081456 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:59.106663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3350/6736] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:59 2022] PUT /identity/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c/users/d33a368d77fc4a559eafd4ba69a7d70a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:27:59.107616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:59.121015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a410-cfeb-4b65-a063-224e183a7cfa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:59.243875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:59.244645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:59.245318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:59.245728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:59.246719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:59.248876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891dc31-dc99-4ca7-ab6c-5c0b4afbdc5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:59.272445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:59.285593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3387/6737] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:27:59.286953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48981e-7e80-4e32-aaa4-2affea77cb56 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:59.295695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:59.296935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:59.297506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:59.298013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] PATH_INFO: `/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c/users/d33a368d77fc4a559eafd4ba69a7d70a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:59.300930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec636569c93e4d9abbfe8ad43d0e854c, user_id=d33a368d77fc4a559eafd4ba69a7d70a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:59.304399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:59.334992 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3351/6738] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:27:59 2022] PUT /identity/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c/users/d33a368d77fc4a559eafd4ba69a7d70a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:27:59.341147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:59.341489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:59.341746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:59.401864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] MFA Rules not processed for user `d33a368d77fc4a559eafd4ba69a7d70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:27:59.411338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:59.522565 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:59.552682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3388/6739] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:27:59.569567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:27:59.571633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:27:59.842006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979f226-af11-47e4-badc-7464abd26b4f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:27:59.848874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:27:59.849846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:27:59.850292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:27:59.850825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:27:59.875298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:27:59.877082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c661b83-9729-4c24-8a53-c55eb96b8b3c service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:27:59.919381 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3352/6740] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:00.191693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:00.272776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d858fd-1759-4a60-aa86-852a50cfb53e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:00.278792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:00.279541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:00.280036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:00.280529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] PATH_INFO: `/v3/users/29cc824eb5d341fea568dbb05e060292` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:00.282465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cc824eb5d341fea568dbb05e060292)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:00.284761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:00.354337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cc824eb5d341fea568dbb05e060292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.361940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cc824eb5d341fea568dbb05e060292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.383519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cc824eb5d341fea568dbb05e060292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.391358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cc824eb5d341fea568dbb05e060292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.392600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cc824eb5d341fea568dbb05e060292'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.421708 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3389/6741] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:00 2022] DELETE /identity/v3/users/29cc824eb5d341fea568dbb05e060292 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:00.428329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:00.428750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:00.429056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:00.454546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:00.456000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:00.518668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:00.523415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:00.544052 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3353/6742] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:00.555559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:00.559945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:00.628529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a639-fdcb-419c-93c4-5b7ce01a2709 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:00.633198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:00.633973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:00.634344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:00.634677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] PATH_INFO: `/v3/users/c1c655b1afc54b6c98d771d6acf81ee0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:00.635422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75317-3b4e-46ba-9409-584af071be0d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:00.636431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c655b1afc54b6c98d771d6acf81ee0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:00.638526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:00.640834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:00.640834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:00.641169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:00.641556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:00.653668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:00.655496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56686-b947-4e2d-8e32-a7c47bb083a4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:00.659242 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:00.674874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3354/6743] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:00.711176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c655b1afc54b6c98d771d6acf81ee0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.723388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c655b1afc54b6c98d771d6acf81ee0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.750279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c655b1afc54b6c98d771d6acf81ee0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.751199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c655b1afc54b6c98d771d6acf81ee0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.751960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c655b1afc54b6c98d771d6acf81ee0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:00.778982 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3390/6744] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:00 2022] DELETE /identity/v3/users/c1c655b1afc54b6c98d771d6acf81ee0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:28:01.202498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.203180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.203180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.219383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:01.221728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.254899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] MFA Rules not processed for user `88a281617be64d1b85a6b7d8a708876a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:01.256633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.386437 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:01.425592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf479-debf-4e49-916d-9f468b63c460 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:01.440615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:01.441531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.441935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.442315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] PATH_INFO: `/v3/projects/b834faf6ccd346118618d537725be36f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.443604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b834faf6ccd346118618d537725be36f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:01.444358 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3355/6745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:01.445546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:01.448021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.450520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:01.485764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267515-7633-45a8-97d3-58f0e5363c9f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:01.492665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:01.511987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.512537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.515553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] PATH_INFO: `/v3/projects/5404f5e8a04445d08a69a14616c5e008` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.524322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5404f5e8a04445d08a69a14616c5e008)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:01.529720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:01.556413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b834faf6ccd346118618d537725be36f', 'request_id': 'req-233f3fc6-3909-492c-b032-15aa9819e5d1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.571988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b834faf6ccd346118618d537725be36f', 'request_id': 'req-233f3fc6-3909-492c-b032-15aa9819e5d1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.578971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b834faf6ccd346118618d537725be36f', 'request_id': 'req-233f3fc6-3909-492c-b032-15aa9819e5d1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.616566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] The token cache is being invalidate because project b834faf6ccd346118618d537725be36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:01.616985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.617785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.623889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3391/6746] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:01 2022] DELETE /identity/v3/projects/b834faf6ccd346118618d537725be36f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:28:01.626648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:01.630376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.669290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5404f5e8a04445d08a69a14616c5e008', 'request_id': 'req-7675daab-5232-4d4e-baf0-76bc726b9933'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.685245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5404f5e8a04445d08a69a14616c5e008', 'request_id': 'req-7675daab-5232-4d4e-baf0-76bc726b9933'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.699710 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:01.701362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5404f5e8a04445d08a69a14616c5e008', 'request_id': 'req-7675daab-5232-4d4e-baf0-76bc726b9933'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.736718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] The token cache is being invalidate because project 5404f5e8a04445d08a69a14616c5e008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:01.737217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.739107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7675daab-5232-4d4e-baf0-76bc726b9933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:01.741310 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3356/6747] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:01 2022] DELETE /identity/v3/projects/5404f5e8a04445d08a69a14616c5e008 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:01.746058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e2cc-b072-4af7-8df7-d8ea2e5a30db None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.746990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e2cc-b072-4af7-8df7-d8ea2e5a30db None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.747280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e2cc-b072-4af7-8df7-d8ea2e5a30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.784554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5a41e2cc-b072-4af7-8df7-d8ea2e5a30db None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:01.785949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3fc6-3909-492c-b032-15aa9819e5d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:01.788128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5a41e2cc-b072-4af7-8df7-d8ea2e5a30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.881467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3357/6748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:01.886042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.886156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.886580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.895943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:01.896729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.897014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.897518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] PATH_INFO: `/v3/users/d33a368d77fc4a559eafd4ba69a7d70a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.899108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33a368d77fc4a559eafd4ba69a7d70a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:01.906014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:01.913154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:01.914632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:01.929922 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3358/6749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:01.931951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:01.943778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1036f6-7b43-426b-b5b8-3533c0ca511c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:01.950159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:01.950813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:01.951196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:01.951475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:01.963171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:01.965753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:01.970100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:01.988145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3359/6750] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:28:01.993984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.008797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5b16b-b108-4a5c-83b7-203249f135f6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.012107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33a368d77fc4a559eafd4ba69a7d70a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.015995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.016631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.016900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.017232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.017979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.020842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.061363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3360/6751] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:01 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:02.066137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.066844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33a368d77fc4a559eafd4ba69a7d70a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.090877 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:02.093739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33a368d77fc4a559eafd4ba69a7d70a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.095443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33a368d77fc4a559eafd4ba69a7d70a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.096208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33a368d77fc4a559eafd4ba69a7d70a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.117099 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3392/6752] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:01 2022] DELETE /identity/v3/users/d33a368d77fc4a559eafd4ba69a7d70a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:02.174139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc2c1-e9af-40a8-b075-29f72cc0dbe0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.271445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.272941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.273581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.274590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.275516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.277851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.308662 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3361/6753] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:02 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:02.310372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.312931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:02.333267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbdab-9d3a-4525-8bd3-ba26cea0148a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.338441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.339236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.339623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.340066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.340839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.342713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.360455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.368106 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3393/6754] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:02.387832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8803fd-c21d-4adb-9e1a-587d1dca7977 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.400693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.401973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.402392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.402771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.403564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.406684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69746b-88cf-4efa-bee1-7a668c0e39a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.424625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.436996 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3362/6755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:28:02.440951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611668-b342-4b26-a014-c68045298001 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.448604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.449287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.449708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.450084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] PATH_INFO: `/v3/projects/a5c020f7dd2f4748b22baae3c5628137/users/e05eaa044506481ebb431d7f01301a32/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.476167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c020f7dd2f4748b22baae3c5628137, user_id=e05eaa044506481ebb431d7f01301a32, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.479318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.504682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.505289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.505689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.508945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3394/6756] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:02 2022] PUT /identity/v3/projects/a5c020f7dd2f4748b22baae3c5628137/users/e05eaa044506481ebb431d7f01301a32/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:02.530921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:02.533218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:02.546166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.549150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:02.587762 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:02.661535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0099-ac26-4179-81cb-ebc691d7996c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.662008 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3363/6757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:02.670651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.671835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.672015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:02.672519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.672936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] PATH_INFO: `/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.741782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:02.744864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec636569c93e4d9abbfe8ad43d0e854c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.744864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.762720 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:02.774717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0c06b-d1e1-4395-b877-52ed06ec75da None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:02.781031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:02.782252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.782763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.783101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.799232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:02.802507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f7dd6-db75-4453-b795-cfb77a6310ee service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:02.812790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec636569c93e4d9abbfe8ad43d0e854c', 'request_id': 'req-185a0800-abdd-4a34-9596-d680983eb3a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.822482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec636569c93e4d9abbfe8ad43d0e854c', 'request_id': 'req-185a0800-abdd-4a34-9596-d680983eb3a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.828380 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3364/6758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:28:02.831724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec636569c93e4d9abbfe8ad43d0e854c', 'request_id': 'req-185a0800-abdd-4a34-9596-d680983eb3a9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.854009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] The token cache is being invalidate because project ec636569c93e4d9abbfe8ad43d0e854c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:02.854329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.855006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-185a0800-abdd-4a34-9596-d680983eb3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:02.856793 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3395/6759] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:02 2022] DELETE /identity/v3/projects/ec636569c93e4d9abbfe8ad43d0e854c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:02.861566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:02.861971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:02.862345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:02.893197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:02.899354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:03.034627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3365/6760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:03.043211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.043505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.043786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.076137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:03.077507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:03.093694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3396/6761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:03.095847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.108562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c573af-5e13-4994-9b78-287fb2dcc4b4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.114600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.115516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.115939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.116467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.117375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:03.117736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.119780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.144064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3366/6762] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:28:03.150543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.165361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440ec2-3348-476a-9f0d-194dab9a2ffc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.173091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.173990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.174288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.174572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.175260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.189085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.236125 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3397/6763] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:03 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:03.237581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.249092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c36e-c7e2-4cf9-a37a-c6a9cdd0c880 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.329686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.330471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.330915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.331296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.332757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.337442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.366683 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3367/6764] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:03 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:03.368217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.384099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708dcf-3967-4580-8242-a0b0c2073626 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.400868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.401981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.402300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.402571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.403206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.404920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.429449 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3398/6765] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:03.434756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.448392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3527b95-7c5e-4bf3-aad3-ed656fb6a857 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.462748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.462748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.462748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.463063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.463798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.465865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f507b80-0163-4ab9-a2fb-14a68061f887 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.482294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3368/6766] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:03.487086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.503477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00648fa-7664-4e1a-9736-2e72a616ae74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.514752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.515444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.515727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.516390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] PATH_INFO: `/v3/projects/0aca20096cd84d9994577a2d212f90a2/users/1b530df730354d3f8feacc75aa3b2fa0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.546010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aca20096cd84d9994577a2d212f90a2, user_id=1b530df730354d3f8feacc75aa3b2fa0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:03.550345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:03.577449 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3399/6767] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:03 2022] PUT /identity/v3/projects/0aca20096cd84d9994577a2d212f90a2/users/1b530df730354d3f8feacc75aa3b2fa0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:03.587857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.588314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.588637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:03.661738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] MFA Rules not processed for user `1b530df730354d3f8feacc75aa3b2fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:03.661738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:03.795641 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:03.834190 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3369/6768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:03.845452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:03.847240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:03.933398 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:03.968205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb947-5a06-4c29-bb34-4af6dbc34e0f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:03.989987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:03.991227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:03.992214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:03.994139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:04.010262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:04.012181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e82ffd-1c18-4422-866a-b9d693ca99fd service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:04.036953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3400/6769] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:04.051458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:04.120379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85fc1-e7b9-4364-99dd-b7f15657c39a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:04.125585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:04.126215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:04.126493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:04.126764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] PATH_INFO: `/v3/users/1b530df730354d3f8feacc75aa3b2fa0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:04.127891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b530df730354d3f8feacc75aa3b2fa0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:04.130485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:04.224966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b530df730354d3f8feacc75aa3b2fa0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:04.227025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b530df730354d3f8feacc75aa3b2fa0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:04.238027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b530df730354d3f8feacc75aa3b2fa0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:04.264036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b530df730354d3f8feacc75aa3b2fa0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:04.265848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b530df730354d3f8feacc75aa3b2fa0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:04.287805 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3370/6770] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:04 2022] DELETE /identity/v3/users/1b530df730354d3f8feacc75aa3b2fa0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:04.292394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:04.292685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:04.292958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:04.331302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:04.334333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:04.431469 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3401/6771] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:04.440118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:04.442340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:04.529770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a2da-9ca6-4e28-b9e1-c151d4bc269a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:04.534069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:04.534788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:04.537640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:04.537640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:04.548994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:04.551508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615153-16ea-4b40-a3d9-80e90aa7c561 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:04.571838 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3371/6772] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:04.936288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:04.937874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:04.960761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9870fe-b136-45c5-b30c-e740d55f3701 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:04.975636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:04.976628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:04.977086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:04.980319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] PATH_INFO: `/v3/projects/0aca20096cd84d9994577a2d212f90a2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:04.990755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aca20096cd84d9994577a2d212f90a2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:04.994647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.119372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aca20096cd84d9994577a2d212f90a2', 'request_id': 'req-a299e95d-c7ec-4584-9547-8ac5427875e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:05.134639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aca20096cd84d9994577a2d212f90a2', 'request_id': 'req-a299e95d-c7ec-4584-9547-8ac5427875e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:05.146747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aca20096cd84d9994577a2d212f90a2', 'request_id': 'req-a299e95d-c7ec-4584-9547-8ac5427875e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:05.175023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] The token cache is being invalidate because project 0aca20096cd84d9994577a2d212f90a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:05.175329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:05.182352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a299e95d-c7ec-4584-9547-8ac5427875e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:05.184248 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3402/6773] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:04 2022] DELETE /identity/v3/projects/0aca20096cd84d9994577a2d212f90a2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:05.189005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.189294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.189604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.213711 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:05.230019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:05.231274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:05.366773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3372/6774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:05.369460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.369460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.369460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.412472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:05.414125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:05.439693 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3403/6775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:05.441396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:05.463092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee150-fa8d-4eb2-a988-aab5420cebc1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:05.480658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:05.480658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.480658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.480658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.481010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:05.481010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:05.482832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.507851 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3373/6776] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:28:05.512350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:05.526024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0e70-2ea1-42ac-b036-7409b19b44d9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:05.532607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:05.533501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.534008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.534476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.535666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:05.537982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.586074 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3404/6777] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:05 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:05.587154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:05.599270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d1e5f-3056-4fe3-be08-ba118eb34aac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:05.735017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:05.735731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.736155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.736786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.745272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:05.748571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.796914 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3374/6778] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:05 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:05.798769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:05.816707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279906-d4ce-4cba-8fd7-17eab8266601 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:05.837917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:05.839073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.839560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.840067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.840918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:05.848381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.892098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3405/6779] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:05.904213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:05.919985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4d5f-2b31-414c-88a8-0e4cf4fa1c75 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:05.939025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:05.939720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:05.940005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:05.940286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:05.941742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:05.943290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f79a9a-8902-4d4b-bb20-c1b06695c75e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:05.996422 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3375/6780] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:06.001017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:06.017918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849edfd9-56b4-4b21-82f6-7a502969c790 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:06.026567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:06.027140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:06.027573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:06.027963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] PATH_INFO: `/v3/projects/709cede638de4bb18c0aae5c5f1c205b/users/3ca4422887dc47cea8da884bb8130146/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:06.049986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709cede638de4bb18c0aae5c5f1c205b, user_id=3ca4422887dc47cea8da884bb8130146, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:06.056127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:06.089059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3406/6781] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:05 2022] PUT /identity/v3/projects/709cede638de4bb18c0aae5c5f1c205b/users/3ca4422887dc47cea8da884bb8130146/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:06.089220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:06.089514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:06.089795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:06.153342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] MFA Rules not processed for user `3ca4422887dc47cea8da884bb8130146`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:06.155412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:06.318155 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3376/6782] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:28:06.330070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:06.334628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:06.342043 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:06.456739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828bda-0460-4a19-a943-8447c9890f63 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:06.468304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:06.469773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:06.470247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:06.470534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:06.490894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:06.493737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9915-6f96-47aa-a02a-e864dddf8e1f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:06.508673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3407/6783] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:07.740458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:07.742540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:07.748715 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:07.897881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c76b4-f93d-4dbc-a815-a3b2f21bc29b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:07.918293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:07.919718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:07.920002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:07.920274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] PATH_INFO: `/v3/users/610e18eeab4844619a1a1b464b0900d3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:07.922983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610e18eeab4844619a1a1b464b0900d3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:07.924951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:08.082269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610e18eeab4844619a1a1b464b0900d3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:08.083436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610e18eeab4844619a1a1b464b0900d3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:08.115104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610e18eeab4844619a1a1b464b0900d3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:08.189451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610e18eeab4844619a1a1b464b0900d3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:08.192136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610e18eeab4844619a1a1b464b0900d3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:08.252404 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3377/6784] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:07 2022] DELETE /identity/v3/users/610e18eeab4844619a1a1b464b0900d3 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:08.254214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:08.254694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:08.254835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:08.312271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:08.315224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:08.478265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3408/6785] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:08.490391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:08.492350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:08.621049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44403a31-95f2-44d4-8fff-0f8f9e8eaca2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:08.627254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:08.627882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:08.628226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:08.628432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:08.653450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:08.654948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32424406-d747-400e-acf8-c79cffba8745 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:08.685445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3378/6786] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:09.038438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:09.039911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:09.080066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8901-2f20-4a99-8f7d-1dbf40bcf7ef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:09.091142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:09.092549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.092825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.093108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] PATH_INFO: `/v3/projects/2f4229cfef9549dfa75fd9ed73322326` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.094657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4229cfef9549dfa75fd9ed73322326)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:09.097099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:09.294597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4229cfef9549dfa75fd9ed73322326', 'request_id': 'req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:09.309271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4229cfef9549dfa75fd9ed73322326', 'request_id': 'req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:09.317663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4229cfef9549dfa75fd9ed73322326', 'request_id': 'req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:09.340556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] The token cache is being invalidate because project 2f4229cfef9549dfa75fd9ed73322326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:09.345097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:09.345896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b56149cf-8ce6-4602-a1dc-54ed5c7e00d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:09.352517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3409/6787] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:09 2022] DELETE /identity/v3/projects/2f4229cfef9549dfa75fd9ed73322326 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:09.353980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.354444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.354670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.413762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:09.415431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:09.450029 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:09.549663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3379/6788] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:09.558599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.559065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.559349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.589537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:09.591832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:09.615664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:09.617255 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3410/6789] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:09.637003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd22a74-1a7f-496d-8e0a-4b6e0deab30b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:09.647896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:09.649066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.649627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.658046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.659130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:09.659734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:09.663113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfffe63-2401-4e9b-9dcb-fca3f485309b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:09.711528 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3380/6790] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:28:09.712482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:09.735378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a62a2b-f875-4b7a-9ed0-f60e8e0711fe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:09.742549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:09.743313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.743590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.744135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.744927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:09.747564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:09.799265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.799620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.800110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.815520 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:09.833025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3411/6791] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:09 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:28:09.835151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:09.845517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] MFA Rules not processed for user `3ca4422887dc47cea8da884bb8130146`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:09.846904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:09.957445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3381/6792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:09.967975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c2d-5bbb-4eb0-9c70-954ff58a19de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:09.976437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:09.977153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:09.977543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:09.977822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:09.980323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:09.981709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:10.037270 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3412/6793] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:09 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:10.041945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:10.058488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce8f2d-5230-43f0-a000-55f9cb0b0f18 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:10.068825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:10.070146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:10.070486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:10.070770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:10.071768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:10.073436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:10.089237 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3382/6794] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:10.090463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:10.102692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be45c-c60a-4134-bbf6-ee553688820b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:10.108805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:10.109638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:10.109926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:10.110208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:10.110869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:10.112487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac35e9-d9ee-401c-8747-ac619ce29ef5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:10.124601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3413/6795] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:10.130058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:10.143123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244af2-fd2e-4068-9923-8201674f3fc8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:10.151651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:10.152669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:10.153166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:10.154606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] PATH_INFO: `/v3/projects/efb4b48ff1cc400e9fd6085e47d346b4/users/00c8fcabbde045eab865098c996969ba/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:10.186411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb4b48ff1cc400e9fd6085e47d346b4, user_id=00c8fcabbde045eab865098c996969ba, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:10.190536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:10.241139 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3383/6796] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:10 2022] PUT /identity/v3/projects/efb4b48ff1cc400e9fd6085e47d346b4/users/00c8fcabbde045eab865098c996969ba/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:10.244390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7b4-367d-48b9-9fbd-3b380b49bb0a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:10.244756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7b4-367d-48b9-9fbd-3b380b49bb0a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:10.245073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7b4-367d-48b9-9fbd-3b380b49bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:10.291734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fe6d7b4-367d-48b9-9fbd-3b380b49bb0a None None] MFA Rules not processed for user `00c8fcabbde045eab865098c996969ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:10.293464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fe6d7b4-367d-48b9-9fbd-3b380b49bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:10.382436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3414/6797] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:28:10.393817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:10.397005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:10.485438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96545-aa8d-4455-afd8-ff289bcbf0fe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:10.491665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:10.492543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:10.492974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:10.493422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:10.504775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:10.506887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2235d6-b878-4787-8c77-64731eb43692 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:10.517982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3384/6798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:18.306608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:18.307106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:18.307205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:18.368204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] MFA Rules not processed for user `e05eaa044506481ebb431d7f01301a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:18.369794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:18.518825 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:18.530416 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3415/6799] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:18.543148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597d32c-db76-47a6-b4ae-3ff3b1948adf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:18.544233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597d32c-db76-47a6-b4ae-3ff3b1948adf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:18.546474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597d32c-db76-47a6-b4ae-3ff3b1948adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:18.583231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9597d32c-db76-47a6-b4ae-3ff3b1948adf None None] MFA Rules not processed for user `e05eaa044506481ebb431d7f01301a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:18.585368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9597d32c-db76-47a6-b4ae-3ff3b1948adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:18.601238 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3385/6800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:18.937801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:18.939743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:19.164375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffc21b-ed43-4ef8-bc1d-89aa579e4e63 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:19.181281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:19.182072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:19.182355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:19.182705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:19.203656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:19.207264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea5114-e507-48b4-ab7f-a632e9d1bc00 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:19.233038 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3416/6801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:23.682118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a8f-4710-4ba1-a1fe-c278cc30b884 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:23.683134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a8f-4710-4ba1-a1fe-c278cc30b884 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:23.683608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a8f-4710-4ba1-a1fe-c278cc30b884 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:23.685329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3386/6802] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:28:23.693241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd30f-d6b3-4330-b373-fc8e8a8ec73d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:23.693772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd30f-d6b3-4330-b373-fc8e8a8ec73d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:23.694145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd30f-d6b3-4330-b373-fc8e8a8ec73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:23.764827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-603fd30f-d6b3-4330-b373-fc8e8a8ec73d None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:23.766655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-603fd30f-d6b3-4330-b373-fc8e8a8ec73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:23.776808 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3417/6803] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:23.802518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3760a8f-4710-4ba1-a1fe-c278cc30b884 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:23.825441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3760a8f-4710-4ba1-a1fe-c278cc30b884 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:23.833368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:23.835189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:23.835629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:23.836045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:23.850374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:23.853975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:23.891313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3387/6804] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:33.761957 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=44 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:33.861855 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:42.165883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8430-b1ee-40be-93e8-224978385c95 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:42.166702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8430-b1ee-40be-93e8-224978385c95 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:42.167179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8430-b1ee-40be-93e8-224978385c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:42.279543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59fa8430-b1ee-40be-93e8-224978385c95 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:42.282861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59fa8430-b1ee-40be-93e8-224978385c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:42.467845 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3418/6805] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:42.545423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:42.549254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:42.834573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626c52-ab26-4763-a719-84d2a944260e service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:42.848787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:42.850559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:42.851309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:42.852674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:42.862357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:42.864406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:42.873869 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3388/6806] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:28:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:28:43.632069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9cfa-b8db-46b1-ad7b-7960d50989bb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:43.632557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9cfa-b8db-46b1-ad7b-7960d50989bb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:43.632660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9cfa-b8db-46b1-ad7b-7960d50989bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:43.656277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5bad9cfa-b8db-46b1-ad7b-7960d50989bb None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:43.657962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5bad9cfa-b8db-46b1-ad7b-7960d50989bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:43.667916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3419/6807] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:43.687390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:43.706763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71ea65-e96c-4ce8-9b09-911976a608c7 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:43.719045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:43.719676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:43.720169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:43.721306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:43.736578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:43.739489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:43.754254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3389/6808] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:28:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:28:44.155591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:44.156123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:44.156586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:44.181816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:44.183492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:44.196527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3420/6809] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:44.213390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:44.234677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59e237-4ee8-4be2-8359-2ce12486a94d service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:44.243073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:44.244286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:44.244845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:44.245384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:44.262725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:44.265475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32d268-6d33-4651-b8c6-57d23d0a346d service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:44.285350 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3390/6810] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:28:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:28:44.797037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:44.802287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:44.803198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:44.803675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:44.823845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb008b-3690-4ec9-9a7d-72db4f7b13d0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:44.838704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:44.839740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:44.840440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:44.840588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:44.840724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:44.842263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:44.850146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3391/6811] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:44.860740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:44.878952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:44.905096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:44.907042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:44.912439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f290f3-a477-4810-bbfd-87adf0f5ea35 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:44.937690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:44.938537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:44.941864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:44.943478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:44.960606 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3421/6812] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:44.983013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:44.989817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c072a97-afd7-4aba-a324-a0f5b91f178e service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:45.053504 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3392/6813] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:28:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:28:50.607994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:50.609576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:50.746166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0508df5-5557-4ec9-859c-ce36d5ee5e66 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:50.758534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:50.759453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:50.759935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:50.760954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] PATH_INFO: `/v3/users/3ca4422887dc47cea8da884bb8130146` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:50.765541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca4422887dc47cea8da884bb8130146)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:50.767905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:50.844731 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:50.883871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca4422887dc47cea8da884bb8130146'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:50.896161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca4422887dc47cea8da884bb8130146'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:50.924017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca4422887dc47cea8da884bb8130146'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:50.926426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca4422887dc47cea8da884bb8130146'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:50.927891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca4422887dc47cea8da884bb8130146'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:50.952988 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3422/6814] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:50 2022] DELETE /identity/v3/users/3ca4422887dc47cea8da884bb8130146 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:50.958024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:50.958459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:50.958599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:51.008702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:51.009975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:51.135583 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3393/6815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:51.204017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:51.206302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:51.311811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e055-6e0d-4c83-9c6b-35f603ef1e00 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:51.316360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:51.317454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:51.317651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:51.317942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:51.357783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:51.359267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa164cf-b97a-4be1-b1a7-481f230e5e7d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:51.386644 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3423/6816] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:52.574669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:52.577662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:52.591337 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:52.612325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c873e-a86f-4a45-829c-b0275f442631 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:52.620202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:52.621366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:52.621899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:52.622369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] PATH_INFO: `/v3/projects/709cede638de4bb18c0aae5c5f1c205b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:52.623999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=709cede638de4bb18c0aae5c5f1c205b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:52.626214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:52.700432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709cede638de4bb18c0aae5c5f1c205b', 'request_id': 'req-4e961b78-6403-4808-8e7f-9df1837b58fa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:52.709275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709cede638de4bb18c0aae5c5f1c205b', 'request_id': 'req-4e961b78-6403-4808-8e7f-9df1837b58fa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:52.715890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709cede638de4bb18c0aae5c5f1c205b', 'request_id': 'req-4e961b78-6403-4808-8e7f-9df1837b58fa'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:52.736500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] The token cache is being invalidate because project 709cede638de4bb18c0aae5c5f1c205b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:52.737989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:52.749953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e961b78-6403-4808-8e7f-9df1837b58fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:52.751949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3394/6817] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:52 2022] DELETE /identity/v3/projects/709cede638de4bb18c0aae5c5f1c205b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:52.761939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:52.762886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:52.763965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:52.810307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:52.811902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:52.912357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3424/6818] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:52.920580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:52.920864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:52.921138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:52.952013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:52.955239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:52.969294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3395/6819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:52.973056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:52.983996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2983-3a1d-433e-87f2-53d17e20dd41 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:52.990723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:52.992564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:52.993038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:52.993600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:52.994474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:52.994984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:52.997307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.012489 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3425/6820] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:28:53.016899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.028043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432461d4-1932-4fdc-9861-f3c865a1835a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.033287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.035302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.035910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.036386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.037294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.039475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.080250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3396/6821] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:53 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:28:53.086812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.100237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567756-be1b-46f5-b7c6-f34cfc6449b2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.145113 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:53.191564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.192182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.192468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.192756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.193628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.195745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.228312 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3426/6822] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:53 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:53.229869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.250698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d00d-955c-4fbc-9e99-7871cc0746c5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.259870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.261137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.261137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.261595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.263115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.265201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.285704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3397/6823] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:53.287812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.301368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459114-c7ed-45c4-af6f-7ded9766464a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.310687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.311380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.311818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.312279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.313121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.316041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec519-2582-4a2c-8f03-88b798de1331 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.338660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.338907 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3427/6824] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:53.355802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b12f1a-6d1d-404b-bb1a-b8544c07b9e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.364567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.365517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.365903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.366276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] PATH_INFO: `/v3/projects/dc6eecfc22d54d30a11c63b0d7518e4a/users/aa5f2510f105430fb01974c7a6e1579e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.386844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6eecfc22d54d30a11c63b0d7518e4a, user_id=aa5f2510f105430fb01974c7a6e1579e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.389918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.433202 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3398/6825] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:53 2022] PUT /identity/v3/projects/dc6eecfc22d54d30a11c63b0d7518e4a/users/aa5f2510f105430fb01974c7a6e1579e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:53.433799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.434306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.434787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.494574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.496478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:53.501771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] MFA Rules not processed for user `aa5f2510f105430fb01974c7a6e1579e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:53.504132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:53.587046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a89c-7c18-4410-a18a-54f4ab5feca5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.596265 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3428/6826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:53.597286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.598157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.598609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.599026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] PATH_INFO: `/v3/users/e05eaa044506481ebb431d7f01301a32` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.600481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05eaa044506481ebb431d7f01301a32)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.601694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.602808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.615092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b71a7-205c-4fa5-b727-b3a2e4243114 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.620260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.621045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.621336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.621832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.622487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.624429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.634746 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:53.669689 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3429/6827] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:53 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:53.673931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.681986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05eaa044506481ebb431d7f01301a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:53.682895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05eaa044506481ebb431d7f01301a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:53.693788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05eaa044506481ebb431d7f01301a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:53.715250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05eaa044506481ebb431d7f01301a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:53.716201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05eaa044506481ebb431d7f01301a32'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:53.737332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3399/6828] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:28:53 2022] DELETE /identity/v3/users/e05eaa044506481ebb431d7f01301a32 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:53.776363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6209a-7c7d-480f-a0f7-eb054c03b251 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.796969 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:53.855333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.856059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.856410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.856752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.857517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.860758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.889865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3430/6829] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:53 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:53.895317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.901053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:53.917043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4705c7-700e-4324-a037-ae6a9a5c8ade admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.923646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.924360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.924949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.925298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.926077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.927779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.951658 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3400/6830] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:53.957490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.974584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6315-ada1-4bd2-9fda-6c2944b8dd93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:53.980416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:53.981104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:53.981386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:53.981693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:53.982379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:53.984033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:53.985997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:53.988907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:54.016227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df24757-84b0-42e2-8cce-6cdc52b16e3d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.035815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3431/6831] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:54.039914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.040834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.041342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.042249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] PATH_INFO: `/v3/projects/a5c020f7dd2f4748b22baae3c5628137` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.044653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c020f7dd2f4748b22baae3c5628137)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.046337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.049040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.065614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1acf9-99c2-4fda-9e5d-cee9854430ec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.077591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.078640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.079164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.079543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] PATH_INFO: `/v3/projects/380f7c8277734a0892e7c47a12b974d3/users/87b1926ae1e84a79b5d081d9ef23017a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.100014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] RBAC: Authorizing `identity:create_grant(project_id=380f7c8277734a0892e7c47a12b974d3, user_id=87b1926ae1e84a79b5d081d9ef23017a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.103376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345918-317e-4ae1-904f-7fd40190053f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.121051 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3432/6832] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:54 2022] PUT /identity/v3/projects/380f7c8277734a0892e7c47a12b974d3/users/87b1926ae1e84a79b5d081d9ef23017a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:54.136835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.137480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.137954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.141154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c020f7dd2f4748b22baae3c5628137', 'request_id': 'req-246aa977-071a-44fd-b9e8-3313293cc45a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:54.151785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c020f7dd2f4748b22baae3c5628137', 'request_id': 'req-246aa977-071a-44fd-b9e8-3313293cc45a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:54.162243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c020f7dd2f4748b22baae3c5628137', 'request_id': 'req-246aa977-071a-44fd-b9e8-3313293cc45a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:54.185088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] MFA Rules not processed for user `87b1926ae1e84a79b5d081d9ef23017a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:54.186585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:54.193032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] The token cache is being invalidate because project a5c020f7dd2f4748b22baae3c5628137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:28:54.193453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:54.196294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-246aa977-071a-44fd-b9e8-3313293cc45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:28:54.200323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3401/6833] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:28:53 2022] DELETE /identity/v3/projects/a5c020f7dd2f4748b22baae3c5628137 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:54.206032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d974-5380-4ee4-8e08-7939ee1b51d1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.206519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d974-5380-4ee4-8e08-7939ee1b51d1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.206881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d974-5380-4ee4-8e08-7939ee1b51d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.251815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-39d0d974-5380-4ee4-8e08-7939ee1b51d1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:54.253722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-39d0d974-5380-4ee4-8e08-7939ee1b51d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:54.296090 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3433/6834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:54.297151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.299243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:54.387299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a751-ffef-43e6-8886-7221f25aaccb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.394186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.394969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.395349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.395724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.396721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.398822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.413482 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:54.415738 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3402/6835] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:28:54.422688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.422983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.433859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.476241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:54.477939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:54.480159 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3434/6836] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:28:54.483747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.495975 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:54.592764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f403-3c87-48e4-9f34-53158e5ddfb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.603769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3403/6837] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:54.610071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.612073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.612821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.613295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.614189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.614440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.617660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.629848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19050e5-4813-4482-a5dc-7885d37c6551 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.636842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.637688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.638184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.638528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.639199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:28:54.640156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.642676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.660518 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3435/6838] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:28:54.667796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.673364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3404/6839] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:28:54.678014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.692334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d689-2ca1-4eb1-8357-0f76d207e608 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.700156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.700884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.701346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.701743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.702356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443ebcb-62b1-4a2e-9a3e-f12b36c4c047 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.702539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.704860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.710704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.711345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.711623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.711895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.712550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.714207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.740031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3436/6840] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:54.742378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.769108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3405/6841] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:28:54.770582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.775958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ed5e-b409-4a40-9d95-e655c5026242 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.873509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.874495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.874788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.875222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] PATH_INFO: `/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c/users/8be2ef76457043b0a90348a85bbf7595/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.900054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dec2d-e201-455d-ae98-dceb3c999656 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:54.905024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7b8a9defb5423b9e1dc487d9b50a5c, user_id=8be2ef76457043b0a90348a85bbf7595, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.907805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:54.907965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.908429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:54.908830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:54.909274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:54.910964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:54.915249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:54.929447 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3437/6842] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:54 2022] PUT /identity/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c/users/8be2ef76457043b0a90348a85bbf7595/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:54.930772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.949718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3406/6843] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:28:54 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:28:54.951821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:54.965328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328e4a-d899-4e00-8e53-1bcad7815d89 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.004666 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:55.019624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06625e-8c52-4eea-b5ac-546d98222ded admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.025856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.026726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.027208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.027677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.028716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.030661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.039749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.040979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.041268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.041568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.042793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.047800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3438/6844] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:55.047945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.050114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:55.059718 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3407/6845] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:28:55.061866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee63ff-0926-492b-9ccd-fc7174fe99b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.063766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:55.068714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.069679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.070219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.070638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] PATH_INFO: `/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c/users/8be2ef76457043b0a90348a85bbf7595/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.071181 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:55.073844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7b8a9defb5423b9e1dc487d9b50a5c, user_id=8be2ef76457043b0a90348a85bbf7595, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.076246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e33bc-df9a-4681-be2e-fb55a19ff094 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.079107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cac9c-eef2-49ae-831d-2f82973605f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.084719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.086386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.087050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.087401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.088173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.090382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.104561 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3439/6846] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:55 2022] PUT /identity/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c/users/8be2ef76457043b0a90348a85bbf7595/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:55.106596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.107157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.108246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.114708 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3408/6847] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:28:55.115632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:55.133512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd1126-a243-4b27-8747-6f019c54aa3a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.147088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] MFA Rules not processed for user `8be2ef76457043b0a90348a85bbf7595`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:55.148445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:55.220796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.222602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.222884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.223442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] PATH_INFO: `/v3/projects/d0f7aff60fed41988176a7b46c5f2953/users/9ac2837cd4e04995a4b7aa33aa7b5ecf/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.237891 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3440/6848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:55.257043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:55.260284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:55.262830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f7aff60fed41988176a7b46c5f2953, user_id=9ac2837cd4e04995a4b7aa33aa7b5ecf, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.265920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe38624-186a-4999-b5f7-f83783a6efea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.285921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3409/6849] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:28:55 2022] PUT /identity/v3/projects/d0f7aff60fed41988176a7b46c5f2953/users/9ac2837cd4e04995a4b7aa33aa7b5ecf/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:28:55.290892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.291239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.291519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.313653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:28:55.317280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:55.401248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49840c7-5a76-42be-adc2-eb8a10fc6c05 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.422468 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3410/6850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:28:55.435458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:55.437125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:55.506727 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:55.539843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.540490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.540774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.541054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.545835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:28:55.551775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0b201-f057-43a3-8407-1394ba67937c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:55.557671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:55.558879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:55.559160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:55.559432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:55.571775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.575081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.588787 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3411/6851] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:28:55.667768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:28:55.670419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d1a3-4d47-4d5c-be09-64fa330a0e9e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:28:55.682144 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3441/6852] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:28:59.863369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:28:59.880727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c9d5-6b86-4efe-8797-a785da4ce1a7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:28:59.897325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:28:59.898305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:28:59.898598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:28:59.898876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:28:59.938336 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:00.027717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:00.030594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865d844-ce39-4c24-9af5-80cf2289ec44 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:00.054110 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3412/6853] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:05.122437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:05.122914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:05.122995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:05.230696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] MFA Rules not processed for user `9ac2837cd4e04995a4b7aa33aa7b5ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:05.231926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:05.443918 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3442/6854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:05.456784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67c29-3d95-49a5-a131-c2aadc9f26ec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:05.457798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67c29-3d95-49a5-a131-c2aadc9f26ec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:05.458519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67c29-3d95-49a5-a131-c2aadc9f26ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:05.553015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-48c67c29-3d95-49a5-a131-c2aadc9f26ec None None] MFA Rules not processed for user `9ac2837cd4e04995a4b7aa33aa7b5ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:05.558995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-48c67c29-3d95-49a5-a131-c2aadc9f26ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:05.580494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3413/6855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:05.595621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:05.650675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0dc7f-045f-4844-9641-108623296fb6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:05.669700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:05.670408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:05.670814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:05.671100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:05.686689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:05.689502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:05.719143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3443/6856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:07.722160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:07.722602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:07.722796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:07.745893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] MFA Rules not processed for user `aa5f2510f105430fb01974c7a6e1579e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:07.748556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:07.759211 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3414/6857] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:15.703315 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=71 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:17.739049 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=27 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:27.946355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:27.948549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:28.111100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e8d8-c031-4246-8307-87088caab1bb service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:28.118849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:28.119431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:28.119739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:28.120017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:28.122082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:28.155328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:28.159181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:28.191457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3444/6858] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:37.909224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:37.927206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d361d4-aa2d-467f-abde-5ee3c7b8abb7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:37.942824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:37.943504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:37.943787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:37.944061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] PATH_INFO: `/v3/users/9ac2837cd4e04995a4b7aa33aa7b5ecf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:37.958774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac2837cd4e04995a4b7aa33aa7b5ecf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:37.960800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:38.047216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac2837cd4e04995a4b7aa33aa7b5ecf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.048308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac2837cd4e04995a4b7aa33aa7b5ecf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.057642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac2837cd4e04995a4b7aa33aa7b5ecf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.076941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac2837cd4e04995a4b7aa33aa7b5ecf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.078045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bd59c3ef-f9ae-4a9f-8fdd-6396520ffd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac2837cd4e04995a4b7aa33aa7b5ecf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.101789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3415/6859] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:29:37 2022] DELETE /identity/v3/users/9ac2837cd4e04995a4b7aa33aa7b5ecf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:29:38.170922 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=37 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:38.722034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:38.744026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33ba82-5388-4915-9655-25d3ce22f056 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:38.841325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:38.842594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:38.843074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:38.843733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] PATH_INFO: `/v3/projects/d0f7aff60fed41988176a7b46c5f2953` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:38.846948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f7aff60fed41988176a7b46c5f2953)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:38.850667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:38.961721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f7aff60fed41988176a7b46c5f2953', 'request_id': 'req-af1f70db-19b5-44b4-a8fc-46f65364ced4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:38.996150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f7aff60fed41988176a7b46c5f2953', 'request_id': 'req-af1f70db-19b5-44b4-a8fc-46f65364ced4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:39.027133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f7aff60fed41988176a7b46c5f2953', 'request_id': 'req-af1f70db-19b5-44b4-a8fc-46f65364ced4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:39.056648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] The token cache is being invalidate because project d0f7aff60fed41988176a7b46c5f2953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:29:39.058247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:39.061381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af1f70db-19b5-44b4-a8fc-46f65364ced4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:39.078927 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3445/6860] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:29:38 2022] DELETE /identity/v3/projects/d0f7aff60fed41988176a7b46c5f2953 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:29:39.080983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.081507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.081612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.118556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:39.120269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:39.236522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.237653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.238038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.240787 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3416/6861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:39.283102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:39.286703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:39.314147 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3446/6862] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:29:39.318524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.337958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6c244-c94b-43d9-9668-b0328610b3f1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.347686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.348330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.348616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.350662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.352274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:29:39.352759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:39.356608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:39.388640 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3417/6863] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:29:39.394150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.416421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20141477-2c73-47f7-bef8-e7a94749e803 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.434774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.435313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.435595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.436774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.437205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:39.442491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:39.571410 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3447/6864] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:29:39 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:29:39.575580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.597720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429f5f-856a-43cc-8dce-e8973a22db58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.766194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.767023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.767405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.767779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.771484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:39.775522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:39.796109 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:39.830954 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3418/6865] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:29:39 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:29:39.833452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.849067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04b54-c96a-4dd0-90b2-cfdd7e827b74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.862305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.862956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.864270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.865452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.867588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:39.871750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:39.900245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3448/6866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:29:39.902080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.916318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5206-2407-4055-9ea0-03af6bc82df8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.928044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.929195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.929729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.930690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:39.932251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:39.936036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac30ec2-013e-4730-918a-db285fc6e84b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:39.958935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3419/6867] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:29:39.959152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:39.977713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30492d70-cbf5-4008-b22f-ce18fcab90c8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:39.991724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:39.992430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:39.992714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:39.992990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] PATH_INFO: `/v3/projects/2d08c63381bf4c438f6c384826265c65/users/a9547b1dc9c84b9d8b3c03a87815643b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:40.028258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d08c63381bf4c438f6c384826265c65, user_id=a9547b1dc9c84b9d8b3c03a87815643b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:40.036938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:40.062423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3449/6868] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:29:39 2022] PUT /identity/v3/projects/2d08c63381bf4c438f6c384826265c65/users/a9547b1dc9c84b9d8b3c03a87815643b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:29:40.067635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822e17-8d73-4078-883f-d64f3e32a322 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:40.067931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822e17-8d73-4078-883f-d64f3e32a322 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:40.068306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28822e17-8d73-4078-883f-d64f3e32a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:40.113942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-28822e17-8d73-4078-883f-d64f3e32a322 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:40.115236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-28822e17-8d73-4078-883f-d64f3e32a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:40.287632 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3420/6869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:40.303947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:40.306047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:40.398037 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:40.515749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e550e-01f1-4740-8db1-ad1a7ae82707 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:40.530169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:40.530921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:40.531272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:40.532710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:40.565645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:40.570969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:40.610385 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3450/6870] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:48.754772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d9f0-33b1-4fa9-bb46-103359db91af None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:48.760189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d9f0-33b1-4fa9-bb46-103359db91af None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:48.761811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d9f0-33b1-4fa9-bb46-103359db91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:48.838731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2889d9f0-33b1-4fa9-bb46-103359db91af None None] MFA Rules not processed for user `a9547b1dc9c84b9d8b3c03a87815643b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:48.840514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2889d9f0-33b1-4fa9-bb46-103359db91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:48.936933 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3421/6871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:48.945013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:48.946492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:49.124535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584f5a-cd23-4d39-93b7-9ee24c24276d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:49.161266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:49.164390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:49.165234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:49.166604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:49.182297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:49.189806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:49.214026 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3451/6872] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:54.053670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:54.054105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:54.054105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:54.085461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] MFA Rules not processed for user `88a281617be64d1b85a6b7d8a708876a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:54.086915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:54.183848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3422/6873] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:56.265929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:56.284473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea758566-0056-4ee3-a7a3-33b2175c4ff4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:56.294492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:56.295137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:56.295557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:56.295848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] PATH_INFO: `/v3/users/a9547b1dc9c84b9d8b3c03a87815643b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:56.297776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9547b1dc9c84b9d8b3c03a87815643b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:56.300060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:56.387026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9547b1dc9c84b9d8b3c03a87815643b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:56.412117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9547b1dc9c84b9d8b3c03a87815643b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:56.459082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9547b1dc9c84b9d8b3c03a87815643b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:56.459764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9547b1dc9c84b9d8b3c03a87815643b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:56.460576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-690b5815-48ab-4b2f-a28d-8a0260277632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9547b1dc9c84b9d8b3c03a87815643b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:56.487554 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3452/6874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:29:56 2022] DELETE /identity/v3/users/a9547b1dc9c84b9d8b3c03a87815643b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:29:57.252908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:57.268093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0463-2ad6-421d-b037-eabd57b66632 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:57.283896 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:57.366626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144795-d636-4169-a079-499a73d089fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:57.367765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144795-d636-4169-a079-499a73d089fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.368049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144795-d636-4169-a079-499a73d089fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.368322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144795-d636-4169-a079-499a73d089fd admin admin] PATH_INFO: `/v3/projects/2d08c63381bf4c438f6c384826265c65` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.369511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144795-d636-4169-a079-499a73d089fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d08c63381bf4c438f6c384826265c65)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:57.371441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144795-d636-4169-a079-499a73d089fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:57.439006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d08c63381bf4c438f6c384826265c65', 'request_id': 'req-db144795-d636-4169-a079-499a73d089fd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:57.449023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d08c63381bf4c438f6c384826265c65', 'request_id': 'req-db144795-d636-4169-a079-499a73d089fd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:57.458118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d08c63381bf4c438f6c384826265c65', 'request_id': 'req-db144795-d636-4169-a079-499a73d089fd'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:57.487412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] The token cache is being invalidate because project 2d08c63381bf4c438f6c384826265c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:29:57.487764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:57.488405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-db144795-d636-4169-a079-499a73d089fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:29:57.489937 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3423/6875] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:29:57 2022] DELETE /identity/v3/projects/2d08c63381bf4c438f6c384826265c65 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:29:57.494886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.495366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.495456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.522370 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:57.556109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:57.557721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:57.651330 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3453/6876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:29:57.660378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.660643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.661263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.690650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:57.692297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:57.705023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3424/6877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:57.705937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:57.716386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73bda-e5d5-453f-a1e2-c873ebadc84e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:57.722153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:57.722695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.723043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.723382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.724107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:29:57.724482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:57.726199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:57.744162 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3454/6878] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:29:57.745296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:57.759535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609eb1-374c-40a9-9bf5-f5a2956541dd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:57.765341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:57.767111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.767788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.768060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.768904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:57.770977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:57.817002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3425/6879] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:29:57 2022] POST /identity/v3/projects => generated 395 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:29:57.819284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:57.831805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de342f-6acf-4495-85b0-32bae0d30eb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:57.916794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:57.917563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.918082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.918456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.919312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:57.921373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:57.950860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3455/6880] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:29:57 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:29:57.952303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:57.963823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019604e-bbd3-4574-a363-e4691b294f90 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:57.970984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:57.971710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:57.972055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:57.972357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:57.973111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:57.974866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:57.989845 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3426/6881] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:29:57.991566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:58.003638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59341e-5c93-4513-92b3-8608433074be admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:58.008932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:58.009587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:58.009869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:58.010139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:58.010786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:58.012391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6537e95-bb83-4ad5-85a8-adf3ee425946 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:58.028598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3456/6882] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:29:58.030496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:58.041779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506e53-0ebe-48d2-8b09-11557bba9a10 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:58.046777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:58.048033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:58.049063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:58.049063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] PATH_INFO: `/v3/projects/ba17f9b214fc4a1b8b543d1bf96cb68a/users/830045557dd94ea5947df0c661c2a069/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:58.067652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba17f9b214fc4a1b8b543d1bf96cb68a, user_id=830045557dd94ea5947df0c661c2a069, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:58.071137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:58.086854 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3427/6883] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:29:58 2022] PUT /identity/v3/projects/ba17f9b214fc4a1b8b543d1bf96cb68a/users/830045557dd94ea5947df0c661c2a069/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:29:58.092620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:58.093078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:58.094145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:58.142461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:29:58.142461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:58.227923 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:58.243102 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3457/6884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:29:58.266751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:58.270458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:58.304860 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:58.382217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f71dd-ff0e-4b09-9415-66cdb30d8a7a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:58.390890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:58.392671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:58.392998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:58.393497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:58.404264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:58.405943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:58.429443 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3428/6885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:29:58.787752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:29:58.790483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:59.008223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1803e2-88ba-4311-8209-4b87bae515af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:29:59.020175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:29:59.020844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:29:59.021201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:29:59.021517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:29:59.023518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:29:59.040402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:29:59.042150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929dec0-07d8-45c6-aa66-d72e766c0afd service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:29:59.087292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3458/6886] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:02.449283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:02.450806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:02.472171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c59e-c188-4cad-8721-8ed56ea0f8e0 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:02.478020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:02.478885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:02.479453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:02.480130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:02.482383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:02.501529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:02.503673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6d116-3ab2-4bff-9538-4f07e4d4721b service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:02.523050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3429/6887] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:09.058322 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=32 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:09.138945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:09.139257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:09.139669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:09.192126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] MFA Rules not processed for user `830045557dd94ea5947df0c661c2a069`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:09.194911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:09.325583 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3459/6888] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:09.326416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aecfcf-8f94-4bbf-950f-ab5bcc99ec8f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:09.326882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aecfcf-8f94-4bbf-950f-ab5bcc99ec8f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:09.326961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aecfcf-8f94-4bbf-950f-ab5bcc99ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:09.351959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c1aecfcf-8f94-4bbf-950f-ab5bcc99ec8f None None] MFA Rules not processed for user `830045557dd94ea5947df0c661c2a069`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:09.353559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c1aecfcf-8f94-4bbf-950f-ab5bcc99ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:09.367704 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3430/6889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:09.375148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:09.380232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:09.550814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1d0b-220a-48d0-9ac5-16d6aa545366 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:09.561245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:09.562181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:09.562325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:09.562742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:09.580541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:09.582539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:09.597453 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3460/6890] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:14.464373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeac3e-228f-42e2-aec9-83325f2a337e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:14.465085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeac3e-228f-42e2-aec9-83325f2a337e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:14.465205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeac3e-228f-42e2-aec9-83325f2a337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:14.505815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-abeeac3e-228f-42e2-aec9-83325f2a337e None None] MFA Rules not processed for user `aa5f2510f105430fb01974c7a6e1579e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:14.507985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-abeeac3e-228f-42e2-aec9-83325f2a337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:14.617042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3431/6891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:18.833028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:18.834915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:18.853599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05bfd-3420-4ef7-beb6-04368e2150e7 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:18.862658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:18.863459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:18.863935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:18.864596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] PATH_INFO: `/v3/users/00c8fcabbde045eab865098c996969ba` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:18.866218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c8fcabbde045eab865098c996969ba)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:18.869749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:18.935702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c8fcabbde045eab865098c996969ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:18.952335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c8fcabbde045eab865098c996969ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:18.956384 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:18.976091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c8fcabbde045eab865098c996969ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:18.977127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c8fcabbde045eab865098c996969ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:18.977887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c8fcabbde045eab865098c996969ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:18.999734 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3461/6892] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:18 2022] DELETE /identity/v3/users/00c8fcabbde045eab865098c996969ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:19.006650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:19.007171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:19.007258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:19.063301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:19.064805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:19.204262 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3432/6893] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:19.209209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:19.210952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:19.400193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc51c-085f-4251-8a5d-7146cea8d443 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:19.405208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:19.405885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:19.406194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:19.406489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:19.452527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:19.454575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31be94-5882-4a29-8502-85d27b73bc69 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:19.485255 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3462/6894] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:20.062921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.066034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:20.098345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16b87-4400-4548-9e94-a26dc122903b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.110820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.111575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.111824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.112107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] PATH_INFO: `/v3/projects/efb4b48ff1cc400e9fd6085e47d346b4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.124982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb4b48ff1cc400e9fd6085e47d346b4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.127556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.244668 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:20.250438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb4b48ff1cc400e9fd6085e47d346b4', 'request_id': 'req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:20.261472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb4b48ff1cc400e9fd6085e47d346b4', 'request_id': 'req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:20.271757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb4b48ff1cc400e9fd6085e47d346b4', 'request_id': 'req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:20.321848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] The token cache is being invalidate because project efb4b48ff1cc400e9fd6085e47d346b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:20.322518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:20.326445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-23d2e5f9-995f-49ce-9a66-378f11fa7cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:20.330262 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3433/6895] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:20 2022] DELETE /identity/v3/projects/efb4b48ff1cc400e9fd6085e47d346b4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:20.335159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.335641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.335641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.362168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:20.364736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:20.493101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3463/6896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:20.503444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.505688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.506156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.543274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:20.545348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:20.554843 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3434/6897] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:20.559106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.570064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59d11b-a684-4a75-acc4-fa26c3b26156 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.575000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.575616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.575902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.576168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.576827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:20.577134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.579217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.593713 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3464/6898] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:20.598448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.608213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67938d82-464d-4c5f-be0e-067b0a2eb298 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.627728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.628515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.628948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.629270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.630055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.632404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.670822 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3435/6899] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:20 2022] POST /identity/v3/projects => generated 351 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:20.676860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.688588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747ea9f-247c-413d-9184-a7a6d6b19a41 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.806827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.807892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.808920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.809203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.811552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.814741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.832460 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:20.858171 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3465/6900] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:20 2022] POST /identity/v3/users => generated 276 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:20.862299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.879703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46655-ad93-482a-9633-8d97c14160ac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.888017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.888645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.888924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.889190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.889882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.892603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.905248 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3436/6901] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:20.909951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.929275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d14eef-8f73-4997-8ce3-4ce9b569a3a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.940731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.941781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.941920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.942287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:20.943007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:20.944728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfea15-c204-4aee-a325-857576055aae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:20.958543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3466/6902] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:20.962857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:20.975167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7b8b-df57-43b4-b99b-064e22f415b9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:20.980978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:20.981683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:20.981966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:20.982234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] PATH_INFO: `/v3/projects/b3984bc8a1c14fc2b62bd4c8b121f14a/users/a74b01a75dff4dd081e81dfc99fd411b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:21.004955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3984bc8a1c14fc2b62bd4c8b121f14a, user_id=a74b01a75dff4dd081e81dfc99fd411b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:21.008258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:21.045366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:21.045821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:21.046116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:21.050943 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3437/6903] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:20 2022] PUT /identity/v3/projects/b3984bc8a1c14fc2b62bd4c8b121f14a/users/a74b01a75dff4dd081e81dfc99fd411b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:21.082396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] MFA Rules not processed for user `a74b01a75dff4dd081e81dfc99fd411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:21.083783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:21.161180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3467/6904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:21.172635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:21.174471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:21.247347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c7e3-ca05-4ba3-9498-7b003bf7dea7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:21.256120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:21.257094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:21.258691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:21.258691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:21.276602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:21.278324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb9d5c-8826-4a3d-8fc3-b8cec2fa8c95 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:21.290611 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3438/6905] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:24.048240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.144923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8facea7-eee6-4164-8765-e69f91e03a59 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:24.149684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:24.150642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.151010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.151458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] PATH_INFO: `/v3/users/a74b01a75dff4dd081e81dfc99fd411b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.152641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74b01a75dff4dd081e81dfc99fd411b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:24.154671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:24.213224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74b01a75dff4dd081e81dfc99fd411b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.221793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74b01a75dff4dd081e81dfc99fd411b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.238398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74b01a75dff4dd081e81dfc99fd411b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.239393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74b01a75dff4dd081e81dfc99fd411b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.240392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74b01a75dff4dd081e81dfc99fd411b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.244235 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:24.258922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3468/6906] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:24 2022] DELETE /identity/v3/users/a74b01a75dff4dd081e81dfc99fd411b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:24.263930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.264479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.264571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.287188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:24.289018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.364897 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3439/6907] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:24.374872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.376592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.408777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.420220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.437534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409c44c-c16b-4b38-8fdb-4ec53f054f54 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:24.443371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:24.444437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.444907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.445341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] PATH_INFO: `/v3/users/58f25295b4324e4ebe7e8b589f95eac0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.446565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f25295b4324e4ebe7e8b589f95eac0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:24.448714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:24.454809 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:24.503449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026019-f2d9-47bc-895d-8873382f5236 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:24.506150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f25295b4324e4ebe7e8b589f95eac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.507016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f25295b4324e4ebe7e8b589f95eac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.509097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:24.509756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.510035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.510307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.512050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.515034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f25295b4324e4ebe7e8b589f95eac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.526995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:24.528354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f25295b4324e4ebe7e8b589f95eac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.528469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066d94-f2ea-43b8-b0bb-47e12757b4d9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:24.529089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f25295b4324e4ebe7e8b589f95eac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.539400 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3469/6908] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:24.544074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3440/6909] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:24 2022] DELETE /identity/v3/users/58f25295b4324e4ebe7e8b589f95eac0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:24.548893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.549326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.549639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.569689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:24.571017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.638101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3470/6910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:24.648535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.650340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.715071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d7cd8-130c-4200-9eb2-e5d72eb233ef admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:24.722184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.724180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:24.724902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.725256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.725357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.725658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.739062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c7165-cf2d-41ae-89b8-82075cc652f1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:24.739971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:24.741526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8579ae-bef4-4680-8499-eaf4d2070162 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:24.744272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:24.744907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.745554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.745832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] PATH_INFO: `/v3/projects/b3984bc8a1c14fc2b62bd4c8b121f14a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.746983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3984bc8a1c14fc2b62bd4c8b121f14a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:24.748936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:24.773653 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3441/6911] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:24.803822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3984bc8a1c14fc2b62bd4c8b121f14a', 'request_id': 'req-05f9ccad-be78-404f-be93-b1c56a7047b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.812571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3984bc8a1c14fc2b62bd4c8b121f14a', 'request_id': 'req-05f9ccad-be78-404f-be93-b1c56a7047b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.819207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3984bc8a1c14fc2b62bd4c8b121f14a', 'request_id': 'req-05f9ccad-be78-404f-be93-b1c56a7047b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.835565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] The token cache is being invalidate because project b3984bc8a1c14fc2b62bd4c8b121f14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:24.835863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.836533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-05f9ccad-be78-404f-be93-b1c56a7047b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:24.838404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3471/6912] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:24 2022] DELETE /identity/v3/projects/b3984bc8a1c14fc2b62bd4c8b121f14a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:24.843327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.844194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.844480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.865881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:24.867117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.949515 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3442/6913] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:24.960259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:24.960914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:24.961167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:24.982769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:24.984047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.990752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:24.992331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:24.993390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3472/6914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:24.997177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.007356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69230-fed6-4733-8e56-c57da6b17e98 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.010146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1945524-bb8f-402c-a702-6d95e82cb87e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.012360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.013006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.013288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.013597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] PATH_INFO: `/v3/projects/77536d7b35e34f7ba78fe5b0bb1cc97d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.014731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77536d7b35e34f7ba78fe5b0bb1cc97d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.017213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.017973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.019266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.020216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.020699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.021672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:25.022192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.023958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.035950 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.040096 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3473/6915] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:25.044780 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.046397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.058788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa62675-df73-43da-b3d0-30939e7b4e84 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.071156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77536d7b35e34f7ba78fe5b0bb1cc97d', 'request_id': 'req-85d400b7-d855-41aa-912a-fba434df92d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:25.077492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77536d7b35e34f7ba78fe5b0bb1cc97d', 'request_id': 'req-85d400b7-d855-41aa-912a-fba434df92d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:25.085002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77536d7b35e34f7ba78fe5b0bb1cc97d', 'request_id': 'req-85d400b7-d855-41aa-912a-fba434df92d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:25.101701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] The token cache is being invalidate because project 77536d7b35e34f7ba78fe5b0bb1cc97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:25.102244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:25.102899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-85d400b7-d855-41aa-912a-fba434df92d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:25.104728 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3443/6916] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:24 2022] DELETE /identity/v3/projects/77536d7b35e34f7ba78fe5b0bb1cc97d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:25.109594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf2ab-b136-4099-a4dd-a8559937ff69 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.109886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf2ab-b136-4099-a4dd-a8559937ff69 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.110160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf2ab-b136-4099-a4dd-a8559937ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.119649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.120474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.120818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.121149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.121894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.124041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.130692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-92daf2ab-b136-4099-a4dd-a8559937ff69 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:25.131906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-92daf2ab-b136-4099-a4dd-a8559937ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.142211 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3444/6917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:25.151034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.151302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.151577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.161177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3474/6918] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:25.164973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.168257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.176104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:25.177386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.261771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1a6d-f18a-4232-ac35-51d10cfbb837 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.267310 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3445/6919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:25.269655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.270469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.270758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.271035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.271950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.272721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.273988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.284701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a341b7-cec5-44f3-81aa-0aa8fd276593 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.290097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.290801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.291136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.291416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.292070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:25.292365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.294107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.299600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3475/6920] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:25.303668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.306645 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3446/6921] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:30:25.311162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.315391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e14-390b-4b4c-8e97-07685d471da4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.321004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.321664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.321936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.322211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.322632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df3dfd-e85c-4b11-894c-23fd0bf98fac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.322859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.324590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.327493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.328827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.329257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.329568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.330188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.332083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.338641 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3476/6922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:25.339832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.349651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd2-0573-4f7d-8c32-35a28c27d74e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.354973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.355579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.355865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.356140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.356782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.358421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.361363 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3447/6923] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:25.365427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.374027 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3477/6924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:25.375497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.387248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bc51a-c5b0-4a8c-8b29-b0ed689efade admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.436766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaccdc-7f98-498b-ab9e-0fd025d2489c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.441648 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.443457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.444341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.444621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.444892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.445700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.447624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.451938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.452607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.453619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.454000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] PATH_INFO: `/v3/projects/f3fb455629224fa086ff8a67d0d32866/users/65e081c51ade4b93b075e401e621aab2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.467431 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.472438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fb455629224fa086ff8a67d0d32866, user_id=65e081c51ade4b93b075e401e621aab2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.475557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee70341-15f0-4ebe-8f2a-ba56764ff433 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.476249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3448/6925] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:25.480505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.493900 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3478/6926] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:25 2022] PUT /identity/v3/projects/f3fb455629224fa086ff8a67d0d32866/users/65e081c51ade4b93b075e401e621aab2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:25.498632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7f01-7eea-452e-90fe-8d4a5ecfc69a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.507582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.507871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.508151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.544058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] MFA Rules not processed for user `65e081c51ade4b93b075e401e621aab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:25.546533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.591189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.591822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.592104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.592383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.593259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.595170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.606222 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3449/6927] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:25.610286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.622755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91ad0e-494d-4bfc-b64a-5419b6c1e870 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.627434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.628046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.628326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.628598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.629237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.630905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.634829 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3479/6928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:25.639211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.644074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3450/6929] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:25.647860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.653263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150167e-547d-454b-94a4-cabc7a8dca90 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.659491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.659967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884b2b-72aa-4233-86ca-fa2570f19b38 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.660145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.660387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.660658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.661298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.663291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4771f-fce7-45e1-95b9-f132d9e3ab0f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.664921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.665623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.665916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.666194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] PATH_INFO: `/v3/projects/0d5940ad4ed646f6a2c2534b9d1f3768/users/445a43f6890e469db530fde400eb629a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.683075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5940ad4ed646f6a2c2534b9d1f3768, user_id=445a43f6890e469db530fde400eb629a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.687857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.702453 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3451/6930] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:25 2022] PUT /identity/v3/projects/0d5940ad4ed646f6a2c2534b9d1f3768/users/445a43f6890e469db530fde400eb629a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:25.705312 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3480/6931] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:25.714702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.717336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.717780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.718117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.756096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] MFA Rules not processed for user `445a43f6890e469db530fde400eb629a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:25.759626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.798407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949361-c9ab-47a4-8f0c-713e6d385683 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.859572 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3481/6932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:25.875680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.877465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:25.880594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.881362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.881810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.882095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.882762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.885039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.897094 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.915540 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3452/6933] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:25 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:25.919183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.927614 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:25.933786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da57ed-0658-44ba-baa4-0cf641a80aa6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.941703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.942257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.942769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.943095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.943759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:25.946150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:25.961781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3453/6934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:25.965658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:25.966134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ea4e0-9f42-4936-bed6-b03b1b3e99db None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.973909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.974586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.975004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.975933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:25.980357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a611-22c9-4dad-bb4f-4eb614a68bc4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:25.986977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:25.987795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:25.988173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:25.988515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] PATH_INFO: `/v3/projects/195db5b82dbc41b3bb1c3cd68e790736/users/b5e2824f05eb42388fab3501c4c5a9cd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.001943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.003422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.008134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195db5b82dbc41b3bb1c3cd68e790736, user_id=b5e2824f05eb42388fab3501c4c5a9cd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.010999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.016646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3482/6935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:30:26.030825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3454/6936] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:25 2022] PUT /identity/v3/projects/195db5b82dbc41b3bb1c3cd68e790736/users/b5e2824f05eb42388fab3501c4c5a9cd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:26.033125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:26.045121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0351-eace-43a4-a232-04f73474c899 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:26.115809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:26.116610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.116966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.117310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.118096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.120419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfa376-f4f0-4544-8500-f0efc65be6ce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.133882 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3483/6937] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:26.137752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:26.152419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acfec9-4027-4a81-a306-6e60a69d91c2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:26.160056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:26.161687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.162046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.162444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] PATH_INFO: `/v3/projects/195db5b82dbc41b3bb1c3cd68e790736/users/b5e2824f05eb42388fab3501c4c5a9cd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.164836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=195db5b82dbc41b3bb1c3cd68e790736, user_id=b5e2824f05eb42388fab3501c4c5a9cd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.169161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.183478 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3455/6938] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:26 2022] PUT /identity/v3/projects/195db5b82dbc41b3bb1c3cd68e790736/users/b5e2824f05eb42388fab3501c4c5a9cd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:26.194441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.194650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.194934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.202350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:26.204803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:26.235715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] MFA Rules not processed for user `b5e2824f05eb42388fab3501c4c5a9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:26.238769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:26.349375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130375-6a1b-4713-b379-cce3b1416a9b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:26.358236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:26.360283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.360764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.361447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.364232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:26.390997 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3484/6939] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:26.408571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:26.410477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:26.497381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.499426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.516388 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3456/6940] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:26.563090 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:26.581921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d54d7-2740-42a9-bcdf-e784ee91ae1e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:26.594634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:26.595047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.595368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.595690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.624088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.629106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.648337 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3485/6941] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:26.763124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:26.790592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3e30-fae8-4aec-92a9-f7b7ebaafcf9 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:26.799420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:26.806902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:26.807181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:26.807458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:26.889969 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:26.915299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:26.917578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c83c6-d404-472e-8700-637baaafb3b2 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:26.929166 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3457/6942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:30.190353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:30.332503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064602-c345-46a4-b22e-7074315f4244 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:30.341274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:30.341992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:30.342275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:30.342619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] PATH_INFO: `/v3/users/65e081c51ade4b93b075e401e621aab2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:30.343864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e081c51ade4b93b075e401e621aab2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:30.347425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:30.429424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e081c51ade4b93b075e401e621aab2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:30.456747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e081c51ade4b93b075e401e621aab2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:30.486955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e081c51ade4b93b075e401e621aab2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:30.487923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e081c51ade4b93b075e401e621aab2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:30.488699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e081c51ade4b93b075e401e621aab2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:30.517544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3486/6943] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:30 2022] DELETE /identity/v3/users/65e081c51ade4b93b075e401e621aab2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:30.522512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:30.523498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:30.524177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:30.561308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:30.563659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:30.696295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3458/6944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:30.738460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:30.740284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:30.828635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d566c8-716b-47e5-ac5a-6633e6f8eead admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:30.833147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:30.833863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:30.834092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:30.834376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:30.847523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:30.849448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:30.865457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3487/6945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:32.065475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:32.068330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:32.088791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b792c-c787-4d0f-a69c-5a780969646b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:32.101626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:32.103201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:32.103583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:32.103929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] PATH_INFO: `/v3/projects/f3fb455629224fa086ff8a67d0d32866` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:32.106505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fb455629224fa086ff8a67d0d32866)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:32.110950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:32.197116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fb455629224fa086ff8a67d0d32866', 'request_id': 'req-dec4e132-c04a-45ea-929d-6375cde5930d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.213917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fb455629224fa086ff8a67d0d32866', 'request_id': 'req-dec4e132-c04a-45ea-929d-6375cde5930d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.229917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fb455629224fa086ff8a67d0d32866', 'request_id': 'req-dec4e132-c04a-45ea-929d-6375cde5930d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.253759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] The token cache is being invalidate because project f3fb455629224fa086ff8a67d0d32866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:32.253759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.254961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.257982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3459/6946] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:32 2022] DELETE /identity/v3/projects/f3fb455629224fa086ff8a67d0d32866 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:32.262323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:32.277302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c7e0-6e14-4664-8276-115f80a4d86f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:32.297876 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:32.446329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:32.447819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:32.462049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:32.462536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:32.462825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:32.463100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] PATH_INFO: `/v3/users/b5e2824f05eb42388fab3501c4c5a9cd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:32.464417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e2824f05eb42388fab3501c4c5a9cd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:32.467550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:32.585734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e2824f05eb42388fab3501c4c5a9cd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.594980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e132-c04a-45ea-929d-6375cde5930d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:32.595441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e2824f05eb42388fab3501c4c5a9cd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.606116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:32.606766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:32.607059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:32.607328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] PATH_INFO: `/v3/users/445a43f6890e469db530fde400eb629a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:32.609875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=445a43f6890e469db530fde400eb629a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:32.611292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:32.621865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e2824f05eb42388fab3501c4c5a9cd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.623328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e2824f05eb42388fab3501c4c5a9cd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.623791 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:32.623967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26007b2a-9e1c-4232-83a1-4326d3b3367a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e2824f05eb42388fab3501c4c5a9cd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.649725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3488/6947] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:32 2022] DELETE /identity/v3/users/b5e2824f05eb42388fab3501c4c5a9cd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:32.722435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445a43f6890e469db530fde400eb629a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.723172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445a43f6890e469db530fde400eb629a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.736407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445a43f6890e469db530fde400eb629a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.754632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445a43f6890e469db530fde400eb629a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.755464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445a43f6890e469db530fde400eb629a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:32.780193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3460/6948] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:32 2022] DELETE /identity/v3/users/445a43f6890e469db530fde400eb629a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:32.783359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:32.784189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:32.785432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:32.811296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:32.813315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:32.908904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3489/6949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:32.919293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:32.920725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.001138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811339dc-6fe9-40d1-8fef-f1ca7482cd2e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.006298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.007103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.007558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.007978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.033783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.035346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.052270 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3461/6950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:33.181200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.182664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.199087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ec8d7-d47a-4fec-834c-bafa7cfab02f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.208048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.208048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.208315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.208594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] PATH_INFO: `/v3/projects/195db5b82dbc41b3bb1c3cd68e790736` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.214740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=195db5b82dbc41b3bb1c3cd68e790736)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.217547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.277106 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:33.309692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195db5b82dbc41b3bb1c3cd68e790736', 'request_id': 'req-996f245c-988e-43b9-a791-979312bd2bfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.318156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195db5b82dbc41b3bb1c3cd68e790736', 'request_id': 'req-996f245c-988e-43b9-a791-979312bd2bfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.327268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.331000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.335402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195db5b82dbc41b3bb1c3cd68e790736', 'request_id': 'req-996f245c-988e-43b9-a791-979312bd2bfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.360889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ac143-ba58-4835-96d0-b350efb859c4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.369907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] The token cache is being invalidate because project 195db5b82dbc41b3bb1c3cd68e790736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:33.370618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.372049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-996f245c-988e-43b9-a791-979312bd2bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.374374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3490/6951] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:33 2022] DELETE /identity/v3/projects/195db5b82dbc41b3bb1c3cd68e790736 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:33.389799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb5ed-468a-4148-b57d-2ae1093ce771 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.390313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb5ed-468a-4148-b57d-2ae1093ce771 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.390746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb5ed-468a-4148-b57d-2ae1093ce771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.427494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e0efb5ed-468a-4148-b57d-2ae1093ce771 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:33.430100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0efb5ed-468a-4148-b57d-2ae1093ce771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.511736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.512660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.514463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.514752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] PATH_INFO: `/v3/projects/0d5940ad4ed646f6a2c2534b9d1f3768` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.517614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5940ad4ed646f6a2c2534b9d1f3768)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.518195 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3491/6952] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:33.521534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.528201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.528201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.528201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.552932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:33.554267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.567734 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3492/6953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:33.572307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.585148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667cf3-46e5-4859-8c48-4a90ca127316 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.587683 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:33.591271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.592027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.592426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.592777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.594269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:33.594653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.596497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.611396 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3493/6954] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:33.613489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5940ad4ed646f6a2c2534b9d1f3768', 'request_id': 'req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.615555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.628880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f30b8-18b6-4cfd-8b30-13cdf63e3108 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.629832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5940ad4ed646f6a2c2534b9d1f3768', 'request_id': 'req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.641702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5940ad4ed646f6a2c2534b9d1f3768', 'request_id': 'req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.661925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] The token cache is being invalidate because project 0d5940ad4ed646f6a2c2534b9d1f3768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:33.662233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.662971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-055b9e19-b5a5-475d-ac9d-d56bfdcdc531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:33.664578 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3462/6955] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:33 2022] DELETE /identity/v3/projects/0d5940ad4ed646f6a2c2534b9d1f3768 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:33.670119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a2ad5-efb0-424b-811c-34ba645aa9bf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.671186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a2ad5-efb0-424b-811c-34ba645aa9bf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.671186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a2ad5-efb0-424b-811c-34ba645aa9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.697595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1d4a2ad5-efb0-424b-811c-34ba645aa9bf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:33.699294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1d4a2ad5-efb0-424b-811c-34ba645aa9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.711865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.712782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.714107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.714576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.715489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.718047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.772800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3494/6956] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:33.777651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.779439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.809239 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:33.814443 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3463/6957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:33.827797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.828460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.829026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.857582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:33.858850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:33.868082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94746d-ccf1-4340-8abc-e07493c73691 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.870416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3464/6958] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:33.874753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.875234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.876023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.876376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.876728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.877365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.879364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.886449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19390069-86ba-425f-b2fa-0c7c8856819a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.892121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.892857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.893220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.893541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.894347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:33.894606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.896359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.910442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3465/6959] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:30:33.914165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3495/6960] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:33.914767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.915298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:33.928785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c4452-f116-469a-9faf-fae0d705d253 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.934705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.935455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.936000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.936406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.947932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.953438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.953871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d84011-43d6-494f-811b-bde56de76b46 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:33.960546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:33.960929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:33.961247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:33.961567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:33.962226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:33.965166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:33.980970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3466/6961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:33.985252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.013983 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3496/6962] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:33 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:34.016703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9aee-2651-41cf-a261-0157d0fbc1a3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.019342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.118003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.118634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.118914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.119191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.119989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.121784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.130745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac75d9-37dd-442d-9586-5563487c7ae0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.138065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3467/6963] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:34.141472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.141472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.141472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.141472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.141897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.142364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.143582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.156259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65720f66-e056-490a-a16d-83f449407880 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.165121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.166134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.166568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.167042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] PATH_INFO: `/v3/projects/0c17b639af7d46008b9f07e80c4ce0bf/users/e6f957970d494b77bffa4d6aba319aad/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.173344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3497/6964] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:34 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:34.177263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.192340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c17b639af7d46008b9f07e80c4ce0bf, user_id=e6f957970d494b77bffa4d6aba319aad, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.192942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af97c1-f94b-4571-aac9-ff0985b20412 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.199899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.200505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.207331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98ea48-4a47-41c3-97bd-ab1a2c561fc9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.210876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.211351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.219798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.221885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.235097 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:34.246523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3498/6965] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:34.249173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.257017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3468/6966] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:34 2022] PUT /identity/v3/projects/0c17b639af7d46008b9f07e80c4ce0bf/users/e6f957970d494b77bffa4d6aba319aad/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:34.299280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841b2c9-912d-48a3-befe-96560efe0eb4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.372873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.373360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.373540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.448535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] MFA Rules not processed for user `e6f957970d494b77bffa4d6aba319aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:34.449806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:34.512991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.518063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.519407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.521557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.522424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.528818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.566292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3499/6967] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:34.572413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.599825 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:34.610673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0560-1ff3-459f-be64-0b781675ec0f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.641850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.642910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.643888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.644178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] PATH_INFO: `/v3/projects/61086d3269e64f8595e852e02b06ce72/users/66d5f65baa6b48048b427d8b06a120a7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.686922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61086d3269e64f8595e852e02b06ce72, user_id=66d5f65baa6b48048b427d8b06a120a7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.689701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce85ea-b3c6-4b19-bf72-d2bf4098f3b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.704029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3469/6968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:34.704977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.727546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3500/6969] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:34 2022] PUT /identity/v3/projects/61086d3269e64f8595e852e02b06ce72/users/66d5f65baa6b48048b427d8b06a120a7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:34.733012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54442-bcc6-4ce2-85c2-70a48e84ea6e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:34.738977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.740944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.740944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.818731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] MFA Rules not processed for user `66d5f65baa6b48048b427d8b06a120a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:34.822591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:34.913815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:34.915394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:34.915689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:34.915970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:34.917909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:34.920378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:34.982526 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3470/6970] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:34 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:34.983542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:34.996998 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3501/6971] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:35.003357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.020746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bebd74-6668-4799-bf89-04ad25ca86e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.125188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46773fdd-a429-421f-a395-b5c23a648335 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.139565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.141395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.141910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.142197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.142597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.142971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.143185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.143286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.143524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.144155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.145859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.149428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.194958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3502/6972] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:35 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:35.197396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.200351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3471/6973] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:34 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:35.205126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.212615 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:35.222980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b600-d0dd-4393-941c-7895fdaa36fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.338293 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:35.355965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.357068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.357470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.359221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.360123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.363298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd863-12c1-4aa1-b935-239686ba857f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.364593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.376864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.377868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.378299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.380496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.380496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.385455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.389045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3472/6974] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:35.393975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.424845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45730-ba86-4553-93b4-be00ae74656f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.432621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.433712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.434145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.434575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] PATH_INFO: `/v3/projects/7bdc37bafda041c7b49fe84c48019de8/users/e7beea25ff4944489dbd533190af396f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.434739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3503/6975] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:35 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:35.450061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.477186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d642-aa9f-4cdc-b418-7caaba199a9c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.485510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdc37bafda041c7b49fe84c48019de8, user_id=e7beea25ff4944489dbd533190af396f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.489830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.491414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.492575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.493066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.493994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.494844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.497157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.517359 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3473/6976] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:35 2022] PUT /identity/v3/projects/7bdc37bafda041c7b49fe84c48019de8/users/e7beea25ff4944489dbd533190af396f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:35.521575 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3504/6977] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:35.522821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.523213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.541419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf08d-7a0b-4cc1-92c7-c418dcdca7a7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.651744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f15d7-197e-41ba-ad16-48610ddf72a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.660756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.661507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.661744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.662021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] PATH_INFO: `/v3/projects/57189361d98b47bea1b60b4a2971dc90/users/b3f1646b06e64dc6a348300dae9cd3f1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.671134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.673336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.675463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.676558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.678511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.680533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.691758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57189361d98b47bea1b60b4a2971dc90, user_id=b3f1646b06e64dc6a348300dae9cd3f1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.699570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.717686 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3474/6978] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:35.724100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.735049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3505/6979] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:35 2022] PUT /identity/v3/projects/57189361d98b47bea1b60b4a2971dc90/users/b3f1646b06e64dc6a348300dae9cd3f1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:35.742741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.756809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9d919-2e60-48cb-bcba-2e437de2627f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.910519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07977-f8fb-4931-bd1b-c394a98d8464 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:35.912966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.913797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.914190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.914598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] PATH_INFO: `/v3/projects/7bdc37bafda041c7b49fe84c48019de8/users/e7beea25ff4944489dbd533190af396f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.918370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdc37bafda041c7b49fe84c48019de8, user_id=e7beea25ff4944489dbd533190af396f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.918641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:35.919276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.919559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.919832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:35.921290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:35.922461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.928229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eda9e6-c41c-4214-b787-b9ef43af9434 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:35.944676 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3506/6980] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:35.949124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:35.986287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3475/6981] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:35 2022] PUT /identity/v3/projects/7bdc37bafda041c7b49fe84c48019de8/users/e7beea25ff4944489dbd533190af396f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:35.989747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:35.991061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:35.991291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:36.001328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcf2d-aa06-490d-b00d-8f83d51a64a1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:36.013336 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:36.036016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] MFA Rules not processed for user `e7beea25ff4944489dbd533190af396f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:36.037237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:36.084787 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:36.112340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:36.113037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:36.113323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:36.113629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] PATH_INFO: `/v3/projects/57189361d98b47bea1b60b4a2971dc90/users/b3f1646b06e64dc6a348300dae9cd3f1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:36.119409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57189361d98b47bea1b60b4a2971dc90, user_id=b3f1646b06e64dc6a348300dae9cd3f1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:36.122639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08cf6c-5600-4d66-8848-c1c77a86432b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:36.141558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3476/6982] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:36.154486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:36.157174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:36.168878 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3507/6983] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:35 2022] PUT /identity/v3/projects/57189361d98b47bea1b60b4a2971dc90/users/b3f1646b06e64dc6a348300dae9cd3f1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:36.181229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:36.181694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:36.182035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:36.246512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] MFA Rules not processed for user `b3f1646b06e64dc6a348300dae9cd3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:36.250491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:36.315939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6f32a-a9bf-40b4-8969-48c7f87bb185 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:36.471358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:36.472789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:36.473223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:36.473679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:36.475326 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3508/6984] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:36.555005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:36.557069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:36.564841 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:36.580299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3477/6985] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:36.630575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:36.646086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a22f41-8eff-409a-aaca-aa77c2bf054c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:36.654871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:36.656156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:36.656791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:36.657394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:36.673705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:36.675725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:36.694124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3509/6986] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:38.106860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:38.192688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:38.284749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79477-6678-4c7c-aba1-a65f14a6c6ea service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:38.305615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:38.308633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:38.310305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:38.312126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] PATH_INFO: `/v3/users/e6f957970d494b77bffa4d6aba319aad` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:38.317460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f957970d494b77bffa4d6aba319aad)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:38.332512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:38.338573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83d1a8-86b4-41a1-8353-d3f056959488 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:38.350646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:38.351432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:38.351809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:38.352207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] PATH_INFO: `/v3/users/66d5f65baa6b48048b427d8b06a120a7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:38.353499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d5f65baa6b48048b427d8b06a120a7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:38.355551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:38.458474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d5f65baa6b48048b427d8b06a120a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.469908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d5f65baa6b48048b427d8b06a120a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.472357 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:38.497768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d5f65baa6b48048b427d8b06a120a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.500092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d5f65baa6b48048b427d8b06a120a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.501609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-34df2baf-91d9-4ab8-b80e-6a4ccc0dafdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d5f65baa6b48048b427d8b06a120a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.519082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f957970d494b77bffa4d6aba319aad'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.520748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f957970d494b77bffa4d6aba319aad'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.533970 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3510/6987] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:38 2022] DELETE /identity/v3/users/66d5f65baa6b48048b427d8b06a120a7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:38.544485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f957970d494b77bffa4d6aba319aad'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.545979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:38.546655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:38.547770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:38.604702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f957970d494b77bffa4d6aba319aad'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.607149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2cad73f8-730d-4eb7-852a-673ca39cd17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f957970d494b77bffa4d6aba319aad'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:38.610080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:38.614796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:38.659294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3478/6988] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:38 2022] DELETE /identity/v3/users/e6f957970d494b77bffa4d6aba319aad => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:38.675638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:38.678017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:38.680085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:38.728036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:38.729676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:38.804701 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3511/6989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:38.840281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:38.842371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:38.959878 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3479/6990] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:38.991187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:38.992943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:39.075614 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:39.151351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0aa84-86aa-42b0-a4e5-3e5ea6c15c02 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:39.199595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb4592-a64d-45a0-8bfc-12968e294cb9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:39.205965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:39.210625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:39.211178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:39.211995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:39.225614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:39.227431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:39.271320 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3480/6991] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:30:39.335343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:39.335986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:39.336274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:39.336552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:39.381170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:39.386113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:39.441397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3512/6992] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:30:39.879922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:39.885298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:39.967918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd59-9cce-43be-b1f2-ade26bfdb7c8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:39.982372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:39.983036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:39.983319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:39.984157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] PATH_INFO: `/v3/projects/61086d3269e64f8595e852e02b06ce72` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:39.985495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61086d3269e64f8595e852e02b06ce72)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:39.987412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:40.119541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61086d3269e64f8595e852e02b06ce72', 'request_id': 'req-4360c1de-3fce-434f-bd67-2caee73f513b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.145397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61086d3269e64f8595e852e02b06ce72', 'request_id': 'req-4360c1de-3fce-434f-bd67-2caee73f513b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.178592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61086d3269e64f8595e852e02b06ce72', 'request_id': 'req-4360c1de-3fce-434f-bd67-2caee73f513b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.205639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] The token cache is being invalidate because project 61086d3269e64f8595e852e02b06ce72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:40.206680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.207555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.209630 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3481/6993] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:39 2022] DELETE /identity/v3/projects/61086d3269e64f8595e852e02b06ce72 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:40.213439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:40.238961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ad7e-8f23-4b47-8089-2191e7d09539 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:40.286118 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:40.320502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:40.321277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:40.321865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:40.322248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] PATH_INFO: `/v3/users/b3f1646b06e64dc6a348300dae9cd3f1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:40.323501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f1646b06e64dc6a348300dae9cd3f1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:40.325687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:40.392292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f1646b06e64dc6a348300dae9cd3f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.404496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f1646b06e64dc6a348300dae9cd3f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.457659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f1646b06e64dc6a348300dae9cd3f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.461673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f1646b06e64dc6a348300dae9cd3f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.466971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f1646b06e64dc6a348300dae9cd3f1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.501180 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3513/6994] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:40 2022] DELETE /identity/v3/users/b3f1646b06e64dc6a348300dae9cd3f1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:40.609621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:40.611446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:40.633661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360c1de-3fce-434f-bd67-2caee73f513b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:40.786187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:40.799503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:40.799788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:40.800178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] PATH_INFO: `/v3/projects/0c17b639af7d46008b9f07e80c4ce0bf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:40.801460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c17b639af7d46008b9f07e80c4ce0bf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:40.803531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:40.888025 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:40.895073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c17b639af7d46008b9f07e80c4ce0bf', 'request_id': 'req-5dbb1953-021b-4249-9d84-90481ad7da58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.908139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c17b639af7d46008b9f07e80c4ce0bf', 'request_id': 'req-5dbb1953-021b-4249-9d84-90481ad7da58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.917972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c17b639af7d46008b9f07e80c4ce0bf', 'request_id': 'req-5dbb1953-021b-4249-9d84-90481ad7da58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.940192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] The token cache is being invalidate because project 0c17b639af7d46008b9f07e80c4ce0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:40.940866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.942026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:40.944947 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3482/6995] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:40 2022] DELETE /identity/v3/projects/0c17b639af7d46008b9f07e80c4ce0bf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:40.950278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:40.951816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:40.972306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485032f6-511e-44f0-adef-5aeeec437316 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.022163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.024138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.069608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.070384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.070763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.071134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] PATH_INFO: `/v3/users/e7beea25ff4944489dbd533190af396f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.080993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7beea25ff4944489dbd533190af396f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.083617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.162413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7beea25ff4944489dbd533190af396f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.172949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1953-021b-4249-9d84-90481ad7da58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.174617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7beea25ff4944489dbd533190af396f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.177059 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:41.178352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.179263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.179706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.180137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] PATH_INFO: `/v3/projects/57189361d98b47bea1b60b4a2971dc90` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.181610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57189361d98b47bea1b60b4a2971dc90)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.183786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.207801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7beea25ff4944489dbd533190af396f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.208901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7beea25ff4944489dbd533190af396f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.209730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7beea25ff4944489dbd533190af396f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.246749 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3514/6996] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:40 2022] DELETE /identity/v3/users/e7beea25ff4944489dbd533190af396f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:41.296845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.298351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.357331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57189361d98b47bea1b60b4a2971dc90', 'request_id': 'req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.373634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57189361d98b47bea1b60b4a2971dc90', 'request_id': 'req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.398248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57189361d98b47bea1b60b4a2971dc90', 'request_id': 'req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.432450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] The token cache is being invalidate because project 57189361d98b47bea1b60b4a2971dc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:41.432747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.435254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-26fe01bf-d0d2-4aaf-a8fc-839bf1162b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.445617 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3483/6997] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:41 2022] DELETE /identity/v3/projects/57189361d98b47bea1b60b4a2971dc90 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:41.448159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.448454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.449555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.478851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab8382-b42a-4b7d-b9e4-4e6711a4b7f9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.489741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:41.491326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.625709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.627774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.628060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.628345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.633161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.675944 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3484/6998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:41.675944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.683765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.699309 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:41.712124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b9cb-b3ff-4882-b7ed-0cb0ec06d51e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.718307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.718997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.719288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.719563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.721709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.774039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.776658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90701afd-0496-4f23-a8ba-dec565f98dc4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.795391 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3515/6999] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:41.798235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.798526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.798806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.820893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.822330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.826885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:41.828819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.842148 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3485/7001] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:41.842902 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3516/7001] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:41.843893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.856910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a02cfe-7c22-459d-b96e-edf327854631 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.858240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.863044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.863343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.864020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.870350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.870783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.871380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:41.871688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.874329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.876917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c21f-874d-4589-8e2a-ded9e2410c6c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.882064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.882714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.883030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.883308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] PATH_INFO: `/v3/projects/7bdc37bafda041c7b49fe84c48019de8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.884455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdc37bafda041c7b49fe84c48019de8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.886638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.900837 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3486/7002] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:30:41.905108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.913477 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:41.920636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7702-c934-44fe-818e-cd2598819459 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:41.928036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:41.928647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.928921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.929201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:41.929854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:41.931951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:41.947215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdc37bafda041c7b49fe84c48019de8', 'request_id': 'req-65c22797-486a-4301-861f-53d1bfdc509b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.955049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdc37bafda041c7b49fe84c48019de8', 'request_id': 'req-65c22797-486a-4301-861f-53d1bfdc509b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.962424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdc37bafda041c7b49fe84c48019de8', 'request_id': 'req-65c22797-486a-4301-861f-53d1bfdc509b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.975851 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3487/7003] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:41 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:41.976939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] The token cache is being invalidate because project 7bdc37bafda041c7b49fe84c48019de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:41.977480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.978141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-65c22797-486a-4301-861f-53d1bfdc509b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:41.978891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:41.983035 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3517/7004] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:41 2022] DELETE /identity/v3/projects/7bdc37bafda041c7b49fe84c48019de8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:41.985903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:41.986640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237f5f-68c7-4e6f-b487-bf42cd5884b6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:41.986857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237f5f-68c7-4e6f-b487-bf42cd5884b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:41.987029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237f5f-68c7-4e6f-b487-bf42cd5884b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.019164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac237f5f-68c7-4e6f-b487-bf42cd5884b6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:42.020945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac237f5f-68c7-4e6f-b487-bf42cd5884b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:42.085622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761618d2-d271-4094-b3df-f52f49c22976 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.095354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.096110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.096529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.096929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.097722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.099842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.102859 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3518/7005] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:42.112410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.113319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.113319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.128112 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3488/7006] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:41 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:42.133258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.136681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:42.138002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:42.146797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111bf28-bd03-4d2a-8b6f-535bfcce9646 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.147998 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3519/7007] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:42.152473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.156375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.157003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.157281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.157601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.158465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.160726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.163617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800d028-6171-48e9-9f14-75e834987af1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.168804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.170014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.170184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.170531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.171291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:42.171666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.173347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.174552 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3489/7008] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:42.175457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.187965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ded428-74a9-4062-b967-921f44f8f034 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.197140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.197789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.198189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.198847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.199516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.204185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3520/7009] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:42.204329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.205305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.216408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8681-9cd8-45cb-805a-006bb151d0cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.217429 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3490/7010] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:42.225115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.238871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.238871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.239178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.239533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.240037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7f67-74f1-4573-842b-8fc99778e38b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.240378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.242420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.244980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.245964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.246984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.247901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] PATH_INFO: `/v3/projects/45bcd2e8bede4193b99ffe81b162729f/users/418ca12a6a2f4f7588f606227aefb0d7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.277645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bcd2e8bede4193b99ffe81b162729f, user_id=418ca12a6a2f4f7588f606227aefb0d7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.280363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d791d8-bb61-4615-b12e-39894f8d402b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.299220 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:42.304685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3521/7011] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:42.312652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.337237 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3491/7012] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:42 2022] PUT /identity/v3/projects/45bcd2e8bede4193b99ffe81b162729f/users/418ca12a6a2f4f7588f606227aefb0d7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:42.346559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.346963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.347392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.399231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] MFA Rules not processed for user `418ca12a6a2f4f7588f606227aefb0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:42.402823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:42.454513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad32b-55f0-499c-ad86-fc854d668baf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.463117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.463902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.464242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.464580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.465839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.470088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.492725 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:42.516432 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3522/7013] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:42.520259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.557834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46781f-73f9-4364-a627-7cbd4ed26afd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.566714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.566714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.566714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.566714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.567023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.569626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.578568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3492/7014] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:42.580842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.585669 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3523/7015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:42.587033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.598220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526e53-9c13-4e83-88e8-0b05cbb48c90 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.598760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b0212-64a1-468b-9561-6f86abb43cc2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.603437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.604732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.605025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.605198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.605319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.605996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.606259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.606685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.607130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.607762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.608183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.610524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.630091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3524/7016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:42.631182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.643970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae36c54-7a05-45b1-adbd-12f5e3934b6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.659550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.660780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.661297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.664751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3493/7017] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/projects => generated 363 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:42.665638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] PATH_INFO: `/v3/projects/ec79918a39c740ce91e60741c0633e3f/users/ef9d74ba852042a6b56abf5bb22d771b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.666646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.686382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec79918a39c740ce91e60741c0633e3f, user_id=ef9d74ba852042a6b56abf5bb22d771b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.690658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f3fbb-4e18-4071-bc20-4aa4dea32b81 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.732324 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3525/7018] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:42 2022] PUT /identity/v3/projects/ec79918a39c740ce91e60741c0633e3f/users/ef9d74ba852042a6b56abf5bb22d771b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:42.753044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.753341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.756377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.805931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f3a3-779b-4826-805a-28acbbaf7c7a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.818713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] MFA Rules not processed for user `ef9d74ba852042a6b56abf5bb22d771b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:42.820315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:42.912730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.913142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.913456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.913852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.914492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.917602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.941547 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3526/7019] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:42.946406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.946809 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3494/7020] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:42.950697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:42.958680 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:42.964741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b660-4345-4e1b-a409-279a1e8f8ac2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.981881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c44ecd-f6d9-402b-8d4f-b4515c937682 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:42.985752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.986478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.986893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.987198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.988098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.989740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:42.990223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:42.990466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:42.990820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:42.991164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:42.992224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:42.994147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.013078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3495/7021] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:43.014187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.027081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56161997-cec9-405c-991d-a622d1e7e067 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.034452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.035355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.035724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.036041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] PATH_INFO: `/v3/projects/d518cafb365a4fd998f365d39143866e/users/ab89527348a442918fd23361283d5fb4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.045142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3527/7022] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:42 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:43.046783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.055100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d518cafb365a4fd998f365d39143866e, user_id=ab89527348a442918fd23361283d5fb4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.057988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.075612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3496/7023] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:43 2022] PUT /identity/v3/projects/d518cafb365a4fd998f365d39143866e/users/ab89527348a442918fd23361283d5fb4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:43.079422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.127078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51911b13-be7d-4ff7-9219-77c012e594d0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.140266 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:43.158052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3e92-8b2a-4bbf-86a7-33603baf5b63 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.163379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.163995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.164268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.165754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.165891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.167631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.184012 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3497/7024] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:43.189060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.201110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.201765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.202050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.202174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2cbd-7905-42df-90c9-86800c1ed7b9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.202376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.203011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.205202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.209029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.209960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.210309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.211009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] PATH_INFO: `/v3/projects/d518cafb365a4fd998f365d39143866e/users/ab89527348a442918fd23361283d5fb4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.213440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d518cafb365a4fd998f365d39143866e, user_id=ab89527348a442918fd23361283d5fb4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.219174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1045df-9d1e-40f7-80da-ce60981b07ec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.237816 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3528/7025] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:43 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:43.238063 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3498/7026] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:43 2022] PUT /identity/v3/projects/d518cafb365a4fd998f365d39143866e/users/ab89527348a442918fd23361283d5fb4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:30:43.239255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.248721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.249044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.251884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.254588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c8b3-8e67-48bb-8c41-b9c2a02879b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.329112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] MFA Rules not processed for user `ab89527348a442918fd23361283d5fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:43.330862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:43.366528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.367104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.367384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.367952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.368300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.370630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.390221 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3529/7027] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:43.391147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.415113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10f53-41c4-42e7-a61f-43048d9cbe9a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.433680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.434467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.435864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.438287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] PATH_INFO: `/v3/projects/8a4fb07cb90e432c925c625877acf917/users/900674b4d2e54c8babc5be61b872855e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.466603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4fb07cb90e432c925c625877acf917, user_id=900674b4d2e54c8babc5be61b872855e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.471094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.481447 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3499/7028] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:43.490737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.492902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:43.501433 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3530/7029] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:43 2022] PUT /identity/v3/projects/8a4fb07cb90e432c925c625877acf917/users/900674b4d2e54c8babc5be61b872855e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:43.505652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.551651 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:43.576774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9eac-0ac5-4929-92ac-bee2e71eb660 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.586576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92d74-4575-4dae-87dc-88fdcfd24590 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.592183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.592800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.593894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.594175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.594946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.596558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.606817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3531/7030] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:43.611650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.624029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8a11c-211b-4802-89cf-53f0819705b4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.630637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.631305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.631971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.632094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] PATH_INFO: `/v3/projects/8a4fb07cb90e432c925c625877acf917/users/900674b4d2e54c8babc5be61b872855e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.634529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4fb07cb90e432c925c625877acf917, user_id=900674b4d2e54c8babc5be61b872855e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.636623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.637309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.637545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad15b0-f886-4907-8fa7-865e5e88614f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.637721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.638108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.649785 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:43.653085 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3532/7031] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:43 2022] PUT /identity/v3/projects/8a4fb07cb90e432c925c625877acf917/users/900674b4d2e54c8babc5be61b872855e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:43.663236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.663952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.663952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.719877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] MFA Rules not processed for user `900674b4d2e54c8babc5be61b872855e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:43.721513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:43.740545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.742209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.756499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3500/7032] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:43.864524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.879358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b6fa-7da7-47a1-8ceb-e9bf3f5c2d87 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.885844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3533/7033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:43.893756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:43.895178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:43.946453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.947320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.947572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.947845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.959675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c14f-8b0e-49e9-b578-f8a5821e8e4c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:43.963631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:43.964412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:43.964696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:43.964968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:43.975547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:43.977070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:43.989797 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3534/7034] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:30:44.023509 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:44.031810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:44.033283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a04f1-be8e-49dd-9266-e8fac3f4406a service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:44.043883 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3501/7035] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:30:44.401585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:44.472113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510ed-724b-4d31-b76e-17645ae5989f service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:44.476786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:44.477441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:44.477729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:44.477999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] PATH_INFO: `/v3/users/ef9d74ba852042a6b56abf5bb22d771b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:44.479133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9d74ba852042a6b56abf5bb22d771b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:44.481094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:44.520929 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:44.534744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9d74ba852042a6b56abf5bb22d771b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:44.541607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9d74ba852042a6b56abf5bb22d771b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:44.554167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9d74ba852042a6b56abf5bb22d771b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:44.554849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9d74ba852042a6b56abf5bb22d771b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:44.555477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9d74ba852042a6b56abf5bb22d771b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:44.568411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3535/7036] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:44 2022] DELETE /identity/v3/users/ef9d74ba852042a6b56abf5bb22d771b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:44.572889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:44.573330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:44.573472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:44.592320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:44.593581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:44.653968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3502/7037] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:44.663885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:44.665307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:44.726085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7d46-bd5f-4974-bd3b-04655f5d40ae admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:44.729833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:44.730440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:44.730717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:44.730987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:44.740929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:44.742378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:44.752840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3536/7038] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:45.053189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:45.054704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:45.073770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb0b9-e124-44b1-8cbb-11c2d4055e37 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:45.082963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:45.083684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:45.083971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:45.084246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] PATH_INFO: `/v3/projects/ec79918a39c740ce91e60741c0633e3f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:45.085392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec79918a39c740ce91e60741c0633e3f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:45.087510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:45.142827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec79918a39c740ce91e60741c0633e3f', 'request_id': 'req-57e05b7d-70d8-4405-b05d-caafc8da22fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.149321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec79918a39c740ce91e60741c0633e3f', 'request_id': 'req-57e05b7d-70d8-4405-b05d-caafc8da22fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.155414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec79918a39c740ce91e60741c0633e3f', 'request_id': 'req-57e05b7d-70d8-4405-b05d-caafc8da22fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.167734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] The token cache is being invalidate because project ec79918a39c740ce91e60741c0633e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:45.168026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.168660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.170205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3503/7039] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:45 2022] DELETE /identity/v3/projects/ec79918a39c740ce91e60741c0633e3f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:45.174793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:45.186024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a9b8-af22-4490-90a9-4c191c9a9543 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:45.257035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:45.258016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:45.258513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:45.258866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] PATH_INFO: `/v3/users/900674b4d2e54c8babc5be61b872855e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:45.260493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=900674b4d2e54c8babc5be61b872855e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:45.263289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:45.321361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900674b4d2e54c8babc5be61b872855e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.326522 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:45.331496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900674b4d2e54c8babc5be61b872855e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.347558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900674b4d2e54c8babc5be61b872855e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.348384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900674b4d2e54c8babc5be61b872855e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.349093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-151339f0-7d90-4cd0-9e4f-afc8c0631d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900674b4d2e54c8babc5be61b872855e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:45.365756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3537/7040] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:45 2022] DELETE /identity/v3/users/900674b4d2e54c8babc5be61b872855e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:45.772287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:45.773949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:45.795899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e05b7d-70d8-4405-b05d-caafc8da22fc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:45.925843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:45.926601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:45.928521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:45.928875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] PATH_INFO: `/v3/projects/8a4fb07cb90e432c925c625877acf917` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:45.930764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4fb07cb90e432c925c625877acf917)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:45.938433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:45.997859 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:46.033681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4fb07cb90e432c925c625877acf917', 'request_id': 'req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:46.041966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4fb07cb90e432c925c625877acf917', 'request_id': 'req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:46.048741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4fb07cb90e432c925c625877acf917', 'request_id': 'req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:46.065654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] The token cache is being invalidate because project 8a4fb07cb90e432c925c625877acf917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:46.065999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:46.066675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c3bb541d-09be-4d16-a81b-8a1fece5f1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:46.071527 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3504/7041] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:45 2022] DELETE /identity/v3/projects/8a4fb07cb90e432c925c625877acf917 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:46.073297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.073825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.073921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.101872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:46.103328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:46.229082 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3538/7042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:46.230915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.231347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.231756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.258276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:46.260470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:46.275877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.276608 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3505/7043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:46.299152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0f2b-25ff-4f47-8c37-d1d579d8deef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.309359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.310259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.310644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.311020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.311929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:46.312418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.314688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.332129 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3539/7044] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:30:46.336158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.350181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0b79f-4477-4fff-82e3-532d5315dafc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.356155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.357130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.357586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.357968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.359504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.361726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.412298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3506/7045] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:46 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:46.430179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.443545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab55e-07da-4f45-98bb-7c18da666cf7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.583925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.586764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.587085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.587538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.601906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.606002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.638687 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3540/7046] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:46 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:46.641542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.657383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d555e6-18e3-47be-98c4-f79c6004d6e3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.694337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.694968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.696205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.696205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.697621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.699286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.716135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3507/7047] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:46.717475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.734182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd7b2-114a-4d05-9a3f-aaeb074e4d9c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.741824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.742469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.743060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.743414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.744344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.746933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0b256-854b-4f67-85a9-e9ff013178fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.811384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3541/7048] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:46.817209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:46.831139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88d3b-a9aa-4aab-9521-947c3633eb8b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:46.836958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:46.837817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.838085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.838599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] PATH_INFO: `/v3/projects/f79e0cc480824992bcb054678934a99c/users/7a3b82fa47d14302a8716a0da82a1d5f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.870192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79e0cc480824992bcb054678934a99c, user_id=7a3b82fa47d14302a8716a0da82a1d5f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:46.875027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:46.918863 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3508/7049] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:46 2022] PUT /identity/v3/projects/f79e0cc480824992bcb054678934a99c/users/7a3b82fa47d14302a8716a0da82a1d5f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:46.931643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:46.931935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:46.932216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:46.965625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] MFA Rules not processed for user `7a3b82fa47d14302a8716a0da82a1d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:46.966917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:46.993733 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:47.051941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3542/7050] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:47.052791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.129465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d78c8-220a-442c-acdc-322d2c013a6d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.137103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.137835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.138190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.138537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.139253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.141949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.172287 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3509/7051] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:47 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:30:47.176417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.192230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c4e7f-784c-4e6c-ae8f-09bf3a97e16d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.298336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.298960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.299241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.299513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.300143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.304284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.331193 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3543/7052] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:47 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:47.332245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.348520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e021-28c5-43e6-ade9-a05ff9a4055c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.364772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.366041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.366651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.367183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.368152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.369942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.383536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3510/7053] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:47.388118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.399388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3022-9678-45cb-a87d-f9c6dabceb9b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.404737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.405643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.405956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.406045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] PATH_INFO: `/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4/users/2fdb871eb317430b8a1fdf30831d92ab/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.425672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08cf78f858c4d1ebaa1482ee8f824f4, user_id=2fdb871eb317430b8a1fdf30831d92ab, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.428737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.460837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3544/7054] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:47 2022] PUT /identity/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4/users/2fdb871eb317430b8a1fdf30831d92ab/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:47.464469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.486875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fbc32-8ace-4d55-9083-f1adda3c09ac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.508857 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:47.594112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.595196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.595813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.596088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.597014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.598868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e631c-ad0b-465b-8362-12ec68bce936 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.615716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3511/7055] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:47.616954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.633649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e9446-da10-4d2f-868e-dfb9704987a5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.641650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.642773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.643295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.643799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] PATH_INFO: `/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4/users/2fdb871eb317430b8a1fdf30831d92ab/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.646555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08cf78f858c4d1ebaa1482ee8f824f4, user_id=2fdb871eb317430b8a1fdf30831d92ab, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.651095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.678269 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3545/7056] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:47 2022] PUT /identity/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4/users/2fdb871eb317430b8a1fdf30831d92ab/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:47.680601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.681180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.681703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.719745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] MFA Rules not processed for user `2fdb871eb317430b8a1fdf30831d92ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:47.721027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:47.804325 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3512/7057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:47.817143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:47.819120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:47.897552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3335d7-63c5-48d0-b741-02ca9203c005 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:47.901664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:47.902305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:47.902589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:47.902865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:47.913888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:47.915668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:47.929273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3546/7058] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:48.705774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:48.721889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8118c-73db-4270-adf2-10dc5baed831 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:48.725980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:48.726709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:48.727097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:48.727650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:48.849256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:48.852102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f3ba-3199-4288-b373-d71307361260 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:48.882635 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3513/7059] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:49.711381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:49.760523 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:49.898031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60b078-bba1-40f8-a021-1e5916d47674 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:49.915324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:49.915998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:49.916284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:49.917136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] PATH_INFO: `/v3/users/7a3b82fa47d14302a8716a0da82a1d5f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:49.920695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3b82fa47d14302a8716a0da82a1d5f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:49.924515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:49.998322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3b82fa47d14302a8716a0da82a1d5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:50.012942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3b82fa47d14302a8716a0da82a1d5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:50.038471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3b82fa47d14302a8716a0da82a1d5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:50.042505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3b82fa47d14302a8716a0da82a1d5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:50.043458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3b82fa47d14302a8716a0da82a1d5f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:50.080416 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3547/7060] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:49 2022] DELETE /identity/v3/users/7a3b82fa47d14302a8716a0da82a1d5f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:50.081645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:50.082492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:50.082960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:50.119789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:50.132521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:50.202301 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:50.274147 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3514/7061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:50.302088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:50.304552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:50.497793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31529-182c-4241-affe-e69911776c1f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:50.508153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:50.509747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:50.510440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:50.511761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:50.539672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:50.541440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:50.564586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3548/7062] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:51.571835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:51.573347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:51.619196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9b33-fae0-40a1-94ca-c4c6cb64f474 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:51.629460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:51.630340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:51.630799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:51.631280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] PATH_INFO: `/v3/projects/f79e0cc480824992bcb054678934a99c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:51.632577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79e0cc480824992bcb054678934a99c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:51.634702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:51.694516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79e0cc480824992bcb054678934a99c', 'request_id': 'req-7f503394-de74-4e73-8eeb-97d708aa48f2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:51.718484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79e0cc480824992bcb054678934a99c', 'request_id': 'req-7f503394-de74-4e73-8eeb-97d708aa48f2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:51.729175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79e0cc480824992bcb054678934a99c', 'request_id': 'req-7f503394-de74-4e73-8eeb-97d708aa48f2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:51.764240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] The token cache is being invalidate because project f79e0cc480824992bcb054678934a99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:51.764524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:51.765598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:51.774789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3515/7063] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:51 2022] DELETE /identity/v3/projects/f79e0cc480824992bcb054678934a99c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:51.779540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:51.798832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac667-67c2-477b-b897-c52b048c88a7 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:51.880635 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:51.903466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:51.904653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:51.906185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:51.906622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] PATH_INFO: `/v3/users/2fdb871eb317430b8a1fdf30831d92ab` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:51.908272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdb871eb317430b8a1fdf30831d92ab)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:51.910761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:52.000078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdb871eb317430b8a1fdf30831d92ab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:52.049457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdb871eb317430b8a1fdf30831d92ab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:52.078930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdb871eb317430b8a1fdf30831d92ab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:52.080018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdb871eb317430b8a1fdf30831d92ab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:52.080729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d0d2bb7-3ff7-434c-8f5b-f91461023f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdb871eb317430b8a1fdf30831d92ab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:52.111581 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3549/7064] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:51 2022] DELETE /identity/v3/users/2fdb871eb317430b8a1fdf30831d92ab => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:52.748342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:52.750544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:52.777310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503394-de74-4e73-8eeb-97d708aa48f2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:52.902028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:52.902926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:52.903390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:52.903844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] PATH_INFO: `/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:52.905263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08cf78f858c4d1ebaa1482ee8f824f4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:52.907892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.013217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08cf78f858c4d1ebaa1482ee8f824f4', 'request_id': 'req-0bb75e10-0417-462b-a57d-21eda79fcb2f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:53.034399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08cf78f858c4d1ebaa1482ee8f824f4', 'request_id': 'req-0bb75e10-0417-462b-a57d-21eda79fcb2f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:53.041690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08cf78f858c4d1ebaa1482ee8f824f4', 'request_id': 'req-0bb75e10-0417-462b-a57d-21eda79fcb2f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:53.048851 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:53.068699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] The token cache is being invalidate because project d08cf78f858c4d1ebaa1482ee8f824f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:53.069861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:53.077033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0bb75e10-0417-462b-a57d-21eda79fcb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:53.079397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3516/7065] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:52 2022] DELETE /identity/v3/projects/d08cf78f858c4d1ebaa1482ee8f824f4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:53.086811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.087342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.087342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.113586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:53.115108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:53.222245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.222495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.222856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.229024 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3550/7066] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:53.249682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:53.251796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:53.262353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3517/7067] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:53.267906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.283421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc264a1-5d56-4b16-8735-75fd55c6b97e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.293140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.293995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.294429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.294909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.295820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:53.296803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.299130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.318410 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3551/7068] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:53.319584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.330671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f2e1a-1911-4225-9aa3-67c91ad6cdd1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.368339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.368978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.369262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.369576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.370222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.376383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.440002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3518/7069] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:53 2022] POST /identity/v3/projects => generated 361 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:53.444150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.457429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbd29-b82a-4f88-bdd4-07c13c377384 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.600233 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:53.632485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.633128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.633438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.633774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.634432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.642380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.711817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3552/7070] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:53 2022] POST /identity/v3/users => generated 281 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:53.716446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.744566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253385be-0440-4f7b-8f1c-4aa6e8480ff1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.765520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.766165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.766474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.773030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.773705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.775758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.822143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3519/7071] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:53.822638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.836211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a071-a9c6-4f09-bb41-486f91f92c91 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.855861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.856997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.857473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.858709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.859721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.861610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf151cbd-2189-4c25-a5d0-1e9a44e598cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.879150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3553/7072] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:53.880397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:53.897502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38708d-8210-47a9-9b6d-7c036f4d9cfc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:53.909667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:53.910356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.910638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.910910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] PATH_INFO: `/v3/projects/43be713df90a465ba99b0db0380f1752/users/bdd1c098335c49e1ac0bada476f9f891/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:53.944449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43be713df90a465ba99b0db0380f1752, user_id=bdd1c098335c49e1ac0bada476f9f891, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:53.951115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:53.980873 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3520/7073] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:53 2022] PUT /identity/v3/projects/43be713df90a465ba99b0db0380f1752/users/bdd1c098335c49e1ac0bada476f9f891/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:53.991678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:53.991971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:53.992247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:54.055211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] MFA Rules not processed for user `bdd1c098335c49e1ac0bada476f9f891`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:54.056439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:54.169462 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3554/7074] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:54.206235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:54.208709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:54.414694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d467-f7ef-4eb7-a440-5159997d1e45 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:54.435943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:54.437259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:54.437571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:54.437848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:54.467198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:54.468919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54781-edce-4594-a6de-0fb49234afc3 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:54.494471 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3521/7075] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:54.513955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:54.665338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fff9a-a4fb-40a4-a153-5e9ba27f4a33 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:54.670521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:54.671734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:54.672017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:54.672293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] PATH_INFO: `/v3/users/bdd1c098335c49e1ac0bada476f9f891` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:54.674309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd1c098335c49e1ac0bada476f9f891)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:54.676264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:54.778456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd1c098335c49e1ac0bada476f9f891'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:54.807574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd1c098335c49e1ac0bada476f9f891'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:54.811782 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:54.869368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd1c098335c49e1ac0bada476f9f891'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:54.870169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd1c098335c49e1ac0bada476f9f891'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:54.870803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd1c098335c49e1ac0bada476f9f891'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:54.893445 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3555/7076] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:30:54 2022] DELETE /identity/v3/users/bdd1c098335c49e1ac0bada476f9f891 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:54.897768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:54.898591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:54.900860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:54.938091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:54.939528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:55.082101 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3522/7077] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:55.092402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:55.095095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:55.225727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5ff5-e2d5-48b0-a6bb-5f1332720708 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:55.235850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:55.236490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:55.236773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:55.237055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:55.274128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:55.278695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3adad-2a16-4007-a9db-1ae7ab4bb7d3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:55.307731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3556/7078] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:30:55.874861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:55.876478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:55.899961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3efeb0-e8ce-4334-9f20-2da50d9646fe None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:55.917615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:55.919289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:55.919779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:55.920212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] PATH_INFO: `/v3/projects/43be713df90a465ba99b0db0380f1752` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:55.923439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43be713df90a465ba99b0db0380f1752)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:55.938681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:56.006882 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:56.035532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43be713df90a465ba99b0db0380f1752', 'request_id': 'req-90a2b5af-abe0-4f46-bb3c-f86c68e75602'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:56.044506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43be713df90a465ba99b0db0380f1752', 'request_id': 'req-90a2b5af-abe0-4f46-bb3c-f86c68e75602'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:56.059324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43be713df90a465ba99b0db0380f1752', 'request_id': 'req-90a2b5af-abe0-4f46-bb3c-f86c68e75602'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:56.087842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] The token cache is being invalidate because project 43be713df90a465ba99b0db0380f1752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:30:56.088185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:56.089343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-90a2b5af-abe0-4f46-bb3c-f86c68e75602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:30:56.092317 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3523/7079] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:30:55 2022] DELETE /identity/v3/projects/43be713df90a465ba99b0db0380f1752 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:56.096511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:56.096808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:56.097164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:56.148810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:56.150423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:56.256436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3557/7080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:56.259276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:56.259796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:56.260082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:56.326300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:56.334319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:56.379102 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3524/7081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:56.380228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:56.408703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5e78b-2d2d-4c17-a197-6254ff72ed2b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:56.437353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:56.443205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:56.444380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:56.446068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:56.449332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:30:56.450994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:56.454572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:56.487571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3558/7082] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:30:56.490473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:56.502987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ebf98-53e4-475e-8be0-5bd1df307d98 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:56.516277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:56.517320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:56.517826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:56.518276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:56.519085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:56.521176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:56.596053 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3525/7083] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:56 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:56.599984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:56.617628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd75d9-1a6d-4abe-931f-5966b934a1a7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:56.899839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:56.900873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:56.901164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:56.901503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:56.902147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:56.912622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:56.964194 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:57.041838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:57.044483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3559/7084] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:56 2022] POST /identity/v3/users => generated 288 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:57.059305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3298f-1ebf-4b5a-a0fb-afa84b542cce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:57.075112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:57.075751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:57.076036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:57.076311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:57.076998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:57.078693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:57.110387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3526/7085] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:57.115259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:57.130097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64f1-ca4f-4927-abeb-d2b81fb66bc1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:57.146926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:57.147917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:57.148382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:57.148833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:57.149777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:57.151896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9ab07-a77e-44c0-8fe8-57234489a6ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:57.200373 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3560/7086] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:57.202564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:57.222105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423706-a2cb-432c-b336-4be292d3dade admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:57.232382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:57.233873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:57.234347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:57.234629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] PATH_INFO: `/v3/projects/834209ba6ebd4bdfb26d26fedf879a5a/users/e568b33084854c0984d7c6305558c0c8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:57.284851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834209ba6ebd4bdfb26d26fedf879a5a, user_id=e568b33084854c0984d7c6305558c0c8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:57.292064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:57.347693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3527/7087] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:57 2022] PUT /identity/v3/projects/834209ba6ebd4bdfb26d26fedf879a5a/users/e568b33084854c0984d7c6305558c0c8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:57.349962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:57.351445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:57.351936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:57.447985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] MFA Rules not processed for user `e568b33084854c0984d7c6305558c0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:57.449234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:57.615110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3561/7088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:30:57.619861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:57.794176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324167-affc-4998-a8d4-0467247c7607 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:57.811746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:57.813059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:57.813708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:57.814190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:57.815028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:57.817187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:57.879895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3528/7089] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:30:57 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:57.884037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:57.912223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1516ad4-87f6-4d21-bc32-b2ac0cc359fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:58.172811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:58.173491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.173789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.174066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.174814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:58.181841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:58.227304 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3562/7090] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:30:57 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:30:58.227995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:58.247305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e86-34c8-45a6-8001-384d20d85992 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:58.256280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:58.257188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.257648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.258073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.258887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:58.260690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:58.314434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3529/7091] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:30:58.322389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:58.344973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ebe35-6caa-40eb-bb05-e01cc6fdbbb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:58.370258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:58.372108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.372542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.372991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] PATH_INFO: `/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0/users/6cef67ed9b534b47b7b3574159c35634/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.421618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e7aa62e7a14f65a78ea74ccb72e1f0, user_id=6cef67ed9b534b47b7b3574159c35634, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:58.424576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:58.456575 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3563/7092] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:58 2022] PUT /identity/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0/users/6cef67ed9b534b47b7b3574159c35634/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:58.460869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:58.477725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaead3-1a8e-4b69-bd62-b4115c9dbb96 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:58.557774 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:58.715207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:58.715813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.716106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.716383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.717032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:58.718773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422c74-f197-463a-beba-29cbdf5ca8e9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:58.753141 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3530/7093] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:30:58.754310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:58.772437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823d4d6-58ba-4758-964f-597bbb78d9fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:58.797131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:58.798102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.798455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.798794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] PATH_INFO: `/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0/users/6cef67ed9b534b47b7b3574159c35634/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.814327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e7aa62e7a14f65a78ea74ccb72e1f0, user_id=6cef67ed9b534b47b7b3574159c35634, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:58.817821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:58.871187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:58.871484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:58.871676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:58.881991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3564/7094] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:30:58 2022] PUT /identity/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0/users/6cef67ed9b534b47b7b3574159c35634/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:30:58.953538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] MFA Rules not processed for user `6cef67ed9b534b47b7b3574159c35634`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:30:58.954813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:59.099563 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3531/7095] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:30:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:30:59.117988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:30:59.119751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:30:59.215069 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:59.349686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32f31-ca01-4c2d-b6ed-7acfeec53d95 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:30:59.375143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:30:59.375843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:30:59.376077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:30:59.376351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:30:59.575700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:30:59.577761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea655-6070-4f4e-be75-feb197a66896 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:30:59.608248 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3565/7096] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:07.064101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:07.267539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0859-0688-4a68-8384-41ac83d76cac None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:07.303748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:07.305479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:07.312215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:07.312215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] PATH_INFO: `/v3/users/e568b33084854c0984d7c6305558c0c8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:07.315070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e568b33084854c0984d7c6305558c0c8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:07.321713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:07.489991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e568b33084854c0984d7c6305558c0c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:07.490965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e568b33084854c0984d7c6305558c0c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:07.503890 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:07.524948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e568b33084854c0984d7c6305558c0c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:07.565839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e568b33084854c0984d7c6305558c0c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:07.566989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e568b33084854c0984d7c6305558c0c8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:07.595467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3532/7097] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:07 2022] DELETE /identity/v3/users/e568b33084854c0984d7c6305558c0c8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:07.600004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:07.600792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:07.601346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:07.667136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:07.668612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:07.827945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3566/7098] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:07.860606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:07.862091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:07.999255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7275c-40e6-4cb6-87f2-c1f929492b81 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:08.018035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:08.018675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:08.018953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:08.019224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:08.039706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:08.041324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:08.067429 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3533/7099] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:09.010498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:09.012412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:09.065854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daadac6-668c-4f6f-9830-96576a5b174b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:09.084259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:09.085071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:09.090126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:09.090614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] PATH_INFO: `/v3/projects/834209ba6ebd4bdfb26d26fedf879a5a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:09.095936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] RBAC: Authorizing `identity:delete_project(project_id=834209ba6ebd4bdfb26d26fedf879a5a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:09.099600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:09.270602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834209ba6ebd4bdfb26d26fedf879a5a', 'request_id': 'req-95afd731-b5b3-4384-a580-1ae8328b697b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.289609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834209ba6ebd4bdfb26d26fedf879a5a', 'request_id': 'req-95afd731-b5b3-4384-a580-1ae8328b697b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.313249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834209ba6ebd4bdfb26d26fedf879a5a', 'request_id': 'req-95afd731-b5b3-4384-a580-1ae8328b697b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.350996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] The token cache is being invalidate because project 834209ba6ebd4bdfb26d26fedf879a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:09.351370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.353777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.356706 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3567/7100] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:09 2022] DELETE /identity/v3/projects/834209ba6ebd4bdfb26d26fedf879a5a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:09.361071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:09.392800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a01f99-a460-4916-afb6-1a59cf23b3f1 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:09.594519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:09.602296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:09.618181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:09.623129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] PATH_INFO: `/v3/users/6cef67ed9b534b47b7b3574159c35634` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:09.630172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cef67ed9b534b47b7b3574159c35634)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:09.635378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:09.778404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cef67ed9b534b47b7b3574159c35634'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.779140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cef67ed9b534b47b7b3574159c35634'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.796559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cef67ed9b534b47b7b3574159c35634'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.822984 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:09.824055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cef67ed9b534b47b7b3574159c35634'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.826117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-91a2c3f7-0919-4bb2-a887-7aaee8836b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cef67ed9b534b47b7b3574159c35634'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:09.851888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3534/7101] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:09 2022] DELETE /identity/v3/users/6cef67ed9b534b47b7b3574159c35634 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:10.449554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:10.451840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:10.462627 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:10.470783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd731-b5b3-4384-a580-1ae8328b697b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:10.548483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:10.549238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:10.549627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:10.550102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] PATH_INFO: `/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:10.551383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e7aa62e7a14f65a78ea74ccb72e1f0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:10.553442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:10.608752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e7aa62e7a14f65a78ea74ccb72e1f0', 'request_id': 'req-7088627c-e298-410d-a648-2dba9285cdbe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:10.615884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e7aa62e7a14f65a78ea74ccb72e1f0', 'request_id': 'req-7088627c-e298-410d-a648-2dba9285cdbe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:10.622828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e7aa62e7a14f65a78ea74ccb72e1f0', 'request_id': 'req-7088627c-e298-410d-a648-2dba9285cdbe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:10.637576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] The token cache is being invalidate because project 99e7aa62e7a14f65a78ea74ccb72e1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:10.638162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:10.638801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7088627c-e298-410d-a648-2dba9285cdbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:10.645298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3568/7102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:10 2022] DELETE /identity/v3/projects/99e7aa62e7a14f65a78ea74ccb72e1f0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:10.646913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:10.647342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:10.648221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:10.676170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:10.677766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:10.756983 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3535/7103] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:10.766907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:10.767276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:10.767624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:10.819320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:10.820635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:10.849580 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3569/7104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:10.850912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:10.863812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb4c94-7d8c-4488-9550-e6a9bae033e6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:10.882379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:10.883017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:10.883340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:10.883583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:10.889712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:10.889712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:10.901937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:10.928996 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3536/7105] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:31:10.933775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:10.945249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35623-fb9d-42e0-8c8b-391a5d8fc302 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:10.950547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:10.951404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:10.951793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:10.952142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:10.953320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:10.960222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.007445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.018834 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3570/7106] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:10 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:11.020005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3214-fc57-45ce-b5ef-0b4f703c0358 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.119525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.120224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.120519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.120797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.121705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.123875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.158205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3537/7107] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:11 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:11.162903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.184931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad19354-c2cc-4170-a2a4-4ce2f826729b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.191814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.192733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.193211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.193706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.194560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.196457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.220149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3571/7108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:31:11.221087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.236718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcf285-e866-4b37-8d90-72f7ad00b002 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.242727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.243421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.243710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.243989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.244649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.246434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058f37-71fc-4036-b7a5-641e6e31e663 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.266169 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3538/7109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:11.266642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.283527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b69983-8df2-4361-9155-76b6d4bdf613 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.290559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.291265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.291265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.291545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] PATH_INFO: `/v3/projects/4be9da7930874d11b2c71e256abdfa32/users/7b934504be9a4592a2f71aa8afd84577/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.316097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be9da7930874d11b2c71e256abdfa32, user_id=7b934504be9a4592a2f71aa8afd84577, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.319643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.348764 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3572/7110] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:11 2022] PUT /identity/v3/projects/4be9da7930874d11b2c71e256abdfa32/users/7b934504be9a4592a2f71aa8afd84577/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:11.351226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.351549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.353443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.435970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.438955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] MFA Rules not processed for user `7b934504be9a4592a2f71aa8afd84577`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:11.440355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:11.443492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:11.500781 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:11.501975 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:11.546404 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3539/7111] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:11.558629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.562871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91cd5-8f3c-45a2-abc0-105dbc3efc47 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.564162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:11.568443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.569092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.569376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.569688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] PATH_INFO: `/v3/users/aa5f2510f105430fb01974c7a6e1579e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.570867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5f2510f105430fb01974c7a6e1579e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.572818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.648632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccde10-6319-4858-aca2-0099d65d064d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:11.655686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:11.656561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.657028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.657688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.667171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5f2510f105430fb01974c7a6e1579e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:11.669780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:11.672024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41b9db-1ce5-493e-a18a-a3200c57f6df service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:11.684834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5f2510f105430fb01974c7a6e1579e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:11.695889 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3540/7112] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:11.723558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5f2510f105430fb01974c7a6e1579e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:11.724695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5f2510f105430fb01974c7a6e1579e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:11.725546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5f2510f105430fb01974c7a6e1579e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:11.754214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:11.754768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:11.755190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:11.758375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3573/7113] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:11 2022] DELETE /identity/v3/users/aa5f2510f105430fb01974c7a6e1579e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:31:11.794160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:11.798223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:11.970234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3541/7114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:11.977426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:11.979518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:12.134616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010349bd-8397-4cdc-8a9a-c3e2bf4cf8e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:12.148929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:12.149529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:12.149815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:12.150090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:12.183523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:12.190966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:12.228725 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3574/7115] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:12.397134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:12.399019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:12.463614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237b5f3-f4e7-4f5e-aacf-9adf1e2d1fac None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:12.468827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:12.469775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:12.470320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:12.471489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:12.474644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:12.514494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:12.514494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:12.547983 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3542/7116] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:12.596694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:12.598906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:12.620064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123ad7-7098-4342-855e-50ee7e24b69c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:12.634938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:12.635815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:12.636223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:12.636609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] PATH_INFO: `/v3/projects/dc6eecfc22d54d30a11c63b0d7518e4a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:12.637911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6eecfc22d54d30a11c63b0d7518e4a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:12.644612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:12.773455 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:12.788290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'request_id': 'req-9377ade0-1a81-4bcb-b31d-54ff7509951d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:12.817147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'request_id': 'req-9377ade0-1a81-4bcb-b31d-54ff7509951d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:12.833196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'request_id': 'req-9377ade0-1a81-4bcb-b31d-54ff7509951d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:12.851067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] The token cache is being invalidate because project dc6eecfc22d54d30a11c63b0d7518e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:12.851399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:12.852042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:12.863165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3575/7117] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:12 2022] DELETE /identity/v3/projects/dc6eecfc22d54d30a11c63b0d7518e4a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:12.866797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:12.886276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778346b-401d-431c-b17b-95c46139f5d8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:13.046464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:13.047158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:13.047443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:13.048235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] PATH_INFO: `/v3/users/87b1926ae1e84a79b5d081d9ef23017a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:13.059243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b1926ae1e84a79b5d081d9ef23017a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:13.061426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:13.103558 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:13.151258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b1926ae1e84a79b5d081d9ef23017a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.152053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b1926ae1e84a79b5d081d9ef23017a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.162311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b1926ae1e84a79b5d081d9ef23017a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.180016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b1926ae1e84a79b5d081d9ef23017a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.180824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b1926ae1e84a79b5d081d9ef23017a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.225339 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3543/7118] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:12 2022] DELETE /identity/v3/users/87b1926ae1e84a79b5d081d9ef23017a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:13.679375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:13.680501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:13.714240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ade0-1a81-4bcb-b31d-54ff7509951d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:13.818596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:13.819263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:13.819540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:13.819812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] PATH_INFO: `/v3/projects/380f7c8277734a0892e7c47a12b974d3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:13.821015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380f7c8277734a0892e7c47a12b974d3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:13.822998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:13.897556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380f7c8277734a0892e7c47a12b974d3', 'request_id': 'req-66a0d905-9d6a-496c-88c8-3ed1667eeca4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.923433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380f7c8277734a0892e7c47a12b974d3', 'request_id': 'req-66a0d905-9d6a-496c-88c8-3ed1667eeca4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.927463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380f7c8277734a0892e7c47a12b974d3', 'request_id': 'req-66a0d905-9d6a-496c-88c8-3ed1667eeca4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.940947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] The token cache is being invalidate because project 380f7c8277734a0892e7c47a12b974d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:13.941264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.943307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:13.945175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3576/7119] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:13 2022] DELETE /identity/v3/projects/380f7c8277734a0892e7c47a12b974d3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:13.948919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:13.950765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:13.972759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97c7e-ae1a-42bd-a894-9cd6a30e3003 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:14.053190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:14.053867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:14.054142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:14.054411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] PATH_INFO: `/v3/users/8be2ef76457043b0a90348a85bbf7595` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:14.055540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be2ef76457043b0a90348a85bbf7595)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:14.057536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:14.115328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be2ef76457043b0a90348a85bbf7595'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.116025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be2ef76457043b0a90348a85bbf7595'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.127671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be2ef76457043b0a90348a85bbf7595'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.140915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be2ef76457043b0a90348a85bbf7595'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.141680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be2ef76457043b0a90348a85bbf7595'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.157285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3544/7120] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:13 2022] DELETE /identity/v3/users/8be2ef76457043b0a90348a85bbf7595 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:31:14.371069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:14.373557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:14.400754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0d905-9d6a-496c-88c8-3ed1667eeca4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:14.505787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:14.506786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:14.507172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:14.507533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] PATH_INFO: `/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:14.508960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7b8a9defb5423b9e1dc487d9b50a5c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:14.511781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:14.524449 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:14.591441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7b8a9defb5423b9e1dc487d9b50a5c', 'request_id': 'req-6d35b308-d5db-4631-9bb3-fc2753c9d879'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.601130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7b8a9defb5423b9e1dc487d9b50a5c', 'request_id': 'req-6d35b308-d5db-4631-9bb3-fc2753c9d879'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.610909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7b8a9defb5423b9e1dc487d9b50a5c', 'request_id': 'req-6d35b308-d5db-4631-9bb3-fc2753c9d879'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.639539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] The token cache is being invalidate because project fe7b8a9defb5423b9e1dc487d9b50a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:14.639857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.640673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:14.643571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3577/7121] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:14 2022] DELETE /identity/v3/projects/fe7b8a9defb5423b9e1dc487d9b50a5c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:15.331223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:15.332827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:15.363810 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:15.513635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6812d3-7ae2-4a72-ab17-5c5a8b5e1d45 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:15.721001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:15.721794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:15.724687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:15.725179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:15.727321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:15.758689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:15.760496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:15.804086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3545/7122] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:15.890172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:15.891677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:15.925786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35b308-d5db-4631-9bb3-fc2753c9d879 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:15.940866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:15.941535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:15.941816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:15.942104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:15.946974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:16.104111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:16.106464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:16.126278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3578/7123] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:16.281781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:16.284404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:16.445264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a20812-cd7e-417c-ad9b-792df6d2cfae service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:16.455689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:16.456473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:16.456899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:16.457181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:16.463160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:16.607363 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:16.635571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:16.637257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef2eb1-2fba-4cf2-8c54-c3286d6a09e1 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:16.663022 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3546/7124] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:17.585049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:17.586760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:17.610830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e74-a19d-4863-a640-c7cf346e6275 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:17.632354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:17.633130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:17.633577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:17.634087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] PATH_INFO: `/v3/users/418ca12a6a2f4f7588f606227aefb0d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:17.637734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418ca12a6a2f4f7588f606227aefb0d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:17.640722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:17.744834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418ca12a6a2f4f7588f606227aefb0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:17.795153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418ca12a6a2f4f7588f606227aefb0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:17.813549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418ca12a6a2f4f7588f606227aefb0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:17.814319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418ca12a6a2f4f7588f606227aefb0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:17.815004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418ca12a6a2f4f7588f606227aefb0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:17.843369 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3579/7125] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:17 2022] DELETE /identity/v3/users/418ca12a6a2f4f7588f606227aefb0d7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:17.848135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:17.848600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:17.848895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:17.873102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:17.875742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:18.003731 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3547/7126] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:18.015372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:18.017704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:18.039638 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:18.168346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420531b-cff0-4866-909f-a0d6837dd9e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:18.182972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:18.183631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:18.183919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:18.184195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:18.203987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:18.205508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:18.227454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3580/7127] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:18.594173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:18.595719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:18.616100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210318-0949-4cdb-93a1-d0f444970057 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:18.622374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:18.623929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:18.624925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:18.625559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] PATH_INFO: `/v3/projects/45bcd2e8bede4193b99ffe81b162729f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:18.628200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bcd2e8bede4193b99ffe81b162729f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:18.633019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:18.698142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bcd2e8bede4193b99ffe81b162729f', 'request_id': 'req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.708230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bcd2e8bede4193b99ffe81b162729f', 'request_id': 'req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.715754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bcd2e8bede4193b99ffe81b162729f', 'request_id': 'req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.735384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] The token cache is being invalidate because project 45bcd2e8bede4193b99ffe81b162729f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:18.736043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.737875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.739769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3548/7128] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:18 2022] DELETE /identity/v3/projects/45bcd2e8bede4193b99ffe81b162729f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:18.743665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:18.757064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149893-7dbd-460e-87d3-13b36b737c94 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:18.827617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:18.828295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:18.828577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:18.828851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] PATH_INFO: `/v3/users/ab89527348a442918fd23361283d5fb4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:18.830044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab89527348a442918fd23361283d5fb4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:18.831991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:18.887576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab89527348a442918fd23361283d5fb4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.898505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab89527348a442918fd23361283d5fb4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.915051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab89527348a442918fd23361283d5fb4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.915828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab89527348a442918fd23361283d5fb4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.916459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e820897b-edae-4bd6-9953-bd81871fba24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab89527348a442918fd23361283d5fb4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:18.934937 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3581/7129] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:18 2022] DELETE /identity/v3/users/ab89527348a442918fd23361283d5fb4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:19.296404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:19.298036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:19.318378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ddad-8f8e-4adb-8c50-8a4bcb060e03 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:19.431963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:19.433051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:19.433575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:19.434074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] PATH_INFO: `/v3/projects/d518cafb365a4fd998f365d39143866e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:19.435742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d518cafb365a4fd998f365d39143866e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:19.440025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:19.454583 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:19.505753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd518cafb365a4fd998f365d39143866e', 'request_id': 'req-16c0dc60-90d9-457b-af3c-74326f569ac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:19.514677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd518cafb365a4fd998f365d39143866e', 'request_id': 'req-16c0dc60-90d9-457b-af3c-74326f569ac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:19.522472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd518cafb365a4fd998f365d39143866e', 'request_id': 'req-16c0dc60-90d9-457b-af3c-74326f569ac0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:19.539193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] The token cache is being invalidate because project d518cafb365a4fd998f365d39143866e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:19.539500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:19.540323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-16c0dc60-90d9-457b-af3c-74326f569ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:19.551382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3549/7130] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:19 2022] DELETE /identity/v3/projects/d518cafb365a4fd998f365d39143866e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:19.553322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:19.553658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:19.553993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:19.578253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:19.579612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:19.640350 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:19.823483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3582/7131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:19.825476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:19.825873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:19.826822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:19.865311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:19.867521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:19.880730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3550/7132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:19.882033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:19.895074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83e50-6791-46c6-87f8-badbbe34909e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:19.903011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:19.903751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:19.904110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:19.905083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:19.906023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:19.906405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:19.908862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:19.928107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3583/7133] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:31:19.929760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:19.953668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b9b4-128e-4c2e-876d-04724a3e5838 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:19.961214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:19.962131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:19.962626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:19.963108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:19.963960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:19.966715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.017952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3551/7134] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:19 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:20.023710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.034974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7962f-e9f7-49d5-ab3a-ff177415a163 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.139346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:20.140142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.140626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.140911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.142108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:20.145865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.177395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3584/7135] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:20 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:20.180847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.194797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee629-8d97-4a31-918a-d59a25a0380b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.200465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:20.202400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.202885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.203367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.204271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:20.209909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.246093 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3552/7136] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:20.248490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.264838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227ea77-5f61-4094-991c-1776e9c2c583 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.272744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:20.273535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.274767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.274888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.275970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:20.280207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14d83-e89c-408d-bc20-0cd0c899d8f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.297631 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3585/7137] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:20.302021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.315940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a6828-9f4e-4069-a0fa-320f425fefc4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.330466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:20.330466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.330810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.330986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] PATH_INFO: `/v3/projects/bf843d57593a4860a97ebc0dbb36bf95/users/e5ad86778ab84ffea8fe0023c95a3ba7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.374723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf843d57593a4860a97ebc0dbb36bf95, user_id=e5ad86778ab84ffea8fe0023c95a3ba7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:20.383870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.423254 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3553/7138] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:20 2022] PUT /identity/v3/projects/bf843d57593a4860a97ebc0dbb36bf95/users/e5ad86778ab84ffea8fe0023c95a3ba7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:20.434528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.434820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.435093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.505534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] MFA Rules not processed for user `e5ad86778ab84ffea8fe0023c95a3ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:20.508609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:20.630344 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3586/7139] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:20.634795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.786526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdda3f-4020-4e30-bccc-4a326641d93a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.798858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:20.803220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:20.803548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:20.803823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:20.805588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:20.809764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:20.871110 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3554/7140] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:20 2022] POST /identity/v3/projects => generated 391 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:31:20.876510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:20.894387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a80f-2367-4715-af1d-ba64a8444b54 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:20.962486 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:21.047641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:21.049148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.049652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.050112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.050965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:21.053813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:21.098332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.098619 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3587/7141] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:20 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:21.120090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685bf7-c885-4bd1-8580-189338620b65 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:21.129355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:21.130019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.130301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.130579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.131228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:21.133107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:21.163349 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3555/7142] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:21.169084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.188251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d84a8-2323-48ca-809e-2a2901305e8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:21.193598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:21.195349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.195857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.196998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] PATH_INFO: `/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf/users/c85c73892d124b869e413806b3c58a30/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.221760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd5a5c38d204f9584fd0ac3ed8a3bdf, user_id=c85c73892d124b869e413806b3c58a30, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:21.225534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:21.253223 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3588/7143] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:21 2022] PUT /identity/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf/users/c85c73892d124b869e413806b3c58a30/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:21.254079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.269555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f58b8-b9fd-4ac9-a3c6-8c79d9c98ccc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:21.292662 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:21.463310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:21.464669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.465109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.465581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.466406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:21.471676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae4d2c-5b8e-490e-b273-7c7fa3c50945 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:21.491023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3556/7144] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:31:21.494796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.512550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd62ee-9665-43d8-8da9-66b50f1f705a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:21.525906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:21.526941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.527352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.527738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] PATH_INFO: `/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf/users/c85c73892d124b869e413806b3c58a30/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.535652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd5a5c38d204f9584fd0ac3ed8a3bdf, user_id=c85c73892d124b869e413806b3c58a30, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:21.542691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:21.601502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3589/7145] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:21 2022] PUT /identity/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf/users/c85c73892d124b869e413806b3c58a30/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:21.609249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:21.609718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:21.610287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:21.707903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] MFA Rules not processed for user `c85c73892d124b869e413806b3c58a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:21.709760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:21.852475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.854315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:21.882232 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3557/7146] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:21.891807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:21.894639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:22.020594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dda67-c03a-49ce-b65f-f328b607a1ea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:22.040946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:22.042682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:22.043377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:22.044451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:22.046161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe354b-154e-450c-9a0d-5fa972a95262 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:22.050102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:22.052912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:22.053724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:22.054135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:22.054460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:22.067434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:22.068218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:22.072781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:22.074837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:22.081459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3558/7147] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:22.090751 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3590/7148] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:22.139405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:22.140875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:22.160507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79c20-b6e8-4454-a081-a46bcaca158c service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:22.166464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:22.167434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:22.167910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:22.168351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:22.234195 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:22.301191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:22.303476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:22.318380 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3559/7149] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:24.793041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:24.794598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:24.903410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8127d17-783e-4f1d-84a2-8d79771c2561 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:24.919304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:24.920276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:24.920650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:24.920856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] PATH_INFO: `/v3/users/88a281617be64d1b85a6b7d8a708876a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:24.923377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a281617be64d1b85a6b7d8a708876a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:24.925304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:24.952855 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:25.019803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a281617be64d1b85a6b7d8a708876a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.029234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a281617be64d1b85a6b7d8a708876a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.077123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a281617be64d1b85a6b7d8a708876a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.080774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a281617be64d1b85a6b7d8a708876a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.082521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af22b161-5225-4b8d-a4cd-ac959b7fe759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a281617be64d1b85a6b7d8a708876a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.104698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3591/7150] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:24 2022] DELETE /identity/v3/users/88a281617be64d1b85a6b7d8a708876a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:25.371824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:25.397601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab1d9-4db8-4e0a-9855-8fa6c2699eda service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:25.515759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:25.516605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:25.516909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:25.517192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] PATH_INFO: `/v3/projects/24b293fd2bf248f0a714067e48ea0792` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:25.518605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b293fd2bf248f0a714067e48ea0792)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:25.520657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:25.598237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b293fd2bf248f0a714067e48ea0792', 'request_id': 'req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.608015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b293fd2bf248f0a714067e48ea0792', 'request_id': 'req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.619822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b293fd2bf248f0a714067e48ea0792', 'request_id': 'req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.660287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] The token cache is being invalidate because project 24b293fd2bf248f0a714067e48ea0792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:25.661462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.662360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-889f8fe8-052d-4dc8-ae71-6876ed3cac5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:25.664693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3560/7151] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:25 2022] DELETE /identity/v3/projects/24b293fd2bf248f0a714067e48ea0792 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:25.674111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:25.674389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:25.674785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:25.698187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:25.699491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:25.782606 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3592/7152] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:25.790856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:25.792044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:25.792592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:25.827534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:25.830041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:25.844484 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3561/7153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:25.848587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:25.861301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390abb1-ba6a-4312-ab1d-3ad7d5813cc0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:25.866607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:25.867418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:25.867849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:25.868273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:25.869191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:25.869696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:25.871460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:25.885847 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3593/7154] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:31:25.892825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:25.902153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ee991-3b9a-4b4a-93ec-239f5a15ba7b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:25.908493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:25.909186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:25.909568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:25.909906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:25.910663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:25.912640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:25.959979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:25.966773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3562/7155] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:25 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:25.971731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96e4-ebff-4b8e-a53e-98a15be6b949 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:26.102965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:26.103322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.103699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.104048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.104775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:26.106889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:26.148112 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3594/7156] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:25 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:31:26.149642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:26.168007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ad49b-3164-45f8-a0b7-da569e5d5dc0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:26.174310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:26.174951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.175231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.175559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.176287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:26.179000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:26.197455 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3563/7157] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:26.199503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:26.205922 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:26.219351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717485f-b668-4d7f-a9e4-84d756a05087 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:26.234258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:26.234900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.235184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.235460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.236119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:26.237770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a6bf3-9a08-45a0-a2d2-4445d6945ad1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:26.257177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3595/7158] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:26.261197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:26.294881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad686-7368-41b1-b8f7-5a60af4ee856 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:26.311177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:26.314378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.315112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.315861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] PATH_INFO: `/v3/projects/0ab8cb461554463fa9ed654c88096888/users/c10efff521ac401cb6b0cf0f7a0f8826/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.357523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab8cb461554463fa9ed654c88096888, user_id=c10efff521ac401cb6b0cf0f7a0f8826, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:26.360797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:26.401031 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:26.426541 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3564/7159] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:26 2022] PUT /identity/v3/projects/0ab8cb461554463fa9ed654c88096888/users/c10efff521ac401cb6b0cf0f7a0f8826/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:26.431790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.432728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.433055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.461688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:26.463019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:26.569091 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3596/7160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:26.580341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:26.582254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:26.665311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a20-d716-4d03-acb5-e9325bda11cb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:26.678101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:26.678789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:26.679138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:26.679421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:26.702399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:26.703825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc95b-8bcd-4d25-a2ef-f6cc829c5475 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:26.729533 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3565/7161] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:31.285865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:31.290321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:31.336772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ac5c9-07c6-4b97-acb1-598842b6ad6f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:31.358895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:31.359579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:31.359865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:31.360141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] PATH_INFO: `/v3/users/e5ad86778ab84ffea8fe0023c95a3ba7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:31.366435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ad86778ab84ffea8fe0023c95a3ba7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:31.368438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:31.511696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ad86778ab84ffea8fe0023c95a3ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:31.530042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ad86778ab84ffea8fe0023c95a3ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:31.557127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ad86778ab84ffea8fe0023c95a3ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:31.557962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ad86778ab84ffea8fe0023c95a3ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:31.558589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ad86778ab84ffea8fe0023c95a3ba7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:31.587101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3597/7162] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:31 2022] DELETE /identity/v3/users/e5ad86778ab84ffea8fe0023c95a3ba7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:31.591721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:31.592605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:31.593026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:31.643151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:31.644514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:31.835897 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3566/7163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:31.923724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:31.925231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:32.180689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50deb0-85bd-482f-82f6-b14567a72bc1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:32.201693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:32.203279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:32.204252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:32.204836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:32.251710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:32.259433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:32.308889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3598/7164] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:33.405680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:33.407311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:33.441106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff9ff3-7c1f-4853-8715-58d86422060b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:33.448655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:33.449307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:33.449766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:33.450180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] PATH_INFO: `/v3/projects/bf843d57593a4860a97ebc0dbb36bf95` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:33.453613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf843d57593a4860a97ebc0dbb36bf95)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:33.455023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:33.457721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:33.475308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:33.484463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c427b-d756-4817-8bc2-95a3685bfc2d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:33.498647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:33.499307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:33.499589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:33.499861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] PATH_INFO: `/v3/users/830045557dd94ea5947df0c661c2a069` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:33.504337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830045557dd94ea5947df0c661c2a069)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:33.506543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:33.508509 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:33.588907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf843d57593a4860a97ebc0dbb36bf95', 'request_id': 'req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.596967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830045557dd94ea5947df0c661c2a069'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.604793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf843d57593a4860a97ebc0dbb36bf95', 'request_id': 'req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.617015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf843d57593a4860a97ebc0dbb36bf95', 'request_id': 'req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.619338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830045557dd94ea5947df0c661c2a069'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.641571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] The token cache is being invalidate because project bf843d57593a4860a97ebc0dbb36bf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:33.642120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.644510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.648290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830045557dd94ea5947df0c661c2a069'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.648588 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3567/7165] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:33 2022] DELETE /identity/v3/projects/bf843d57593a4860a97ebc0dbb36bf95 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:33.651904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830045557dd94ea5947df0c661c2a069'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.652678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830045557dd94ea5947df0c661c2a069'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:33.652969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:33.655270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:33.679179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3599/7166] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:33 2022] DELETE /identity/v3/users/830045557dd94ea5947df0c661c2a069 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:33.796399 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:33.923725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f5dc3-fe20-4a7c-a1b7-ddaee00a8c16 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:34.058330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:34.058864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.059145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.059420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] PATH_INFO: `/v3/users/c85c73892d124b869e413806b3c58a30` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.061659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85c73892d124b869e413806b3c58a30)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:34.063767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:34.147147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:34.148984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:34.195283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4073-5fde-4fee-9f6d-32e3d971b670 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:34.198933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85c73892d124b869e413806b3c58a30'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.205353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85c73892d124b869e413806b3c58a30'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.205555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:34.205555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.205958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.206314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] PATH_INFO: `/v3/projects/ba17f9b214fc4a1b8b543d1bf96cb68a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.209758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba17f9b214fc4a1b8b543d1bf96cb68a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:34.214654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:34.225185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85c73892d124b869e413806b3c58a30'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.243954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85c73892d124b869e413806b3c58a30'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.244850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-000b0f78-3a1e-47ea-a4f3-9a209fdb74b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85c73892d124b869e413806b3c58a30'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.306807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3568/7167] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:33 2022] DELETE /identity/v3/users/c85c73892d124b869e413806b3c58a30 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:31:34.430440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'request_id': 'req-d0a45475-892d-43ba-b37c-02dd811baad9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.459411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'request_id': 'req-d0a45475-892d-43ba-b37c-02dd811baad9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.478798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'request_id': 'req-d0a45475-892d-43ba-b37c-02dd811baad9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.507307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] The token cache is being invalidate because project ba17f9b214fc4a1b8b543d1bf96cb68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:34.511724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.515228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0a45475-892d-43ba-b37c-02dd811baad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:34.520030 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3600/7168] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:34 2022] DELETE /identity/v3/projects/ba17f9b214fc4a1b8b543d1bf96cb68a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:31:34.524968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.525737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.525842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.556006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:34.558038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:34.644063 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:34.661467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3569/7169] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:34.669300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.670309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.670759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.703380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:34.704622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:34.715012 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3601/7170] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:34.719417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:34.731265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703131-659c-46c9-ab04-2a9a3a78a386 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:34.745302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:34.747316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.747726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.749760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.751599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:34.754007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:34.758982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:34.808467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3570/7171] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:31:34.812482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:34.826747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5acf0-f945-4948-a7b7-8817cd0efb60 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:34.838383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:34.842273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:34.842523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:34.842677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:34.847433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:34.853530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:34.952258 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3602/7172] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:34 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:31:34.956206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:34.976653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717efc-1795-454d-a991-53fdd063b30a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.026982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.030284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.145445 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:35.179566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.180382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.180808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.181208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.187587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.190022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.203906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46ce9-18fd-464f-b965-c109dbef3691 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.227156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.227942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.228289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.228639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] PATH_INFO: `/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.230720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd5a5c38d204f9584fd0ac3ed8a3bdf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.233940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.250801 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3571/7173] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:34 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:35.254483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.330766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132ede-d899-469e-89cf-ea95e9af65d8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.347877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd5a5c38d204f9584fd0ac3ed8a3bdf', 'request_id': 'req-ad4be897-674f-45e0-9393-84ef9ea23b7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:35.412028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd5a5c38d204f9584fd0ac3ed8a3bdf', 'request_id': 'req-ad4be897-674f-45e0-9393-84ef9ea23b7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:35.431232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd5a5c38d204f9584fd0ac3ed8a3bdf', 'request_id': 'req-ad4be897-674f-45e0-9393-84ef9ea23b7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:35.444894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.445679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.446035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.446363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.447314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.449449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f70b-097d-4b0e-adec-67286bd923a8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.456156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] The token cache is being invalidate because project 7fd5a5c38d204f9584fd0ac3ed8a3bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:35.456582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:35.458959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ad4be897-674f-45e0-9393-84ef9ea23b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:35.464313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3603/7174] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:35 2022] DELETE /identity/v3/projects/7fd5a5c38d204f9584fd0ac3ed8a3bdf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:35.465157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.465289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3572/7175] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:35.467767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.468063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.468679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.474755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.476158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.494356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:35.496647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.514723 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3573/7176] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:35.514723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.514723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.525698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62d6c-2a39-49b8-a4ed-35790a2ada4e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.532091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.534084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.534374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.534882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.535565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.537231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c825c59-0827-4328-9138-8d290f53f7c5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.547061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:35.548545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.550193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3574/7177] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:35.551608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.551894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.552245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.588245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:35.589807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.609068 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3575/7178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:35.609068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.627710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f76b-5b49-4042-b582-30e494cd903d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.639878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.640284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.640570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.640843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] PATH_INFO: `/v3/projects/b729bd9361c5457b84040650f7fda117/users/1770fcec69584a7ba57800ff5cad8bf0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.688867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b729bd9361c5457b84040650f7fda117, user_id=1770fcec69584a7ba57800ff5cad8bf0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.692461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc928c-459b-4b5d-883b-4b169da313bc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.704602 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3604/7179] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:35.705644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.730748 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3576/7180] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:35 2022] PUT /identity/v3/projects/b729bd9361c5457b84040650f7fda117/users/1770fcec69584a7ba57800ff5cad8bf0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:35.735215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.735507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.736964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba5e1a-36fd-468f-a319-3cb0760c58a8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.737087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.782447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:35.786176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.807611 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:35.836959 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:35.862513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.863789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.864796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.865173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.866003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:35.868523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.874934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45091-05a5-43df-b22a-08f7b51c5378 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.901774 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3605/7181] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:31:35.903350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.903908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.904423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.920295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3577/7182] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:35.920295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.945693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e396-400a-4f45-a71c-ab09eced4f29 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:35.955972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:35.956855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:35.958208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:35.959398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:35.959928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:35.961969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:35.962734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:35.968207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:35.976958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3606/7183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:35.986821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:35.991784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:36.035781 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3578/7184] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:35 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:36.038995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:36.043596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:36.205830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8207-5252-445b-bcb9-2752fe48944b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.231027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd53e0-e635-4d2d-8102-9e439aa3090c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.236182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.237003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.237519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.237954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.404772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.405671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.406045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.406489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.437825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.447489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.474976 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3579/7185] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:36.488599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:36.521421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5faf-c869-41ee-8824-f2bac66778e8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.532274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.533045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.533648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.534240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.535456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.545767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.553690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.564298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.579210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3607/7186] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:36.590952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3580/7187] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:36 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:36.593003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:36.609918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8694-2983-493e-bf18-8db22ea93c4c service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.616093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.616646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.616932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.617214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.617901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.619790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.637460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3608/7188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:36.641735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:36.660522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7c5c5-ec08-493a-905b-cd86113a660b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.676420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.677061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.677348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.677718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.678375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.680057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e156-aee0-4189-8d8f-0d9d65249fdb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.706315 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3581/7189] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:36.710561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:36.720802 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:36.738368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b029ce-581f-4fc4-9ac8-b383906d2fdc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:36.751609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:36.752671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.752961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.753248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] PATH_INFO: `/v3/projects/cae5199548ae4d62ab5eda3250753175/users/7cc6ae90cb6d470b99f5683bc3b2cdfe/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.791567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5199548ae4d62ab5eda3250753175, user_id=7cc6ae90cb6d470b99f5683bc3b2cdfe, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:36.795434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:36.838294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:36.838613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:36.838889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:36.842957 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3609/7190] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:36 2022] PUT /identity/v3/projects/cae5199548ae4d62ab5eda3250753175/users/7cc6ae90cb6d470b99f5683bc3b2cdfe/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:36.963314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] MFA Rules not processed for user `7cc6ae90cb6d470b99f5683bc3b2cdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:36.964593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:36.992768 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:37.198758 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3582/7191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:37.203701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.370865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781f0d-c07f-4d26-9d0a-eb0225311c54 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.376572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.377214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.377907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.378193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.378732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.378947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.380908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.445758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3610/7192] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:37 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:37.449941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.546199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfffd1b-fb7b-4c34-81c7-8cdd01045eec None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.578581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9649ae-00ab-408b-8da6-948285dabd6a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.597470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.598235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.598628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.599009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.603524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.609207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.658423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3611/7193] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:37 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:37.659639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.679212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.680200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.680535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.680772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bfad-dd47-4c8b-93dc-413f06241469 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.680953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.684271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:37.696369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.697142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.697594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.697980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.698743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.700460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.706438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.709370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.730164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3612/7194] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:37.731173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.753485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac93d-41f5-42f1-9358-f4afe80f9ade admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.762880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3583/7195] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:37.772938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.773782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.774169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.774642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.775396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.778229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92929e-c3b8-460c-a5ae-7928ba365f2d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.797245 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3613/7196] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:37.801427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:37.822242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee83b6-5639-410f-9839-edcd56b574b3 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:37.832182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:37.833274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.833793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.834528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] PATH_INFO: `/v3/projects/1df2e89e7bd74d93831bab1229c8d339/users/2d30be46996145bd94a05f33f211b465/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.868695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df2e89e7bd74d93831bab1229c8d339, user_id=2d30be46996145bd94a05f33f211b465, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:37.878553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:37.920021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3584/7197] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:37 2022] PUT /identity/v3/projects/1df2e89e7bd74d93831bab1229c8d339/users/2d30be46996145bd94a05f33f211b465/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:37.921842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:37.922133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:37.922408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:37.956862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] MFA Rules not processed for user `2d30be46996145bd94a05f33f211b465`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:37.958359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:38.003569 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:38.115501 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3614/7198] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:38.123942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.229302 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:38.253950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a2a7-09e8-4e2a-b6d6-093281691870 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.261456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.262096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.262661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.262947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:38.264185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:38.266192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:38.303707 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3585/7199] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:38 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:38.310831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.341048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499acf9-c128-428f-94b4-80a74421a019 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.415324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.417586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:38.525098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.526112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.526404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.526846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:38.527519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:38.543012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:38.605379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3615/7200] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:38 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:38.610543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.625374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b20a-4bfb-4b19-983d-5be48e0b0410 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.633654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.635766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.636132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.636477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:38.636895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff148d-0de0-492a-bd52-e65302bb6ebf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.640391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:38.648111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.649146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.649610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.650056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:38.651132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:38.658387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:38.665329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:38.667604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:38.687674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3586/7201] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:38.689472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3616/7202] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:38.693791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.720981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba90a-5d83-4677-8118-c5308e58ea85 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.727139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.728104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.728875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.729701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] PATH_INFO: `/v3/projects/178e7d4ea41d4edebb8be114c62af054/users/41651cac7ad64166a93efbe06e047a7d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:38.772687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178e7d4ea41d4edebb8be114c62af054, user_id=41651cac7ad64166a93efbe06e047a7d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:38.775738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:38.802058 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3587/7203] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:38 2022] PUT /identity/v3/projects/178e7d4ea41d4edebb8be114c62af054/users/41651cac7ad64166a93efbe06e047a7d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:38.806734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:38.824213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665dc5-6344-43d4-8941-f0377ba3dcab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:38.998233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:38.998880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:38.999165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:38.999443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:39.000094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:39.012165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e41b-e6e3-4de6-9a18-d80fd6d733df admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:39.043028 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3617/7204] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:39.044256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:39.062922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf5b6e-bd84-47c3-a629-c2a81b345053 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:39.075549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:39.078287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:39.078582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:39.078849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] PATH_INFO: `/v3/projects/178e7d4ea41d4edebb8be114c62af054/users/41651cac7ad64166a93efbe06e047a7d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:39.085256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=178e7d4ea41d4edebb8be114c62af054, user_id=41651cac7ad64166a93efbe06e047a7d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:39.095310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:39.165472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3588/7205] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:39 2022] PUT /identity/v3/projects/178e7d4ea41d4edebb8be114c62af054/users/41651cac7ad64166a93efbe06e047a7d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:39.315316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:39.315620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:39.315929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:39.394413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] MFA Rules not processed for user `41651cac7ad64166a93efbe06e047a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:39.395995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:39.480520 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:39.604340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3618/7206] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:39.615575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:39.617544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:39.753375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f3ad-7b7c-4d75-8dc3-ae294cc87cdc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:39.765116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:39.765884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:39.766226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:39.766648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:39.790496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:39.791992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:39.821389 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3589/7207] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:39.886770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:39.888782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:39.930569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334996c-29ac-483c-a063-92b3fd25afca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:39.938378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:39.939018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:39.939298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:39.939570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:40.083324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:40.085275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:40.099542 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3619/7208] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:41.506276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:41.507871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:41.580358 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:41.648446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7168fb2-d1a7-4aee-a7ef-0b1117202f8c service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:41.670306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:41.671367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:41.671871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:41.672365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:41.674591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:41.911909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:41.916157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8106a11-92d0-4254-85ae-5a127a8111e9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:41.964920 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3590/7209] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:44.636553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:44.665328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2973e-ad4d-4ec5-bb3f-8428ef460024 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:44.685362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:44.690887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:44.691175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:44.691463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:44.702596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:44.746342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:44.748501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:44.775017 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3620/7210] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:49.666992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1badfd-adbb-470e-86cb-75ff4ea78e57 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:49.673259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1badfd-adbb-470e-86cb-75ff4ea78e57 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:49.673752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1badfd-adbb-470e-86cb-75ff4ea78e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:49.775052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a1badfd-adbb-470e-86cb-75ff4ea78e57 None None] MFA Rules not processed for user `1770fcec69584a7ba57800ff5cad8bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:49.775052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a1badfd-adbb-470e-86cb-75ff4ea78e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:49.897501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:49.930615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f5fd1-8063-46ed-b68b-a6aac07df8f6 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:49.946693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:49.947345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:49.947629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:49.948085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] PATH_INFO: `/v3/users/7cc6ae90cb6d470b99f5683bc3b2cdfe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:49.949636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc6ae90cb6d470b99f5683bc3b2cdfe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:49.952190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:50.016730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3591/7211] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:50.038750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:50.039037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:50.039317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:50.087977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] MFA Rules not processed for user `1770fcec69584a7ba57800ff5cad8bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:50.094106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:50.133330 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3592/7212] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:50.143958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:50.240423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc6ae90cb6d470b99f5683bc3b2cdfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:50.257719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc6ae90cb6d470b99f5683bc3b2cdfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:50.317771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc6ae90cb6d470b99f5683bc3b2cdfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:50.319187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc6ae90cb6d470b99f5683bc3b2cdfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:50.324457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec1ea585-eb48-4fbe-bde6-bd8f29eb9822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc6ae90cb6d470b99f5683bc3b2cdfe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:50.325081 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:50.372040 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3621/7213] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:49 2022] DELETE /identity/v3/users/7cc6ae90cb6d470b99f5683bc3b2cdfe => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:31:50.373680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9908d-f683-426d-a340-484d77de052a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:50.373985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9908d-f683-426d-a340-484d77de052a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:50.374212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9908d-f683-426d-a340-484d77de052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:50.393867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34a7bf-7db0-4842-bee7-8ddb1d8dfcb7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:50.444049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52d9908d-f683-426d-a340-484d77de052a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:50.445691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52d9908d-f683-426d-a340-484d77de052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:50.494661 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:50.615560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:50.617246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:50.617246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:50.617246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:50.618754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:50.654435 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3622/7214] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:50.691408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9908d-f683-426d-a340-484d77de052a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:50.697098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52d9908d-f683-426d-a340-484d77de052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:50.819690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:50.824125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:50.853483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3593/7215] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:50.878017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9908d-f683-426d-a340-484d77de052a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:50.897314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:50.898682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:50.899229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:50.899229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:50.932475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:50.934014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:50.953670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3623/7216] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:51.343419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:51.345357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:51.408679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad965-9651-492c-91bc-d4c13210c1c7 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:51.448731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:51.449732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:51.450230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:51.451817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] PATH_INFO: `/v3/projects/cae5199548ae4d62ab5eda3250753175` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:51.453359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae5199548ae4d62ab5eda3250753175)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:51.456116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:51.636136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae5199548ae4d62ab5eda3250753175', 'request_id': 'req-6e696f23-14d5-4257-a349-1e8e9da253d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.654410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae5199548ae4d62ab5eda3250753175', 'request_id': 'req-6e696f23-14d5-4257-a349-1e8e9da253d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.665725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae5199548ae4d62ab5eda3250753175', 'request_id': 'req-6e696f23-14d5-4257-a349-1e8e9da253d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.688214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] The token cache is being invalidate because project cae5199548ae4d62ab5eda3250753175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:51.688410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.689549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.691464 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3594/7217] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:51 2022] DELETE /identity/v3/projects/cae5199548ae4d62ab5eda3250753175 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:51.696990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:51.710489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f781-0847-4703-a40e-e0ef8f26ce35 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:51.866443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:51.867260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:51.867806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:51.868184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] PATH_INFO: `/v3/users/2d30be46996145bd94a05f33f211b465` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:51.869920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d30be46996145bd94a05f33f211b465)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:51.881958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:51.980232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d30be46996145bd94a05f33f211b465'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.989657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d30be46996145bd94a05f33f211b465'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:51.999558 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:52.010397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d30be46996145bd94a05f33f211b465'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:52.011226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d30be46996145bd94a05f33f211b465'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:52.011852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d30be46996145bd94a05f33f211b465'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:52.029941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3624/7218] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:51 2022] DELETE /identity/v3/users/2d30be46996145bd94a05f33f211b465 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:52.784025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:52.786120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:52.827751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e696f23-14d5-4257-a349-1e8e9da253d1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:52.873390 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:53.020260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:53.021006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:53.021657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:53.022006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] PATH_INFO: `/v3/projects/1df2e89e7bd74d93831bab1229c8d339` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:53.024506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df2e89e7bd74d93831bab1229c8d339)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:53.035727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:53.134357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df2e89e7bd74d93831bab1229c8d339', 'request_id': 'req-ccba1574-111e-4118-9059-131719b48eb0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.144746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df2e89e7bd74d93831bab1229c8d339', 'request_id': 'req-ccba1574-111e-4118-9059-131719b48eb0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.155281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df2e89e7bd74d93831bab1229c8d339', 'request_id': 'req-ccba1574-111e-4118-9059-131719b48eb0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.197490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] The token cache is being invalidate because project 1df2e89e7bd74d93831bab1229c8d339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:53.198583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.201182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.204752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3595/7219] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:52 2022] DELETE /identity/v3/projects/1df2e89e7bd74d93831bab1229c8d339 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:53.208765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:53.210959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:53.231153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50f20-eaca-4d3a-beb7-71fa9584ee27 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:53.348719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:53.350986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:53.351469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:53.352814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] PATH_INFO: `/v3/users/41651cac7ad64166a93efbe06e047a7d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:53.355569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41651cac7ad64166a93efbe06e047a7d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:53.358920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:53.467394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41651cac7ad64166a93efbe06e047a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.481626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41651cac7ad64166a93efbe06e047a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.509568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41651cac7ad64166a93efbe06e047a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.512240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41651cac7ad64166a93efbe06e047a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.515904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-77635f0d-42c7-4f4f-8d09-71d26e45c41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41651cac7ad64166a93efbe06e047a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:53.538990 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3625/7220] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:53 2022] DELETE /identity/v3/users/41651cac7ad64166a93efbe06e047a7d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:54.112648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:54.117507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:54.141993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba1574-111e-4118-9059-131719b48eb0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:54.289830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:54.290494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:54.290782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:54.291059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] PATH_INFO: `/v3/projects/178e7d4ea41d4edebb8be114c62af054` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:54.292983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178e7d4ea41d4edebb8be114c62af054)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:54.296088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:54.412492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178e7d4ea41d4edebb8be114c62af054', 'request_id': 'req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:54.422440 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:54.425151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178e7d4ea41d4edebb8be114c62af054', 'request_id': 'req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:54.459803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178e7d4ea41d4edebb8be114c62af054', 'request_id': 'req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:54.490132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] The token cache is being invalidate because project 178e7d4ea41d4edebb8be114c62af054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:54.490792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:54.492928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2b843d7-d2db-4a53-9fd0-cfd9743cb463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:54.498078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3596/7221] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:54 2022] DELETE /identity/v3/projects/178e7d4ea41d4edebb8be114c62af054 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:54.505016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:54.505549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:54.505549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:54.546505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:54.548022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:54.684932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3626/7222] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:54.694899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:54.696842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:54.697387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:54.750493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:54.755863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:54.784801 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3597/7223] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:54.790117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:54.800836 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:54.814942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161a5c9-c396-41bd-89c9-09f72cee2d39 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:54.830247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:54.831421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:54.831421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:54.831781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:54.832600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:31:54.833013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:54.837011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:54.874081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3627/7224] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:31:54.878218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:54.893301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f225-0ec4-409e-bae5-89c069587f94 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:54.907269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:54.908272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:54.908787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:54.909292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:54.910209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:54.914241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:54.977276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3598/7225] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:54.978581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:54.994125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b798-c399-4e3f-9ad0-639e8415af84 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:55.202985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:55.203469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:55.203754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:55.204031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:55.204787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:55.209461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:55.304588 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3628/7226] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:54 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:55.308192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:55.330216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b359e-e254-4c06-8cfb-b715b9c36e77 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:55.348569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:55.349214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:55.349536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:55.349820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:55.357728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:55.370670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:55.412888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3599/7227] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:55.414531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:55.429577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36422f-0c4e-4fc8-98af-dc6fdd0132ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:55.449301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:55.450301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:55.451121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:55.451410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:55.452075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:55.455534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10e435-b759-4e03-aeeb-6d80a16f1b91 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:55.515675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3629/7228] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:55.533159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:55.549122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41427584-5793-44af-9973-dc5df4fdd1c0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:55.566222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:55.567205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:55.567639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:55.568064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] PATH_INFO: `/v3/projects/f123b7cfb72945ab8e56d84e050e6b22/users/ca252c472ee44c0dbce580e46e56009b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:55.602756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f123b7cfb72945ab8e56d84e050e6b22, user_id=ca252c472ee44c0dbce580e46e56009b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:55.605695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:55.635241 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3600/7229] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:55 2022] PUT /identity/v3/projects/f123b7cfb72945ab8e56d84e050e6b22/users/ca252c472ee44c0dbce580e46e56009b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:55.649616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:55.652150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:55.652552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:55.707109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] MFA Rules not processed for user `ca252c472ee44c0dbce580e46e56009b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:55.708444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:55.889490 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3630/7230] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:55.894393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.054795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.056238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:56.056356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157527-04d8-4624-a522-300c10ab4da1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.062940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.064012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.064369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.064715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.065966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.069736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.147559 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3601/7231] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:31:55 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:56.149132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.209109 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:56.283439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d64e5c-6136-4528-81fb-11f51cbe43ed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.314961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e9bc7-90e5-4c2b-b52a-6877a4967046 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.328560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.331424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.331946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.333763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.334603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.337146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.355821 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:56.387428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3602/7232] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:31:56 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:31:56.394120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.415453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283336ab-718e-40c9-96b3-a555a2327921 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.423235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.424197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.425179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.425883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.429045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.436142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.443316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.444119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.444503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.444900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.447049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:56.463010 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3603/7233] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:31:56.464671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.478795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.488633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11cde-b0e0-424a-b025-da937ee40920 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.493538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.502138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.502975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.504816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.506749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] PATH_INFO: `/v3/projects/1769aab485a847adbcfef5853a4e461f/users/45b736c309144cfaa291de3c9f22aaf5/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.521145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3631/7234] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:31:56.537841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1769aab485a847adbcfef5853a4e461f, user_id=45b736c309144cfaa291de3c9f22aaf5, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.541270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.561133 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3604/7235] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:56 2022] PUT /identity/v3/projects/1769aab485a847adbcfef5853a4e461f/users/45b736c309144cfaa291de3c9f22aaf5/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:56.565066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.585230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3e7e7-cb8b-4725-bae1-bfd6aa38e88d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.699709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.701018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.701591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.701947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.702682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.704422 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913be7-a6b8-49ab-b87b-d9092f7d3264 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.720770 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3632/7236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:31:56.721916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:56.737804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1892c09-c9cb-4b14-8aef-2621f60cd101 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:56.756046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:56.757746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.758304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.758583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] PATH_INFO: `/v3/projects/1769aab485a847adbcfef5853a4e461f/users/45b736c309144cfaa291de3c9f22aaf5/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.760719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1769aab485a847adbcfef5853a4e461f, user_id=45b736c309144cfaa291de3c9f22aaf5, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:56.764635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:56.778323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3605/7237] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:31:56 2022] PUT /identity/v3/projects/1769aab485a847adbcfef5853a4e461f/users/45b736c309144cfaa291de3c9f22aaf5/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:56.788843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:56.789199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:56.789394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:56.840682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] MFA Rules not processed for user `45b736c309144cfaa291de3c9f22aaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:56.842342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:57.022357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3633/7238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:31:57.040480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:57.043114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:57.160811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6f9d-e453-4c17-9576-81eff845fa76 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:57.165160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:57.166024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:57.166574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:57.166960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:57.248343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:57.250017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:57.260208 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3606/7239] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:31:58.504580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:58.506332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:58.513454 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:58.642610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34f23-f8ad-4e1f-af9e-193752d9d3df None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:58.647754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:58.648498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:58.648895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:58.649178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] PATH_INFO: `/v3/users/45ae26af1d0d4104850875f565485d49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:58.650485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ae26af1d0d4104850875f565485d49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:58.653284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:58.741278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ae26af1d0d4104850875f565485d49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:58.758112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ae26af1d0d4104850875f565485d49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:58.790549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ae26af1d0d4104850875f565485d49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:58.791475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ae26af1d0d4104850875f565485d49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:58.796964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ab98785-08ca-47f3-8058-e83c97e055f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ae26af1d0d4104850875f565485d49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:58.826490 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3634/7240] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:58 2022] DELETE /identity/v3/users/45ae26af1d0d4104850875f565485d49 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:59.219317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:59.250644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d8e5-970a-4774-9dad-6f53c7d004fd service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:59.401060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:59.404753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:59.405111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:59.425125 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:59.435230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:59.435924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:59.436171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:59.436466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] PATH_INFO: `/v3/projects/1af93ee90d9d415b850745b7374348b8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:59.440135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:31:59.441905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af93ee90d9d415b850745b7374348b8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:59.442035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:59.444401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:59.522789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af93ee90d9d415b850745b7374348b8', 'request_id': 'req-5463bb66-ceb7-4486-9de0-be91a833424d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.531916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af93ee90d9d415b850745b7374348b8', 'request_id': 'req-5463bb66-ceb7-4486-9de0-be91a833424d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.539336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af93ee90d9d415b850745b7374348b8', 'request_id': 'req-5463bb66-ceb7-4486-9de0-be91a833424d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.556063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] The token cache is being invalidate because project 1af93ee90d9d415b850745b7374348b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:31:59.556977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.557877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.560162 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3607/7241] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:31:59 2022] DELETE /identity/v3/projects/1af93ee90d9d415b850745b7374348b8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:31:59.564795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:31:59.568850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:31:59.587108 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3635/7242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:31:59.716921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bb66-ceb7-4486-9de0-be91a833424d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:31:59.733834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:31:59.737651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:31:59.739199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:31:59.740930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] PATH_INFO: `/v3/users/c641cb06bb4249a18aa8c7b2df80d48e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:31:59.746883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c641cb06bb4249a18aa8c7b2df80d48e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:31:59.750337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:31:59.855717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c641cb06bb4249a18aa8c7b2df80d48e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.856527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c641cb06bb4249a18aa8c7b2df80d48e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.867049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c641cb06bb4249a18aa8c7b2df80d48e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.889097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c641cb06bb4249a18aa8c7b2df80d48e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.890245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c641cb06bb4249a18aa8c7b2df80d48e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:31:59.909472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3608/7243] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:31:59 2022] DELETE /identity/v3/users/c641cb06bb4249a18aa8c7b2df80d48e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:00.342494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:00.344269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:00.425946 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:00.493162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c9a4-dac4-41f4-a20a-8196a3602e5c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:00.520085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:00.521993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:00.537067 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:00.611384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:00.612025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:00.612310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:00.612588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:00.616247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:00.630202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:00.631775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823f13b-e38e-44e5-8d58-328343c390e8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:00.643958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d577bfd-ee70-469d-9154-806139001d73 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:00.644181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3636/7244] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:32:00.651139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:00.652026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:00.652314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:00.652626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] PATH_INFO: `/v3/projects/5e4928093d8f4064b8352f345698b34d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:00.654889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4928093d8f4064b8352f345698b34d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:00.656868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:00.722356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4928093d8f4064b8352f345698b34d', 'request_id': 'req-30474501-9726-4455-9b3f-ad0a37cc8d34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:00.733065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4928093d8f4064b8352f345698b34d', 'request_id': 'req-30474501-9726-4455-9b3f-ad0a37cc8d34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:00.740736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4928093d8f4064b8352f345698b34d', 'request_id': 'req-30474501-9726-4455-9b3f-ad0a37cc8d34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:00.761495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] The token cache is being invalidate because project 5e4928093d8f4064b8352f345698b34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:32:00.761931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:00.763209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-30474501-9726-4455-9b3f-ad0a37cc8d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:00.768575 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3609/7245] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:32:00 2022] DELETE /identity/v3/projects/5e4928093d8f4064b8352f345698b34d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:32:00.770324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:00.770795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:00.771352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:00.798108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:00.799348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:00.879181 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3637/7246] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:00.887279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:00.887636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:00.888475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:00.915136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:00.916538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:00.926974 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3610/7247] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:00.931690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:00.944165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a6c6-8300-4097-8b7a-e48853f389bd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:00.949592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:00.954123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:00.954311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:00.954752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:00.955533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:32:00.955939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:00.957731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:00.975064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3638/7248] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:32:00.976696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:00.990617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05b97d-40a0-4436-9699-91ee1966bf8a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.010169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.010927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.011292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.011635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.012345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.014725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.068637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.077614 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3611/7249] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:32:00 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:32:01.084390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997e5ba-143b-4cea-b74d-2ba512b49086 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.162352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.164655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.183230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.185558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.186229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.186693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.187954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.194675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.253785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3639/7250] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:32:01 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:32:01.255431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.262873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a319-a7db-4749-81a4-4d0338d1fa35 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.269692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.270912 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:01.271633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.272069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.272371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.279463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.282933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ab4d-33e6-426c-b620-583005553104 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.288923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.289620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.289998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.290284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.291136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.291590 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:01.292898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.301125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.303865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.318760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3640/7251] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:32:01.320191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.325489 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3612/7252] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:01.349269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888a401-f006-4730-b8bb-74d7bb5cecd8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.355478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.356159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.356476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.356823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.357344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.359063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475db08-0d96-4581-9bfe-b2cbb1a23f66 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.386326 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3641/7253] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:32:01.392428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.440211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23b2ef-6e58-4a4c-9811-8bf0f4a61c7d service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.452068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.452900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.453322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.453795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] PATH_INFO: `/v3/projects/0604216998c24ee59f60c44615850d30/users/8447ea42224541a69b6af35641350164/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.475261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.475561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.475830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.490999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0604216998c24ee59f60c44615850d30, user_id=8447ea42224541a69b6af35641350164, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.500984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051383e-7dc9-4777-bab6-09c1e367aedb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.522854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:01.524106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.542971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3613/7254] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:32:01 2022] PUT /identity/v3/projects/0604216998c24ee59f60c44615850d30/users/8447ea42224541a69b6af35641350164/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:01.550723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.551045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.551327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.595362 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3642/7255] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:32:01.596202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.597617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.600455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:01.601765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.701375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3614/7256] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:01.713507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:01.715238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.761067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f568-8c6a-4589-8d6c-b76579242797 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.771156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.771883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.772170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.773632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.781271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:01.804985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.814564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.845154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20090ac8-ce9d-40a4-9d60-3216aabb7a2b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:01.850092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:01.850707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:01.850975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:01.851391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:01.859431 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3643/7257] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:01.862819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:01.864750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75a112-21e9-47f7-abae-9fc58f92c00c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:01.879433 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3615/7258] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:02.642679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:02.644285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:02.659965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9776-7bfd-4cf6-b161-b0b9d6ad6cdd service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:02.665187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:02.666071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:02.666416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:02.666600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] PATH_INFO: `/v3/users/7b934504be9a4592a2f71aa8afd84577` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:02.667719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b934504be9a4592a2f71aa8afd84577)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:02.672141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:02.794382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b934504be9a4592a2f71aa8afd84577'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:02.810197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b934504be9a4592a2f71aa8afd84577'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:02.834319 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:02.839666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b934504be9a4592a2f71aa8afd84577'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:02.841285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b934504be9a4592a2f71aa8afd84577'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:02.841861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b934504be9a4592a2f71aa8afd84577'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:02.876014 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3644/7259] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:32:02 2022] DELETE /identity/v3/users/7b934504be9a4592a2f71aa8afd84577 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:02.880484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:02.880958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:02.881055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:02.932371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:02.933655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:03.189907 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3616/7260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:03.222123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:03.223597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:03.354544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef64d-673e-4006-a4e2-95e556ba81fe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:03.362542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:03.363183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:03.363477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:03.363753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:03.422282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:03.423811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25691-a814-4837-873a-aead78cb9030 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:03.446130 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3645/7261] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:04.099517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.101312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:04.122474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce8351-5803-46d9-a3de-e77e50cfc06f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.135614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.136418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.136794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.137224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] PATH_INFO: `/v3/projects/4be9da7930874d11b2c71e256abdfa32` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.139569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be9da7930874d11b2c71e256abdfa32)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.141827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.154774 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:04.204226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be9da7930874d11b2c71e256abdfa32', 'request_id': 'req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:04.213151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be9da7930874d11b2c71e256abdfa32', 'request_id': 'req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:04.221604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be9da7930874d11b2c71e256abdfa32', 'request_id': 'req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:04.243005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] The token cache is being invalidate because project 4be9da7930874d11b2c71e256abdfa32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:32:04.243562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:04.244512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-caf63b71-d6d1-4d32-9dd3-b7cd70d96840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:04.246863 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3617/7262] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:32:04 2022] DELETE /identity/v3/projects/4be9da7930874d11b2c71e256abdfa32 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:04.253271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.253875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.253875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.291215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:04.292977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:04.394525 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3646/7263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:04.403774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.404976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.405487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.437620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:04.438937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:04.449992 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3618/7264] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:04.453864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.464351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245158c-55f8-4365-a371-53e0709bd30d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.470503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.471336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.471698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.472077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.472911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:32:04.473498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.475217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.495283 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3647/7265] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:32:04.496997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.507904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdffa0-b871-4400-9713-0da58b5ac945 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.513345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.513998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.514284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.514735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.515379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.517315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.558007 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3619/7266] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:32:04 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:32:04.563152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.577274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007164-19c8-4940-808e-c8a141c78fbc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.691375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.692017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.692363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.692642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.693288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.695371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.732951 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3648/7267] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:32:04 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:32:04.734582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.752458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debe79c-b9ba-4541-bd1b-b177ff65ad58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.758774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.760041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.760468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.761976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.762898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.765057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.783611 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3620/7268] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:32:04.790692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.817286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ce8b8-a722-48e9-ac40-30117b4413f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.823764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.824605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.824953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.825587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.826426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.828245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7689b41-23af-408b-af8c-62cfe3beab75 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.829937 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:04.848928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:04.849346 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3649/7269] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:32:04.864503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696203b-50d4-4cda-be54-34176c931dda admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:04.870769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:04.871472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.871872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.872698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] PATH_INFO: `/v3/projects/b788028d56a246d49f6586d6255e5f39/users/4ec1161d97a84fb2ab8d27491008c744/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.901293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b788028d56a246d49f6586d6255e5f39, user_id=4ec1161d97a84fb2ab8d27491008c744, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:04.904532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:04.937056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ce3-acbc-4031-95fb-c6093e32af1c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:04.937355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ce3-acbc-4031-95fb-c6093e32af1c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:04.937730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799ce3-acbc-4031-95fb-c6093e32af1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:04.941442 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3621/7270] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:32:04 2022] PUT /identity/v3/projects/b788028d56a246d49f6586d6255e5f39/users/4ec1161d97a84fb2ab8d27491008c744/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:05.063082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15799ce3-acbc-4031-95fb-c6093e32af1c None None] MFA Rules not processed for user `4ec1161d97a84fb2ab8d27491008c744`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:05.067519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15799ce3-acbc-4031-95fb-c6093e32af1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:05.176941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3650/7271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:05.189812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:05.192419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:05.277864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3ce5-130b-461f-aa09-fdd3adb43ebb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:05.284246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:05.285187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:05.285527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:05.285958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:05.296996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:05.298525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae85d6-c122-49a2-b560-a58e387f3b71 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:05.308892 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3622/7272] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:08.126042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:08.126583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:08.126668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:08.155402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] MFA Rules not processed for user `4ec1161d97a84fb2ab8d27491008c744`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:08.156650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:08.166320 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3651/7273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:09.580948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090236dd-f65c-4a16-ba19-41a2b1cba646 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:09.581444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090236dd-f65c-4a16-ba19-41a2b1cba646 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:09.581710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090236dd-f65c-4a16-ba19-41a2b1cba646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:09.670570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-090236dd-f65c-4a16-ba19-41a2b1cba646 None None] MFA Rules not processed for user `8447ea42224541a69b6af35641350164`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:09.672207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-090236dd-f65c-4a16-ba19-41a2b1cba646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:09.734867 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:09.751049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:09.752746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:09.848703 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3623/7274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:09.867683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:09.867683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:09.867683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:09.895887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] MFA Rules not processed for user `8447ea42224541a69b6af35641350164`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:09.897573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:09.906459 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3624/7275] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:32:09.920152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:09.921824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:09.948345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f770f5-005e-42f7-953b-76e173089427 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:09.954551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:09.955296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:09.955643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:09.957268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:09.959517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:10.055919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46a666-2c94-4c5b-9011-d96959b88af9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:10.060029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:10.062179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:10.064325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:10.064948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:10.065792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:10.066073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:10.081758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:10.089857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3652/7276] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:32:10.091149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:10.121606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3625/7277] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:32:20.070402 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:20.102121 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=52 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:22.260938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:22.266748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:22.437925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d766f92-68af-4134-86f4-d1819f65f980 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:22.444887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:22.446173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:22.446446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:22.446728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] PATH_INFO: `/v3/users/1770fcec69584a7ba57800ff5cad8bf0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:22.448426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1770fcec69584a7ba57800ff5cad8bf0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:22.452730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:22.538258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1770fcec69584a7ba57800ff5cad8bf0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:22.547894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1770fcec69584a7ba57800ff5cad8bf0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:22.566088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1770fcec69584a7ba57800ff5cad8bf0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:22.566954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1770fcec69584a7ba57800ff5cad8bf0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:22.567723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466adf6e-2caa-45e0-b1d2-3083ea74d46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1770fcec69584a7ba57800ff5cad8bf0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:22.585957 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3653/7278] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:32:22 2022] DELETE /identity/v3/users/1770fcec69584a7ba57800ff5cad8bf0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:22.905323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:22.917266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a5d88-f76d-4934-aa09-7ff3412bff0c service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.072511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.073940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.074422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.074890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] PATH_INFO: `/v3/projects/b729bd9361c5457b84040650f7fda117` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.077637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b729bd9361c5457b84040650f7fda117)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.079852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.163866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b729bd9361c5457b84040650f7fda117', 'request_id': 'req-7c6bdee2-47d0-4d52-9fee-92f94e330364'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:23.174932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b729bd9361c5457b84040650f7fda117', 'request_id': 'req-7c6bdee2-47d0-4d52-9fee-92f94e330364'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:23.184551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b729bd9361c5457b84040650f7fda117', 'request_id': 'req-7c6bdee2-47d0-4d52-9fee-92f94e330364'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:23.207493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] The token cache is being invalidate because project b729bd9361c5457b84040650f7fda117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:32:23.207796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:23.208472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c6bdee2-47d0-4d52-9fee-92f94e330364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:32:23.214966 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3626/7279] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:32:22 2022] DELETE /identity/v3/projects/b729bd9361c5457b84040650f7fda117 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:23.217427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.217715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.217994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.257672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:23.258930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:23.362667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3654/7280] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:23.369744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.370104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.370348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.396310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:23.397817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:23.411338 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3627/7281] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:32:23.419080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.432238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932aee-de55-4a25-8985-aa27f3abdb6c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.437278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.437936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.438221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.438504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.439164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:32:23.439470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.441239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.464218 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3655/7282] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:32:23.469488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.495937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9091b-8cd2-4298-8eae-809ce3e194c6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.501095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.501889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.502167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.502445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.503113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.505012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.534023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3628/7283] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:32:23 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:32:23.544575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.554820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5861-0954-4ced-a6d4-ae9d591a12c1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.558525 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:23.616271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.616880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.617163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.617461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.618100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.620026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.646292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3656/7284] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:32:23 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:32:23.647771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.659681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430bae-f8b7-4ef1-a8ee-705a5ad407bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.664400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.665011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.665295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.665605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.666251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.667898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.681681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3629/7285] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:32:23.682882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.693321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f7ce-f828-4c76-b8d7-9733fc97e149 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.698175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.698818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.699104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.699913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.700752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.702892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6222-6ab4-4593-bce5-08a0616bbff3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.718281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3657/7286] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:32:23.720037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.736845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b535488-5cbb-4ed2-8bb8-847a657a1f92 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.742160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.742953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.743422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.743769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] PATH_INFO: `/v3/projects/1c215ba6bfd84b8fb7e6b170b813b517/users/0f8c7f57af21464684837dcce49d4d0b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.762556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c215ba6bfd84b8fb7e6b170b813b517, user_id=0f8c7f57af21464684837dcce49d4d0b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.765528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:23.783043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3630/7287] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:32:23 2022] PUT /identity/v3/projects/1c215ba6bfd84b8fb7e6b170b813b517/users/0f8c7f57af21464684837dcce49d4d0b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:32:23.789494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b059e6-fbfc-4bba-be34-f24b60cc6062 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.789795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b059e6-fbfc-4bba-be34-f24b60cc6062 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.790026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b059e6-fbfc-4bba-be34-f24b60cc6062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.811106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-50b059e6-fbfc-4bba-be34-f24b60cc6062 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:23.812369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50b059e6-fbfc-4bba-be34-f24b60cc6062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:23.886442 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3658/7288] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:23.896552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:23.898282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:23.936572 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:23.971380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef6c0-3424-443a-b482-3cb90f7716ad admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:23.977516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:23.977516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:23.977516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:23.977516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:23.997160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:23.997160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013409-db2c-4bdf-bf53-1f27d9e9ad55 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:24.010769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3631/7289] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:24.192853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:24.193223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:24.193601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:24.226431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:24.227832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:24.304004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3659/7290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:31.573234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec250dcb-7802-41e4-8e63-6e4c37a5afb2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:31.574380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec250dcb-7802-41e4-8e63-6e4c37a5afb2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:31.575041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec250dcb-7802-41e4-8e63-6e4c37a5afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:31.644197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ec250dcb-7802-41e4-8e63-6e4c37a5afb2 None None] MFA Rules not processed for user `0f8c7f57af21464684837dcce49d4d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:31.645534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ec250dcb-7802-41e4-8e63-6e4c37a5afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:31.755978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3632/7291] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:31.770417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:31.771882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:31.859612 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:31.917433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ddc3-bb7d-4677-8190-939fcc69089a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:31.926206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:31.926982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:31.927274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:31.927552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:31.939599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:31.941639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121d20-fdbb-442d-a4d5-b0d259440a30 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:31.953572 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3660/7292] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:33.808041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:33.808690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:33.808690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:33.829373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] MFA Rules not processed for user `0f8c7f57af21464684837dcce49d4d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:33.831040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:33.839168 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3633/7293] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:41.947871 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=20 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:43.823293 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=49 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:44.659146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802e97-f8ca-4553-bb76-8b643aa96fb9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:44.659647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802e97-f8ca-4553-bb76-8b643aa96fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:44.659755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802e97-f8ca-4553-bb76-8b643aa96fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:44.690234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b7802e97-f8ca-4553-bb76-8b643aa96fb9 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:32:44.691710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7802e97-f8ca-4553-bb76-8b643aa96fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:44.701359 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3661/7294] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:32:53.126622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:32:53.128153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:53.191984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3676fe-f6b7-4ed4-b750-67d6c35d06bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:32:53.195587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:32:53.196192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:32:53.196467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:32:53.196734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:32:53.199178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:32:53.260791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:32:53.262821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84c2c6-1937-4108-b157-f5092e55e2b0 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:32:53.272353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3634/7295] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:32:54.683945 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:00.165780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:00.167610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:00.168081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:00.189737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:33:00.191161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:00.199502 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3662/7296] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:33:00.435724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b413a-3300-4a53-b7f6-b02f04b4d675 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:00.436272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b413a-3300-4a53-b7f6-b02f04b4d675 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:00.436272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b413a-3300-4a53-b7f6-b02f04b4d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:00.456350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a21b413a-3300-4a53-b7f6-b02f04b4d675 None None] MFA Rules not processed for user `8447ea42224541a69b6af35641350164`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:33:00.457983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a21b413a-3300-4a53-b7f6-b02f04b4d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:00.531536 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3635/7297] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:33:03.418665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:33:03.420235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:03.518132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babd414-876d-48fb-901f-6b58c2ceae45 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:33:03.525047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:33:03.525734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:03.526021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:03.527035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:03.530518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:03.606955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:33:03.608869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:33:03.622413 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3663/7298] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:33:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:33:10.523054 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=75 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:13.621328 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=57 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:24.251881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2aca7-3bc9-4066-a2a4-637112e03c54 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:24.252426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2aca7-3bc9-4066-a2a4-637112e03c54 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:24.252426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2aca7-3bc9-4066-a2a4-637112e03c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:24.290052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0ce2aca7-3bc9-4066-a2a4-637112e03c54 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:33:24.292492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0ce2aca7-3bc9-4066-a2a4-637112e03c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:24.308648 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3636/7299] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:33:24.360582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:33:24.378263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37de24-c5a8-4298-8055-34bc2dfec761 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:33:24.394817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:33:24.395259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:24.395830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:24.396433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:24.449878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:33:24.453581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cb335-d89e-4a33-b59d-7449c4a5c143 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:33:24.489770 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3664/7300] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:33:34.277805 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:34.466871 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:42.302132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:42.302699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:42.302699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:42.326866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] MFA Rules not processed for user `c10efff521ac401cb6b0cf0f7a0f8826`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:33:42.328454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:42.336494 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3637/7301] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:33:47.735500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:47.736041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:47.736041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:47.813087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:33:47.814307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:33:47.961591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3665/7302] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:33:48.037515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:33:48.052707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1956c-0eeb-4807-98d4-d436bcc1bcc1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:33:48.062067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:33:48.062957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:33:48.063388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:33:48.063833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:33:48.075486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:33:48.077327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:33:48.088006 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3638/7303] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:33:57.932147 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=29 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:58.083273 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:08.878336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:08.879771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:08.998429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fc1d9-589c-4802-8bf8-edd07086d2a5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:09.002486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:09.003364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:09.004179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:09.005066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:09.008003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:09.069599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:09.071515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:09.105039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3666/7304] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:09.300514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:09.303721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:09.346970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347967f-9a02-4ad2-9746-35b5728b504d service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:09.355245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:09.357713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:09.358166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:09.358651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:09.361101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:09.426215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:09.435267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:09.461555 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3639/7305] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:09.627179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:09.645850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370562a-1dd9-4c91-aeb4-0f52e8dc54cf service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:09.651081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:09.652436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:09.658117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:09.658957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:09.661741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:09.684621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:09.686978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:09.718276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3667/7306] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:09.770085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:09.771703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:09.835381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4830ad-1ccb-4af3-89e4-f0355e4ac3e9 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:09.841237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:09.841902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:09.842194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:09.842461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] PATH_INFO: `/v3/users/8447ea42224541a69b6af35641350164` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:09.844015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8447ea42224541a69b6af35641350164)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:09.846548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:09.924949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8447ea42224541a69b6af35641350164'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:09.925918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8447ea42224541a69b6af35641350164'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:09.945003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8447ea42224541a69b6af35641350164'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:09.959203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8447ea42224541a69b6af35641350164'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:09.960021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c63dcb33-bdfe-4d84-814a-b30f636b9218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8447ea42224541a69b6af35641350164'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:09.982348 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3640/7307] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:09 2022] DELETE /identity/v3/users/8447ea42224541a69b6af35641350164 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:10.257204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:10.278729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d413-9919-421c-8d53-a1b67e10f75e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:10.461700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:10.462728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:10.463177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:10.463624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] PATH_INFO: `/v3/projects/0604216998c24ee59f60c44615850d30` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:10.465973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0604216998c24ee59f60c44615850d30)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:10.468128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:10.639264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0604216998c24ee59f60c44615850d30', 'request_id': 'req-3740f7fb-b0f5-497d-8177-57e497171f57'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:10.650125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0604216998c24ee59f60c44615850d30', 'request_id': 'req-3740f7fb-b0f5-497d-8177-57e497171f57'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:10.659968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0604216998c24ee59f60c44615850d30', 'request_id': 'req-3740f7fb-b0f5-497d-8177-57e497171f57'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:10.683650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] The token cache is being invalidate because project 0604216998c24ee59f60c44615850d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:10.684262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:10.685372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3740f7fb-b0f5-497d-8177-57e497171f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:10.687298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3668/7308] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:10 2022] DELETE /identity/v3/projects/0604216998c24ee59f60c44615850d30 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:10.693384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:10.694050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:10.694050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:10.716709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:10.718078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:10.827999 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3641/7309] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:10.836614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:10.837968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:10.838468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:10.863959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:10.868134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:10.908598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3669/7310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:10.910326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:10.965943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39d18-13bd-4b65-8ee1-70ad20677b6f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:10.981488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:10.989995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.005440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3642/7311] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:11.009753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.015807 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:11.021268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19050f9-ccfb-4f57-85a1-165fd14d9beb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.029291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.029945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.030580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.031184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.032013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.034514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.083357 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3670/7312] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:11 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:34:11.084555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.096655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee6d4-bfcc-4211-b529-501446f1b8b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.129759 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:11.178628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.180162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.180435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.180780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.182083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.184050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.215059 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3643/7313] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:11 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:11.218845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.231813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a268-7291-4ae1-bc73-d7039fcc3b73 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.242384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.242384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.242384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.242384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.252989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.252989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.261509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3671/7314] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:11.262155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.282824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00567-14b1-44c5-bd3c-650a5286f3e0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.293691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.294594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.294880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.295158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.295814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.299520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3f9a-8e3f-42a1-8e8d-ba836896c39c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.313451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3644/7315] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:11.316269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.327453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba456e8-b62b-4e56-8481-7163d2ad3a32 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.333131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.333917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.334268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.334618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] PATH_INFO: `/v3/projects/143d98d4d3984729b03022104174e152/users/a5ee3a1275ac406bb0f8fbda96d3ad4b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.357933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143d98d4d3984729b03022104174e152, user_id=a5ee3a1275ac406bb0f8fbda96d3ad4b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.360764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf93f9-30e4-4e98-85b2-e3983f5435d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.382953 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3672/7316] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:11 2022] PUT /identity/v3/projects/143d98d4d3984729b03022104174e152/users/a5ee3a1275ac406bb0f8fbda96d3ad4b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:11.393779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.394098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.394341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.441599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] MFA Rules not processed for user `a5ee3a1275ac406bb0f8fbda96d3ad4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:11.443055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:11.539119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3645/7317] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:11.550774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fc37-bed9-413e-a459-f7ad1bac7a85 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.551246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fc37-bed9-413e-a459-f7ad1bac7a85 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.551371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fc37-bed9-413e-a459-f7ad1bac7a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.586368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-84b8fc37-bed9-413e-a459-f7ad1bac7a85 None None] MFA Rules not processed for user `a5ee3a1275ac406bb0f8fbda96d3ad4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:11.586368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84b8fc37-bed9-413e-a459-f7ad1bac7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:11.608642 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3673/7318] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:11.624049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:11.624049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:11.737710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e237194-242c-4fb6-a63b-9e35428e9e0d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:11.761710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:11.762354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:11.762644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:11.762919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:11.780763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:11.782429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:11.802099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3646/7319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:21.111849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:21.112458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:21.112458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:21.160036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:21.161303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:21.274889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3674/7320] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:21.288275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:21.290873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:21.330754 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:21.423628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bdbd2-c7d6-45f6-b029-c7b92a623f00 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:21.431428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:21.432628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:21.433392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:21.436351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:21.450004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:21.452145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:21.463220 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3647/7321] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:31.275473 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:31.469439 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=26 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:35.266580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:35.270498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:35.396176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4a5b-233d-4e8e-bdea-78233538d435 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:35.401772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:35.405856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:35.406212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:35.406418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:35.408328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:35.425683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:35.428849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ef0b-219e-438b-ba75-e834c54d5cb1 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:35.446882 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3675/7322] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:39.039796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:39.041495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:39.120011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8113-ddb3-4903-a6ad-c67822f20ea7 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:39.126049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:39.127142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:39.127142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:39.127373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] PATH_INFO: `/v3/users/ca252c472ee44c0dbce580e46e56009b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:39.128349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca252c472ee44c0dbce580e46e56009b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:39.130295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:39.188721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca252c472ee44c0dbce580e46e56009b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:39.189591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca252c472ee44c0dbce580e46e56009b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:39.200129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca252c472ee44c0dbce580e46e56009b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:39.214101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca252c472ee44c0dbce580e46e56009b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:39.214907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca252c472ee44c0dbce580e46e56009b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:39.230353 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3648/7323] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:39 2022] DELETE /identity/v3/users/ca252c472ee44c0dbce580e46e56009b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:39.234933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:39.235667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:39.236131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:39.265675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:39.267399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:39.360830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3676/7324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:39.368950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:39.370417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:39.444684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56610-9e17-4dcc-9bbe-56242ca02ec5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:39.449392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:39.450227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:39.450615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:39.450962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:39.470236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:39.472024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:39.483199 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3649/7325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:34:39.897806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:39.899015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:39.949704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:39.953817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:39.970700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3c6c-5663-4ccc-a574-351423c36871 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:39.983657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:39.984305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:39.984585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:39.984861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] PATH_INFO: `/v3/projects/f123b7cfb72945ab8e56d84e050e6b22` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:39.989490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f123b7cfb72945ab8e56d84e050e6b22)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:39.991458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:40.033706 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:40.038684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49300b-490b-4e3b-a635-ee3025d17c36 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:40.063466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:40.064139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:40.065181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:40.065626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:40.070366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:40.086252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f123b7cfb72945ab8e56d84e050e6b22', 'request_id': 'req-b9f44f87-86dd-4d4c-bb03-24908931a4d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.095174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f123b7cfb72945ab8e56d84e050e6b22', 'request_id': 'req-b9f44f87-86dd-4d4c-bb03-24908931a4d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.103734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f123b7cfb72945ab8e56d84e050e6b22', 'request_id': 'req-b9f44f87-86dd-4d4c-bb03-24908931a4d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.112800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:40.114644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:40.122988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] The token cache is being invalidate because project f123b7cfb72945ab8e56d84e050e6b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:40.123292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.123998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.125935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3650/7326] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:39 2022] DELETE /identity/v3/projects/f123b7cfb72945ab8e56d84e050e6b22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:40.129701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:40.131451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3677/7327] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:34:40.141826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:40.234255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44f87-86dd-4d4c-bb03-24908931a4d1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:40.241282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:40.243075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:40.243522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:40.244096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] PATH_INFO: `/v3/users/45b736c309144cfaa291de3c9f22aaf5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:40.245713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b736c309144cfaa291de3c9f22aaf5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:40.248211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:40.319854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b736c309144cfaa291de3c9f22aaf5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.320828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b736c309144cfaa291de3c9f22aaf5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.329475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b736c309144cfaa291de3c9f22aaf5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.348380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b736c309144cfaa291de3c9f22aaf5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.349137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4e57b72-0bfa-424e-9b2a-cb35f3b8503a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b736c309144cfaa291de3c9f22aaf5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.387949 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3651/7328] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:40 2022] DELETE /identity/v3/users/45b736c309144cfaa291de3c9f22aaf5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:34:40.719342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:40.738259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41df48-34a7-4bd6-9c3e-1e0e95e6828e service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:40.753949 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:40.815427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:40.816233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:40.816521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:40.816799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] PATH_INFO: `/v3/projects/1769aab485a847adbcfef5853a4e461f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:40.817978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1769aab485a847adbcfef5853a4e461f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:40.819996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:40.888969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1769aab485a847adbcfef5853a4e461f', 'request_id': 'req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.895668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1769aab485a847adbcfef5853a4e461f', 'request_id': 'req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.902489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1769aab485a847adbcfef5853a4e461f', 'request_id': 'req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.916382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] The token cache is being invalidate because project 1769aab485a847adbcfef5853a4e461f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:40.916759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.917550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e6f8cded-cf6e-42c7-af8c-53ad5371e0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:40.919190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3678/7329] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:40 2022] DELETE /identity/v3/projects/1769aab485a847adbcfef5853a4e461f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:40.924074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:40.924433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:40.924778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:40.944867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:40.946781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:40.966514 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:41.010269 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3652/7330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:41.018059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.018352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.018631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.039838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:41.041060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:41.049025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3679/7331] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:41.053186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.063804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973893cc-7e0d-4ffb-a122-f7d6c2f2d7e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.068413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.069010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.069295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.069738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.070384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:41.071262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.072859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.084754 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3653/7332] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:41.088884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.098344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421ffc-1c29-4e3b-b564-c9e75a1bfa55 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.103617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.104163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.104521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.104868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.105611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.107594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.138036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3680/7333] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:41 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:41.142236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.152746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bd21-d461-4f6d-aad5-94d8683c080f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.227003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.227619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.227904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.228188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.228831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.230799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.261730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3654/7334] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:41 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:34:41.264507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.276152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f29d1-464f-4b35-a8b8-15d5252c5421 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.281625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.282248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.282660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.282908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.283685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.285738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.303165 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3681/7335] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:34:41.303670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.314778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2a2-bd94-462b-9863-95578edb5689 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.319694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.320520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.321468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.321931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.322670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.324452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed22bb8-8796-4145-bf1c-4cc3bcba4780 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.335422 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3655/7336] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:34:41.339795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.350729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927aa53-54d8-47fd-87b9-754da57b882c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.357105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.357372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.357617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.357901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] PATH_INFO: `/v3/projects/0011c2c8a8284f4fa504067e6ccacd7f/users/b9c9a2454f424212b2628de78d6847b6/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.374430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0011c2c8a8284f4fa504067e6ccacd7f, user_id=b9c9a2454f424212b2628de78d6847b6, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.377701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.415658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3682/7337] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:41 2022] PUT /identity/v3/projects/0011c2c8a8284f4fa504067e6ccacd7f/users/b9c9a2454f424212b2628de78d6847b6/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:41.421312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4e23-f53c-4605-87f6-31edce172912 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.421637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4e23-f53c-4605-87f6-31edce172912 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.421919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4e23-f53c-4605-87f6-31edce172912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.460849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9f5e4e23-f53c-4605-87f6-31edce172912 None None] MFA Rules not processed for user `b9c9a2454f424212b2628de78d6847b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:41.462764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9f5e4e23-f53c-4605-87f6-31edce172912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:41.571064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3656/7338] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:41.582505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:41.584508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:41.632404 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:41.691961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6878259-3bcf-43b5-baf0-7c0317830094 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:41.697433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:41.698236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:41.698575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:41.699278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:41.714095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:41.717298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:41.747277 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3683/7339] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:34:45.782985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:45.783456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:45.784036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:45.819621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:45.821804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:45.845073 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:45.980473 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3657/7340] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:46.001147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:46.003349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:46.118795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9be93-ad96-441d-b626-e689538b2cd0 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:46.127767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:46.128832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:46.129099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:46.129425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:46.139612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:46.141716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:46.165160 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3684/7341] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:46.277798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:46.280649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:46.385811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b98854-ffb0-4580-8b8f-36fe79fd1a7e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:46.395246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:46.395915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:46.396199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:46.396474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] PATH_INFO: `/v3/users/c10efff521ac401cb6b0cf0f7a0f8826` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:46.397775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10efff521ac401cb6b0cf0f7a0f8826)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:46.400516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:46.464812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10efff521ac401cb6b0cf0f7a0f8826'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.466182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10efff521ac401cb6b0cf0f7a0f8826'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.478759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10efff521ac401cb6b0cf0f7a0f8826'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.497160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10efff521ac401cb6b0cf0f7a0f8826'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.498410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a3e15413-de3d-48f7-bd25-b29c778f9c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10efff521ac401cb6b0cf0f7a0f8826'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.525334 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3658/7342] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:46 2022] DELETE /identity/v3/users/c10efff521ac401cb6b0cf0f7a0f8826 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:46.762390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:46.785554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608392ea-aab5-4ed8-b364-89580a815030 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:46.876644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:46.877306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:46.877623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:46.877898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] PATH_INFO: `/v3/projects/0ab8cb461554463fa9ed654c88096888` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:46.879367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab8cb461554463fa9ed654c88096888)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:46.881309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:46.936861 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:46.938593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab8cb461554463fa9ed654c88096888', 'request_id': 'req-82feaaba-7c33-461c-a313-2ce8e9902431'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.946856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab8cb461554463fa9ed654c88096888', 'request_id': 'req-82feaaba-7c33-461c-a313-2ce8e9902431'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.956177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab8cb461554463fa9ed654c88096888', 'request_id': 'req-82feaaba-7c33-461c-a313-2ce8e9902431'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.991171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] The token cache is being invalidate because project 0ab8cb461554463fa9ed654c88096888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:46.991473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.993994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82feaaba-7c33-461c-a313-2ce8e9902431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:46.999468 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3685/7343] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:46 2022] DELETE /identity/v3/projects/0ab8cb461554463fa9ed654c88096888 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:47.000971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.001469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.001581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.042814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:47.045972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:47.118009 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:47.153926 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3659/7344] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:47.165132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.165742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.165984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.238119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:47.239912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:47.268741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3686/7345] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:47.273269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.286529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf0ced-4ebc-4fb5-a5c0-9640187db0db None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.295369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.296336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.296791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.297248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.297965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:47.298272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.300072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.317145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3660/7346] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:47.321504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.336863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd3d9-8a71-4ef7-9110-70dd8ad33e45 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.342101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.342855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.343132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.343664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.344787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.347112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.388519 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3687/7347] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:47 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:47.393318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.405646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f697e4-80a9-485f-8eda-dde7436ad3f9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.474757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.475300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.475577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.475848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.476533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.478863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.502478 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3661/7348] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:47 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:47.506659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.518577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e87c-5e9e-475f-a6ca-ed0b742d4d1f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.523331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.524683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.525235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.525673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.526248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.528168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.539582 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3688/7349] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:47.543637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.561315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad6f8-0ef5-46a6-ab61-185b3cb5fa36 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.571628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.572257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.572539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.572849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.573535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.579092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788777b-87f8-44b9-9184-17093811f38b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.594961 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3662/7350] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:47.599060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.609376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0cd6-ec89-41b9-9533-222b89827442 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.614280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.615045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.615392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.615764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] PATH_INFO: `/v3/projects/68493330abad42a09d142b7edbad78f5/users/d9bd70e8cb7c471594ba2553edea1b75/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.632438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68493330abad42a09d142b7edbad78f5, user_id=d9bd70e8cb7c471594ba2553edea1b75, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.636032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.653742 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3689/7351] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:47 2022] PUT /identity/v3/projects/68493330abad42a09d142b7edbad78f5/users/d9bd70e8cb7c471594ba2553edea1b75/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:47.664764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.664764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.665207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.710396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] MFA Rules not processed for user `d9bd70e8cb7c471594ba2553edea1b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:47.712562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:47.792035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3663/7352] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:47.803498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:47.805552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:47.912828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7d7-cd2a-42b9-bb7f-eb6f73a8026d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:47.919672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:47.920569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:47.920996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:47.921287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:47.933465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:47.935099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb302ed-fc67-41d8-b0ca-1831e293b775 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:47.946675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3690/7353] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:48.186784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:48.257665 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:48.291787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7951a-f58d-429f-89a6-b42ae33db414 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:48.311514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:48.312185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:48.312471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:48.312752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] PATH_INFO: `/v3/users/d9bd70e8cb7c471594ba2553edea1b75` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:48.314730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bd70e8cb7c471594ba2553edea1b75)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:48.317796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:48.422983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bd70e8cb7c471594ba2553edea1b75'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:48.424350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bd70e8cb7c471594ba2553edea1b75'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:48.439039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bd70e8cb7c471594ba2553edea1b75'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:48.457481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bd70e8cb7c471594ba2553edea1b75'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:48.457481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bd70e8cb7c471594ba2553edea1b75'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:48.481438 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3664/7354] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:48 2022] DELETE /identity/v3/users/d9bd70e8cb7c471594ba2553edea1b75 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:48.484346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:48.484816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:48.485975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:48.522573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:48.524166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:48.583514 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:48.594744 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3691/7355] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:48.604974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:48.606497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:48.677094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca1c4-a6c8-429b-b3ad-7ce2c938be2a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:48.681606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:48.682258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:48.682541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:48.682828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:48.696606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:48.698121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c94fb2-367c-4964-89ab-866f4f03395b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:48.708642 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3665/7356] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:34:49.023737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.026270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:49.079547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b13d20-a7ea-4a29-8651-11f90a264914 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.082873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.083529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.083807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.084078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] PATH_INFO: `/v3/projects/68493330abad42a09d142b7edbad78f5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.085211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68493330abad42a09d142b7edbad78f5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.088156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.155191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68493330abad42a09d142b7edbad78f5', 'request_id': 'req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:49.162243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68493330abad42a09d142b7edbad78f5', 'request_id': 'req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:49.169603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68493330abad42a09d142b7edbad78f5', 'request_id': 'req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:49.185772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] The token cache is being invalidate because project 68493330abad42a09d142b7edbad78f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:49.186130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:49.186958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b0992f7b-dcba-4d4d-8ce1-30e5b69bb196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:49.189211 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3692/7357] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:49 2022] DELETE /identity/v3/projects/68493330abad42a09d142b7edbad78f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:49.193856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.194333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.194458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.218967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:49.220278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:49.306012 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3666/7358] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:49.307666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.307951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.308228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.330036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:49.333968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:49.343682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3693/7359] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:49.347900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.354287 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:49.360062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26004b0-f15a-4bf9-a66d-3634635db347 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.367291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.368533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.368996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.369551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.370340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:49.370925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.374867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.390298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3667/7360] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:49.394424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.407698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65872760-ec44-43d2-9119-639d5684e2ee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.412506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.413114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.413390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.413707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.415097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.417547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.473811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3694/7361] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:34:49.478204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.496985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77542-641e-416b-813b-99ec1b6c36a9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.568652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.569278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.569590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.569860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.571601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.573849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.601450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3668/7362] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:49.605965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.619263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03068-1154-42a4-9c74-4f406918631d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.624290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.625001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.625480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.625840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.626551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.628775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.644185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3695/7363] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:49.646915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.658650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9a4b-c76e-4f72-befc-6abf032994bd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.663717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.664627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.665225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.665614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.666673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.668282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ed449-c3bc-4b6e-adc3-b6251fe378b6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.685593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3669/7364] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:34:49.687552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:49.703044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ddce-2253-4a6d-a1ae-156883b04a26 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:49.711823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:49.712601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.712886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.713169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] PATH_INFO: `/v3/projects/9aca38f1677c410bb1fe6571d1ee1f1f/users/06655fb6877b41999c6ce3cd41a88d9c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.731501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aca38f1677c410bb1fe6571d1ee1f1f, user_id=06655fb6877b41999c6ce3cd41a88d9c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:49.734967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:49.754241 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3696/7365] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:49 2022] PUT /identity/v3/projects/9aca38f1677c410bb1fe6571d1ee1f1f/users/06655fb6877b41999c6ce3cd41a88d9c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:49.766614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:49.766913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:49.767302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:49.827237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] MFA Rules not processed for user `06655fb6877b41999c6ce3cd41a88d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:49.828478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:49.952009 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3670/7366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:49.956608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.027664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e96fc-b81c-48d7-bf27-b97ba58f867b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.032443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.033127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.033513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.033852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.034576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.036553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.073446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3697/7367] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:49 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:50.077474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.089585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8701-e82c-4382-b00b-0615e79d4836 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.153697 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:50.176373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.177663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.178237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.178677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.179480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.183025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.212064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3671/7368] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:50 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:50.215879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.224368 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:50.231709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f23a-d25c-4f9d-b16f-58b67d5e29cc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.241221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.242609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.243327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.243684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.244513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.246683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.262696 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3698/7369] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:50.267043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.278763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24e7ba-b113-478d-bd6f-bba07dd5c29a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.283624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.284278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.284565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.284834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] PATH_INFO: `/v3/projects/5f3ffc2115c34106b95fb24d72b218fc/users/4277e38f16c04209aaacf184e1836b08/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.301540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ffc2115c34106b95fb24d72b218fc, user_id=4277e38f16c04209aaacf184e1836b08, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.304213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.322270 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3672/7370] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:50 2022] PUT /identity/v3/projects/5f3ffc2115c34106b95fb24d72b218fc/users/4277e38f16c04209aaacf184e1836b08/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:34:50.326033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.338780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6048e-3340-449c-9660-94097ad5402b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.409611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.410327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.410696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.411042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.411872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.413696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a406510-0392-4353-a135-227807e1cb37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.429336 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3699/7371] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:50.431731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.442555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ace1-7007-40a1-94bb-2217ac684516 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.450058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.450724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.451003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.451278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] PATH_INFO: `/v3/projects/5f3ffc2115c34106b95fb24d72b218fc/users/4277e38f16c04209aaacf184e1836b08/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.453258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ffc2115c34106b95fb24d72b218fc, user_id=4277e38f16c04209aaacf184e1836b08, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.455909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.469440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3673/7372] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:50 2022] PUT /identity/v3/projects/5f3ffc2115c34106b95fb24d72b218fc/users/4277e38f16c04209aaacf184e1836b08/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:50.479145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.479734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.480088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.550690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] MFA Rules not processed for user `4277e38f16c04209aaacf184e1836b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:50.552693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:50.649991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3700/7373] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:50.665897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.683990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eaa99-6bba-41c3-9b87-340f6aabd561 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.691285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.691901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.692190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.692524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.693199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.695319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.718125 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3674/7374] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:34:50 2022] POST /identity/v3/domains => generated 245 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:50.718755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.729649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf878-03f3-464d-ba2e-9c5b4c0c2d83 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.797365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.798020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.798310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.798591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.799400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.801479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.827107 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:50.855081 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3701/7375] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:50 2022] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:34:50.859145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.870654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1faca7-10cc-4453-a676-967755211add tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.942682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.943547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.944030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:50.944310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:50.944968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:50.947069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:50.977440 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3675/7376] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:50 2022] POST /identity/v3/users => generated 347 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:34:50.979791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:50.992081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52251ae0-c26c-4e24-a4cd-0967a34bb36b tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:50.998514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:50.999531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:50.999978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.000252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.001162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.002811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97ccc3-9b38-4629-beec-92f9707198d1 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.015340 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3702/7377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:34:51.019558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.032251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2006-9b9d-4f5e-9b1a-482cca240f0f tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:51.037530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:51.038218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.038492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.038804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/projects/d0e57fd0c9d9482e86c445f79dc82f07/users/97e855bba8ab493b89b7f2540a381e84/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.057330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d0e57fd0c9d9482e86c445f79dc82f07, user_id=97e855bba8ab493b89b7f2540a381e84, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.060078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d19fa2-7821-4861-a652-7d60474e1c77 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.075808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3676/7378] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:51 2022] PUT /identity/v3/projects/d0e57fd0c9d9482e86c445f79dc82f07/users/97e855bba8ab493b89b7f2540a381e84/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:34:51.080176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.080467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.080743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.217249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] MFA Rules not processed for user `97e855bba8ab493b89b7f2540a381e84`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:51.218701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:51.246190 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3703/7379] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:51.256831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.257464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.257464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.287206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] MFA Rules not processed for user `97e855bba8ab493b89b7f2540a381e84`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:51.289534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:51.303141 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3677/7380] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:51.304786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.317432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ecaf-a95d-40a0-9250-9a6f25b00049 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:51.323471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e855bba8ab493b89b7f2540a381e84', 'user_domain_id': '0cec9a728e284f698ddfb06a523174a5', 'system_scope': None, 'project_id': 'd0e57fd0c9d9482e86c445f79dc82f07', 'project_domain_id': '0cec9a728e284f698ddfb06a523174a5', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:51.324324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.324613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.324889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.334550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.338614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.354065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3704/7381] 10.222.0.16 () {56 vars in 1284 bytes} [Sun Sep 25 01:34:51 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:51.355410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.432030 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:51.439340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e2dd7-28fa-4729-8c69-a9ff593220f8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:51.446295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:51.447188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.447494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.447757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/users/97e855bba8ab493b89b7f2540a381e84` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.448940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:delete_user(user_id=97e855bba8ab493b89b7f2540a381e84)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.450927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.505663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e855bba8ab493b89b7f2540a381e84'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.506376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e855bba8ab493b89b7f2540a381e84'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.515590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e855bba8ab493b89b7f2540a381e84'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.530148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e855bba8ab493b89b7f2540a381e84'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.531411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e855bba8ab493b89b7f2540a381e84'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.551759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3678/7382] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:51 2022] DELETE /identity/v3/users/97e855bba8ab493b89b7f2540a381e84 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:51.557446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.568640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92df04-4892-4410-858b-6f5228c35ab1 tempest-test_project-775352898 tempest-user-941059309] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:51.635697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:51.636347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.636636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.636910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/projects/d0e57fd0c9d9482e86c445f79dc82f07` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.638295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0e57fd0c9d9482e86c445f79dc82f07)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.640454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.689767 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:51.710881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e57fd0c9d9482e86c445f79dc82f07', 'request_id': 'req-680541a1-3b74-42c2-8ae0-c7f01f9e0959'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.720038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e57fd0c9d9482e86c445f79dc82f07', 'request_id': 'req-680541a1-3b74-42c2-8ae0-c7f01f9e0959'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.728441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e57fd0c9d9482e86c445f79dc82f07', 'request_id': 'req-680541a1-3b74-42c2-8ae0-c7f01f9e0959'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.746472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] The token cache is being invalidate because project d0e57fd0c9d9482e86c445f79dc82f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:51.746800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.747408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.749023 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3705/7383] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:51 2022] DELETE /identity/v3/projects/d0e57fd0c9d9482e86c445f79dc82f07 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:51.753435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.754997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:51.770775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140b1b5-a61b-4197-9c8d-3a8733e4a9b7 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:51.873495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:51.874709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:51.875205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:51.877427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/domains/0cec9a728e284f698ddfb06a523174a5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:51.881302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0cec9a728e284f698ddfb06a523174a5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:51.884158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:51.912941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.915836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.953118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.953828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:51.959768 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3679/7384] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:34:51 2022] PATCH /identity/v3/domains/0cec9a728e284f698ddfb06a523174a5 => generated 246 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:34:51.961733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:51.963269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:51.985439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680541a1-3b74-42c2-8ae0-c7f01f9e0959 tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:52.091616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4277e38f16c04209aaacf184e1836b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3ffc2115c34106b95fb24d72b218fc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:52.092272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:52.092554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:52.092833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] PATH_INFO: `/v3/domains/0cec9a728e284f698ddfb06a523174a5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:52.132969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0cec9a728e284f698ddfb06a523174a5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:52.134798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:52.190960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.196025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0cec9a728e284f698ddfb06a523174a5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.316917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.324189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.331136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.354285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] The token cache is being invalidate because project 0cec9a728e284f698ddfb06a523174a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:52.354613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.355279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.363908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.367345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.368044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a861597a-e704-44a2-9d0f-5c83aaddb30c tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0cec9a728e284f698ddfb06a523174a5', 'request_id': 'req-a861597a-e704-44a2-9d0f-5c83aaddb30c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.378287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3706/7385] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:34:51 2022] DELETE /identity/v3/domains/0cec9a728e284f698ddfb06a523174a5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:52.386987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:52.392488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:52.464027 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:52.492312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc8a5-f22c-4255-b3a6-b1e487dcdbbb tempest-TestDefaultProjectId-1098139117 tempest-TestDefaultProjectId-1098139117-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:52.560380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:52.561708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:52.562251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:52.562648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] PATH_INFO: `/v3/users/06655fb6877b41999c6ce3cd41a88d9c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:52.563915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06655fb6877b41999c6ce3cd41a88d9c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:52.566156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:52.623082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06655fb6877b41999c6ce3cd41a88d9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.624054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06655fb6877b41999c6ce3cd41a88d9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.632044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06655fb6877b41999c6ce3cd41a88d9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.647798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06655fb6877b41999c6ce3cd41a88d9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.648875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06655fb6877b41999c6ce3cd41a88d9c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:52.665067 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3680/7386] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:52 2022] DELETE /identity/v3/users/06655fb6877b41999c6ce3cd41a88d9c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:52.669654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:52.669943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:52.670222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:52.677436 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:52.692440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:52.694374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:52.761447 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3707/7387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:52.770547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:52.772063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:52.839957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f662ec-2587-4656-8ce0-6fe1f2e1a197 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:52.843667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:52.844380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:52.844723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:52.845059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:52.855495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:52.857296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:52.869854 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3681/7388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:53.226032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:53.233287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:53.258496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ab4d-cea1-420d-839d-cf2016d1e314 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:53.277637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:53.278331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:53.278612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:53.278891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] PATH_INFO: `/v3/projects/9aca38f1677c410bb1fe6571d1ee1f1f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:53.287040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aca38f1677c410bb1fe6571d1ee1f1f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:53.289395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:53.365950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aca38f1677c410bb1fe6571d1ee1f1f', 'request_id': 'req-c1ed4636-c4e3-4f78-962c-1609924af47b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.379040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aca38f1677c410bb1fe6571d1ee1f1f', 'request_id': 'req-c1ed4636-c4e3-4f78-962c-1609924af47b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.389146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aca38f1677c410bb1fe6571d1ee1f1f', 'request_id': 'req-c1ed4636-c4e3-4f78-962c-1609924af47b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.412531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] The token cache is being invalidate because project 9aca38f1677c410bb1fe6571d1ee1f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:53.412868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.414341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.416064 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3708/7389] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:53 2022] DELETE /identity/v3/projects/9aca38f1677c410bb1fe6571d1ee1f1f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:53.419781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:53.431357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727fab-4d52-408e-84d5-f2b05fc927ab service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:53.436431 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:53.505441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:53.505441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:53.505441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:53.505441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] PATH_INFO: `/v3/users/4277e38f16c04209aaacf184e1836b08` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:53.506621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4277e38f16c04209aaacf184e1836b08)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:53.509298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:53.584885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4277e38f16c04209aaacf184e1836b08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.586879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4277e38f16c04209aaacf184e1836b08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.600023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4277e38f16c04209aaacf184e1836b08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.622423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4277e38f16c04209aaacf184e1836b08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.623236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d0671bf3-386b-4885-8b50-abc0d0dc9cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4277e38f16c04209aaacf184e1836b08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:53.646758 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3682/7390] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:53 2022] DELETE /identity/v3/users/4277e38f16c04209aaacf184e1836b08 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:53.995061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:53.996553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:54.016405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4636-c4e3-4f78-962c-1609924af47b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.110905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.111567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.113297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.113297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] PATH_INFO: `/v3/projects/5f3ffc2115c34106b95fb24d72b218fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.114554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3ffc2115c34106b95fb24d72b218fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.116633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.193979 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:54.220255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3ffc2115c34106b95fb24d72b218fc', 'request_id': 'req-a9c55106-6360-4e63-8b35-221a9a1b2ec1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:54.230646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3ffc2115c34106b95fb24d72b218fc', 'request_id': 'req-a9c55106-6360-4e63-8b35-221a9a1b2ec1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:54.249220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3ffc2115c34106b95fb24d72b218fc', 'request_id': 'req-a9c55106-6360-4e63-8b35-221a9a1b2ec1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:54.266897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] The token cache is being invalidate because project 5f3ffc2115c34106b95fb24d72b218fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:54.267195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:54.268108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a9c55106-6360-4e63-8b35-221a9a1b2ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:54.269871 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3709/7391] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:53 2022] DELETE /identity/v3/projects/5f3ffc2115c34106b95fb24d72b218fc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:54.276180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.276815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.277096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.301320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:54.302600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:54.371511 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3683/7392] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:54.462392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.462977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.463443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.503145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:54.504389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:54.513733 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3710/7393] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:54.518499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.530528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587f28-efee-49fc-93b3-a2d675397d00 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.536026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.536639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.537029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.537307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.538010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:54.538313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.540547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.564709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.575304 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3684/7394] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:54.577915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f1771-1ae8-4a88-a5db-517848d85b76 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.583328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.584019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.584219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.584494 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.585140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.591287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.641463 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3711/7395] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:54 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:54.645054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.661339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af9b9-ae69-4283-9c85-8d7c10e8e5ac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.678953 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:54.735229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.736213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.737167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.737562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.738401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.740374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.768300 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3685/7396] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:54 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:54.772525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.788694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d919b16-6d79-43de-9675-d1cd2ee2eee8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.793949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.794631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.795117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.795462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.796184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.797947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.814031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3712/7397] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:54.815910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.831742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5677c-692c-462e-897c-9e511cc828a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.839428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.840443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.840892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.841538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.843430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.845384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c8bff-7f5e-4b72-a780-7e59b57fd4be admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.861446 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3686/7398] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:54.862633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:54.877904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c833a7-bf57-4755-b572-8cf262c0dc42 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:54.883575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:54.884478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.884878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.885254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] PATH_INFO: `/v3/projects/202220077e1641c2964dc752c730440f/users/0b7c65e6ad6347e7b1bcb75d4d996301/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.904074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202220077e1641c2964dc752c730440f, user_id=0b7c65e6ad6347e7b1bcb75d4d996301, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:54.907529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:54.923868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3713/7399] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:54 2022] PUT /identity/v3/projects/202220077e1641c2964dc752c730440f/users/0b7c65e6ad6347e7b1bcb75d4d996301/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:54.935206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:54.935495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:54.935769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:54.970750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] MFA Rules not processed for user `0b7c65e6ad6347e7b1bcb75d4d996301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:54.971993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.052861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3687/7400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:55.058568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.071431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aa6fd-4824-4214-97fe-665b59478b92 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:55.076030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b7c65e6ad6347e7b1bcb75d4d996301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '202220077e1641c2964dc752c730440f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:55.076756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.077236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.077771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.079943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:55.083299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6986-41ee-4da9-ad8f-daea010f1980 tempest-DefaultDomainTestJSON-766066874 tempest-DefaultDomainTestJSON-766066874-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:55.087353 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3714/7401] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:34:55.091716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.171362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835537b-f04f-4fe2-954c-fdcd37389a00 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:55.176986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:55.177675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.177959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.178233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] PATH_INFO: `/v3/users/0b7c65e6ad6347e7b1bcb75d4d996301` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.180361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7c65e6ad6347e7b1bcb75d4d996301)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:55.182362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:55.223169 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:55.251690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7c65e6ad6347e7b1bcb75d4d996301'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.252601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7c65e6ad6347e7b1bcb75d4d996301'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.260883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7c65e6ad6347e7b1bcb75d4d996301'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.275138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7c65e6ad6347e7b1bcb75d4d996301'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.275891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7c65e6ad6347e7b1bcb75d4d996301'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.297485 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3688/7402] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:55 2022] DELETE /identity/v3/users/0b7c65e6ad6347e7b1bcb75d4d996301 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:55.301269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.302628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.302996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.329310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:55.330638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.417536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3715/7403] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:55.423407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.424999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.498067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d237f1-62a9-4fe9-a138-6226c85a266a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:55.504037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:55.504897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.505520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.506101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.535272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:55.538210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71cc81-e2b0-47f4-9c87-23651b1551cd service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:55.590697 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3689/7404] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:55.682509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.684852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.702402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213cda0-ca75-410a-9d79-af779c5421aa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:55.708301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:55.709673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.710371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.711788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] PATH_INFO: `/v3/users/a5ee3a1275ac406bb0f8fbda96d3ad4b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.719715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ee3a1275ac406bb0f8fbda96d3ad4b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:55.722000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:55.802064 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:55.807580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ee3a1275ac406bb0f8fbda96d3ad4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.819540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ee3a1275ac406bb0f8fbda96d3ad4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.837263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ee3a1275ac406bb0f8fbda96d3ad4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.838739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ee3a1275ac406bb0f8fbda96d3ad4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.839621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ee3a1275ac406bb0f8fbda96d3ad4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:55.862175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3716/7405] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:34:55 2022] DELETE /identity/v3/users/a5ee3a1275ac406bb0f8fbda96d3ad4b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:55.864425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:55.865114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:55.865625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:55.890612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:55.892080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.968486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3690/7406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:55.972509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.978537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:55.986274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:55.988532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.011444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dcf5-4cc1-4455-a26f-1b4e940e1de3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.018236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.018888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.019190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.019997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] PATH_INFO: `/v3/projects/202220077e1641c2964dc752c730440f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.021697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=202220077e1641c2964dc752c730440f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.023684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.069717 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:56.082110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8b601-a1e5-41cb-b18a-059c97b7827a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.092675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202220077e1641c2964dc752c730440f', 'request_id': 'req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.105839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202220077e1641c2964dc752c730440f', 'request_id': 'req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.112964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202220077e1641c2964dc752c730440f', 'request_id': 'req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.129262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] The token cache is being invalidate because project 202220077e1641c2964dc752c730440f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:56.129867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.130697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4b8bb17c-f2ac-4f90-9093-2eb365211e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.133497 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3717/7407] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:55 2022] DELETE /identity/v3/projects/202220077e1641c2964dc752c730440f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:34:56.142134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ca5a-ccc6-47f7-9f3a-09c88e8aeb15 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.142778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ca5a-ccc6-47f7-9f3a-09c88e8aeb15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.143510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ca5a-ccc6-47f7-9f3a-09c88e8aeb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.151328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.152029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.152643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.153039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.154976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.167538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f713ca5a-ccc6-47f7-9f3a-09c88e8aeb15 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:56.169281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f713ca5a-ccc6-47f7-9f3a-09c88e8aeb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.243551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3718/7408] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:56.243774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.245330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.250740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.251466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.252063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.260323 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3691/7409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:56.309917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:56.309917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.319001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3719/7410] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:56.323439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.333604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dfa7d-e7a7-4296-ba4f-3633aa94e1f6 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.346236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.347236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.347573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.347818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.348921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:56.349488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.351905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.374001 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3692/7411] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:56.375209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.387749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164af2d-b926-4103-9a84-303135fa1638 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.394376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.395122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.395520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.395880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.397295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.399726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.447055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3720/7412] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/projects => generated 359 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:56.450986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.463448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa956-8bec-406b-8adf-0643917ff5b5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.572623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.573369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.574100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.574100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.574770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.577020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.616375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3693/7413] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:56.618053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.632689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3a68-260a-4145-9fd2-9d193287a5e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.637974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.640286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.660583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0f917-3964-43f4-9c3e-e704e8c975fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.666853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.667830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.668373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.668885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] PATH_INFO: `/v3/projects/143d98d4d3984729b03022104174e152` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.670306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143d98d4d3984729b03022104174e152)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.670485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.671121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.671985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.673048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.680299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.681266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.683442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.699826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3721/7414] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:56.701441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.706589 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:56.717764 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:56.724874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c777-4d72-4874-bd5b-878f1528539d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.734435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.735695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.737887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.738474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.739384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.741168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.761137 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3722/7415] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:56.762725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:56.769358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143d98d4d3984729b03022104174e152', 'request_id': 'req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.778280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143d98d4d3984729b03022104174e152', 'request_id': 'req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.778796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fdbe6-8682-4c8f-8000-c49abd1c767f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:56.785062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143d98d4d3984729b03022104174e152', 'request_id': 'req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.803215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] The token cache is being invalidate because project 143d98d4d3984729b03022104174e152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:34:56.803552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.804267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2ed6d171-f59d-489e-a3b1-bf2f22aecba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:34:56.809858 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3694/7416] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:34:56 2022] DELETE /identity/v3/projects/143d98d4d3984729b03022104174e152 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:56.811318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f88fb-8d40-434a-9c44-6f89739f9471 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.811610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f88fb-8d40-434a-9c44-6f89739f9471 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.811887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f88fb-8d40-434a-9c44-6f89739f9471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.831928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-242f88fb-8d40-434a-9c44-6f89739f9471 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:56.833318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-242f88fb-8d40-434a-9c44-6f89739f9471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.859733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:56.861221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.861717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.862274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] PATH_INFO: `/v3/projects/ebc395f4dead482fb8a04a0a81dfb675/users/646079702a0247898508f7ac5226e49e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.889635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc395f4dead482fb8a04a0a81dfb675, user_id=646079702a0247898508f7ac5226e49e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:56.893107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb520-2906-4938-9134-d72d0f960826 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:56.908709 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3695/7417] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:56.914824 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3723/7418] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:56 2022] PUT /identity/v3/projects/ebc395f4dead482fb8a04a0a81dfb675/users/646079702a0247898508f7ac5226e49e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:56.925621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.925621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.925621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.927527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:56.928059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:56.928347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:56.950323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:56.951828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:56.965001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] MFA Rules not processed for user `646079702a0247898508f7ac5226e49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:56.966566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:57.036223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3696/7419] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:34:57.037380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.057980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ab6ea-2d34-4258-a977-c31b68520f41 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.062414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3724/7420] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:57.069489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.071376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:57.087219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.087905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.088190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.088467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.089331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:34:57.091140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.092864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.112051 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3697/7421] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:34:57.113771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.128613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42197-1941-424a-8160-be3a75311f53 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.136208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.142306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.142623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.142894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.143999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.147252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.169994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35429e7-04ec-4d9d-89db-999c3b46c34c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.176615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.178293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.178585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.179036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.190788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.192548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.208600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3698/7422] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:34:57 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:57.213555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.227571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3725/7423] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:34:57.240196 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:57.300485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9795419-3b41-4feb-9ed4-e40e57c7ed3e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.307343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.308057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.308408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.309265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.310008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.312793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.346933 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3699/7424] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:34:57 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:34:57.348502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.383931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049a32-1b51-497b-b4d8-f475c71788b7 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.403768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.404890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.409568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.410308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.411528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.416295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.420513 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:57.442958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3726/7425] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:34:57.444244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.474863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7dbf7-832c-4478-9cfd-5bddf4ef0dee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.482388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.483482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.483779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.484063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.484734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.486932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02700fa9-be02-451a-bb42-d9e2b63dcf64 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.502039 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3700/7426] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:34:57.504292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.532285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ef871-5a0a-4abd-966d-925f46710c74 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.538641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.540082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.540462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.540830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] PATH_INFO: `/v3/projects/f30e22bd09f0489aa2809fbc896d7fed/users/30987f89d5824bbeaf313b0452527b20/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.559646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30e22bd09f0489aa2809fbc896d7fed, user_id=30987f89d5824bbeaf313b0452527b20, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.562667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.583755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3727/7427] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:34:57 2022] PUT /identity/v3/projects/f30e22bd09f0489aa2809fbc896d7fed/users/30987f89d5824bbeaf313b0452527b20/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:34:57.589348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.589874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.589990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.611229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:34:57.612469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:57.688065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3701/7428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:34:57.694575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:34:57.697474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:34:57.821815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5712-09d7-439b-9ce6-f540ef7d85cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:34:57.826275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:34:57.826992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:34:57.827342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:34:57.827689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:34:57.839697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:34:57.841923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636bba0-85eb-453a-a435-835e6ee6a466 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:34:57.856072 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3728/7429] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:03.286986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:03.288519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:03.652774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6a5-1167-40f6-ab87-cd3668671b28 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:03.667952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:03.670631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:03.671126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:03.673701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:03.678823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:03.720939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:03.724819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:03.767079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3702/7430] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:06.353036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:06.353652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:06.353652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:06.452846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] MFA Rules not processed for user `30987f89d5824bbeaf313b0452527b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:06.455507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:06.618526 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3729/7431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:07.576604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:07.599003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d06554-9f44-4b9c-9423-e0b2757260f4 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:07.606750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:07.608140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:07.608589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:07.609022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:07.611077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:07.627391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:07.629308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005f86-019d-4bb0-b813-ba55c04d7f66 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:07.666378 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3703/7432] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:10.558103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:10.559486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:10.602693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa17f6-4d04-4e23-abe7-1346c82e95b1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:10.610439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:10.611487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:10.611937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:10.612331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] PATH_INFO: `/v3/users/b9c9a2454f424212b2628de78d6847b6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:10.614551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c9a2454f424212b2628de78d6847b6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:10.616672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:10.737138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c9a2454f424212b2628de78d6847b6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:10.755161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c9a2454f424212b2628de78d6847b6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:10.767910 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:10.797631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c9a2454f424212b2628de78d6847b6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:10.798401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c9a2454f424212b2628de78d6847b6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:10.800262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c9a2454f424212b2628de78d6847b6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:10.838585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:10.839177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:10.839177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:10.842336 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3730/7433] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:10 2022] DELETE /identity/v3/users/b9c9a2454f424212b2628de78d6847b6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:10.869830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:10.871065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:10.895259 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:10.971135 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3704/7434] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:10.991132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:10.993254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:11.138358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0afe-41ae-47bb-9631-789e42f9779c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:11.145941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:11.146992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:11.147853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:11.148398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:11.164818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:11.166786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a01737-52e4-43cc-90ea-ee1d975baa4a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:11.197396 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3731/7435] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:12.149322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:12.151475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:12.179799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b777bc-085d-4274-a46c-f5a982332b08 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:12.220097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:12.220766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.221102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.222819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] PATH_INFO: `/v3/projects/0011c2c8a8284f4fa504067e6ccacd7f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.227135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0011c2c8a8284f4fa504067e6ccacd7f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:12.229664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:12.344591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0011c2c8a8284f4fa504067e6ccacd7f', 'request_id': 'req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.359286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0011c2c8a8284f4fa504067e6ccacd7f', 'request_id': 'req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.371531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0011c2c8a8284f4fa504067e6ccacd7f', 'request_id': 'req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.400706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] The token cache is being invalidate because project 0011c2c8a8284f4fa504067e6ccacd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:12.401222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.402229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cb537c2b-0e41-4c5e-b53e-bb89f1a12076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.405021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3705/7436] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:12 2022] DELETE /identity/v3/projects/0011c2c8a8284f4fa504067e6ccacd7f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:12.410596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.411113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.411235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.462605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:12.463877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:12.611030 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3732/7437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:12.616971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.617272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.617594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.655918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:12.657141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:12.678750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3706/7438] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:12.680565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:12.699080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd304ff-78f8-42de-b356-73e2b243e814 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:12.731297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:12.731470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:12.732249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.732720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:12.733133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.734653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.735545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:12.736979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:12.744399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:12.755206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4616b-65ac-49ee-bcd8-5f158e6f174e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:12.764973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:12.766072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.766554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.767152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] PATH_INFO: `/v3/users/30987f89d5824bbeaf313b0452527b20` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.769827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30987f89d5824bbeaf313b0452527b20)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:12.771996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:12.800753 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3733/7439] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:12.801609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:12.827350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2557d-ff2d-4ee6-9685-5612db0a4989 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:12.837184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:12.838113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:12.838843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:12.839318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:12.844915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:12.847800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:12.900481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30987f89d5824bbeaf313b0452527b20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.907252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30987f89d5824bbeaf313b0452527b20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.940840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3734/7440] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:12 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:12.942010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:12.943330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30987f89d5824bbeaf313b0452527b20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.943994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:12.971633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30987f89d5824bbeaf313b0452527b20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:12.973384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30987f89d5824bbeaf313b0452527b20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.000939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3707/7441] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:12 2022] DELETE /identity/v3/users/30987f89d5824bbeaf313b0452527b20 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:13.029719 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:13.063919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c6fc-5de7-459e-a37a-2592075e7d99 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.154581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.155333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.155621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.155894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.156676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.158661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.188555 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3735/7442] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:12 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:13.189230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.195711 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:13.203795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db004c7-48e3-4ebc-8120-b431d7989d11 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.218987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.219705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.219993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.220306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.221377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.223477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.238484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.242361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3708/7443] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:13.245633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:13.246334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.259121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcb25-0032-4d12-8d9c-d8d0d25240a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.266691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.269040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.269703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.270375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.271278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.275264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.276265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92f94-012d-44a4-b207-e37e8e7b50e0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.287943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.288719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.289076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.289256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] PATH_INFO: `/v3/projects/f30e22bd09f0489aa2809fbc896d7fed` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.290544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30e22bd09f0489aa2809fbc896d7fed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.292450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.295491 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3709/7444] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:13.299656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.334217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb5eb-138b-40eb-af26-7a9c96c62470 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.345514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.346189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.346468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.347369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] PATH_INFO: `/v3/projects/aa1c5e38a7984066a6768784a7385706/users/2675ae84e5834c04b3a592134cf937b4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.378907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30e22bd09f0489aa2809fbc896d7fed', 'request_id': 'req-6ebab628-3612-4920-b40d-6267032f2f6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.389796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1c5e38a7984066a6768784a7385706, user_id=2675ae84e5834c04b3a592134cf937b4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.393169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30e22bd09f0489aa2809fbc896d7fed', 'request_id': 'req-6ebab628-3612-4920-b40d-6267032f2f6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.394614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6608c4-b55f-492a-a808-1a875817ecf5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.404245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30e22bd09f0489aa2809fbc896d7fed', 'request_id': 'req-6ebab628-3612-4920-b40d-6267032f2f6e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.423875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] The token cache is being invalidate because project f30e22bd09f0489aa2809fbc896d7fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:13.424386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.424607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3710/7445] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:13 2022] PUT /identity/v3/projects/aa1c5e38a7984066a6768784a7385706/users/2675ae84e5834c04b3a592134cf937b4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:13.432435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ebab628-3612-4920-b40d-6267032f2f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:13.434883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.435172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.435448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.438353 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3736/7446] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:13 2022] DELETE /identity/v3/projects/f30e22bd09f0489aa2809fbc896d7fed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:13.444121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deca36-933a-4f01-a629-36f61c5630e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.445102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deca36-933a-4f01-a629-36f61c5630e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.446056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deca36-933a-4f01-a629-36f61c5630e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.472431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-43deca36-933a-4f01-a629-36f61c5630e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:13.472704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] MFA Rules not processed for user `2675ae84e5834c04b3a592134cf937b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:13.474101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43deca36-933a-4f01-a629-36f61c5630e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:13.474260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:13.557246 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3737/7447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:13.565513 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3711/7448] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:13.567476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.569247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:13.570090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.570522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.570941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.587930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eced6f5-9912-412e-b2dd-714f3ae7bcde None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.590939 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:13.599599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.601488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.603713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.604000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.604690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.606482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:13.606697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.607708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:13.619771 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3738/7449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:13.623882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.635747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc2a2-85df-427f-b3ed-3f17fc3e0dd6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.644935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3712/7450] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:13.645978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.646126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.648777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.649082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.649358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.650910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:13.651214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.653202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.668319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3739/7451] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:13.672477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.684986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f97ca-4f59-4f8f-be42-a3dde712b784 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.742143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70912b-90d8-42d0-afc5-2aeae8b16a7b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.748475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.749388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.750441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.751190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.752172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.754772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.768458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.769809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.771439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.771801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.774042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.776668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.792958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3713/7452] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:13.795950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.811096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53e87-43aa-419c-9ba4-45dfdd6560d7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.819662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.820591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.821009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.821440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.821980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3740/7453] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:13.822457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.824281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.825840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.846951 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3714/7454] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:13.854412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.863330 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:13.880163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75310-72dd-4e1c-a8ed-ab2eeb3f3a83 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.954648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:13.956096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:13.956544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:13.956992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:13.957826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:13.959684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:13.975628 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3715/7455] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:13.979336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:13.992424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf3e8-5f1a-4ae8-8342-ab38e042cb87 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:13.998090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1346b-a4ba-47ec-b486-ac9ed44d7e37 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.006576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.008707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.009010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.009288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] PATH_INFO: `/v3/projects/2c4f153171d842c3ab498ab1a51e2e90/users/a06de78be33b40f499d64b228ccca8c7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.014712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.015784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.016168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.017273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.019639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.023969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.028922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4f153171d842c3ab498ab1a51e2e90, user_id=a06de78be33b40f499d64b228ccca8c7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.037422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0428-49d9-40da-890e-748ba0a46e29 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.069048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3716/7456] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:13 2022] PUT /identity/v3/projects/2c4f153171d842c3ab498ab1a51e2e90/users/a06de78be33b40f499d64b228ccca8c7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:14.071270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.071270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.071864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.076015 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3741/7457] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:13 2022] POST /identity/v3/users => generated 282 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:14.077550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.100534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3f9e-8e73-4be8-a277-30d6375e750e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.111491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] MFA Rules not processed for user `a06de78be33b40f499d64b228ccca8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:14.112727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:14.204486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3717/7458] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:14.209882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.219855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.220488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.220774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.221051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.221734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.223500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.229023 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:14.247110 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3742/7459] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:14.251159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.262304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532592-e39c-44e9-bc6c-216cad7613d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.267501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.268134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.268397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.268678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.269318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.271234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.283872 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3743/7460] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:14.291424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.309391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28bc-d640-41c9-a84d-2b18adecc8a4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.325242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.325985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.326578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.327253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800/users/028c263d522245a88ee3137154ada628/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.335278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71710de-dda8-41f7-81ab-df9e51d48c85 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.341591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.342829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.343184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.343569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.344462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.346896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.351809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2020d598af4c4da6a7013733d7f4b800, user_id=028c263d522245a88ee3137154ada628, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.356596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8374114-0044-4401-85f6-805ec9a4d35b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.360301 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:14.375532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3744/7461] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:14 2022] PUT /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800/users/028c263d522245a88ee3137154ada628/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:14.388226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.388516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.388797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.406016 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3718/7462] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:14 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:14.409617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.431417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] MFA Rules not processed for user `028c263d522245a88ee3137154ada628`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:14.433489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:14.491055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7127f-a05d-4236-98cb-a81c5879b7ca admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.497436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.498337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.498948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.499417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.500285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.502605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.541529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3745/7463] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:14.549598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3719/7464] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:14 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:14.553169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.556951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.560930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:14.568351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcb906-8633-4318-8569-ae68f412e325 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.575725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.577952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.578546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.578982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.581057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.583890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.598830 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3746/7465] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:14.603605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.624676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd488c7-aee8-4703-8e77-6d28590557b4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.635549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.636239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.636522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.636798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] PATH_INFO: `/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66/users/ca420a914e03412cb88bb3f170517286/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.670258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd2dd2ccea4c229cab8be0458e4e66, user_id=ca420a914e03412cb88bb3f170517286, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.675673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.716212 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3747/7466] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:14 2022] PUT /identity/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66/users/ca420a914e03412cb88bb3f170517286/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:14.717785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.747394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb95b8-1b25-489a-afa1-f91126b11b3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.858573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a7a1-fcd1-485a-9e6d-e18ae90cf335 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.865010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.865676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.866004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.866280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.867822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.869567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.881458 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3748/7467] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:14.885557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:14.914965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.915679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d598-7f50-4483-9acc-c2b075b845c1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:14.916874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.917244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.917692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.933305 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:14.942705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:14.943400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.945897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.946125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] PATH_INFO: `/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66/users/ca420a914e03412cb88bb3f170517286/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:14.948366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd2dd2ccea4c229cab8be0458e4e66, user_id=ca420a914e03412cb88bb3f170517286, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:14.951710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91563-e018-4437-a501-4cd07b204cef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:14.958863 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:14.966460 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3749/7468] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:14 2022] PUT /identity/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66/users/ca420a914e03412cb88bb3f170517286/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:14.981135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:14.981576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:14.981985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.016310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.019101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680efb8-8b1c-409a-9980-9e42f78fe1f1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.020472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] MFA Rules not processed for user `ca420a914e03412cb88bb3f170517286`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:15.021919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:15.032342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3720/7469] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:15.046589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.047001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.047438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.052587 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3721/7470] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:35:15.055251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:35:15.126365 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3750/7471] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:15.139109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.140565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:15.164104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.243027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884df0-b2fd-4f6b-b65e-900c2045289f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.249286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028c263d522245a88ee3137154ada628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2020d598af4c4da6a7013733d7f4b800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.250052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.250406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.250745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.252236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorizing `identity:get_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.258572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2a3bd-34a8-4c31-8b64-c596d312ff06 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.260964 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3722/7472] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 363 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:15.262975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab22c-3783-4937-bbd4-6733a8580ec1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.267909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.268614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.268896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.269170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.312807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.312807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.312807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.313895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3723/7473] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:35:15.322276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:35:15.325171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:15.373821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.375596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec6f9-dd4f-4f3e-9d1d-66aadd9cddbf service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.376005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.387460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5656b-66b1-44b1-a806-26f195d7f884 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.391745 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3751/7474] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:15.398600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028c263d522245a88ee3137154ada628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2020d598af4c4da6a7013733d7f4b800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.399254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.399536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.399813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.401103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorizing `identity:get_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.403421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.406037 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3724/7475] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 363 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:15.468458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457c0a-521c-4466-a26c-e1126801c0db None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.468975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457c0a-521c-4466-a26c-e1126801c0db None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.469101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457c0a-521c-4466-a26c-e1126801c0db None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.471844 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3752/7476] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:35:15.485798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:35:15.514486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.535033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a0b-b86f-44f6-854b-0bb12503ec68 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.546262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028c263d522245a88ee3137154ada628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2020d598af4c4da6a7013733d7f4b800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.549891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.549891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.549891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.554734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorizing `identity:get_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.557073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.559205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3725/7477] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 363 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:15.601894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8040-9b78-46d5-8b74-98d9b0009b7f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.602272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8040-9b78-46d5-8b74-98d9b0009b7f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.602502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8040-9b78-46d5-8b74-98d9b0009b7f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.604033 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3753/7478] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:35:15.611983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:35:15.640958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.656530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861854d1-3cb8-47ef-952c-e50ceea26630 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.668352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028c263d522245a88ee3137154ada628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2020d598af4c4da6a7013733d7f4b800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.669001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.669285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.669582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.672243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorizing `identity:get_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.674102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.678103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3726/7479] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 363 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:15.740878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a7e2-3385-43c6-aa4a-34755efaacc1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.741167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a7e2-3385-43c6-aa4a-34755efaacc1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.742060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a7e2-3385-43c6-aa4a-34755efaacc1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.744065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3754/7480] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:35:15.749832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:35:15.779704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.807668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820eecf-70b4-4979-93be-8fab3d684313 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:15.807668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028c263d522245a88ee3137154ada628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2020d598af4c4da6a7013733d7f4b800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:15.807668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:15.808976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:15.808976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:15.810864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorizing `identity:get_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:15.812949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843e60-061a-4866-a3f2-20ac68150736 tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:15.814783 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3727/7481] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:35:15 2022] GET /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 363 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:15.872769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a7e2-3385-43c6-aa4a-34755efaacc1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:15.981916 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:16.091997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a7e2-3385-43c6-aa4a-34755efaacc1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:16.102510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:16.105229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:16.106216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:16.107699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] PATH_INFO: `/v3/users/028c263d522245a88ee3137154ada628` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:16.111529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028c263d522245a88ee3137154ada628)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:16.117349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:16.231591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028c263d522245a88ee3137154ada628'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:16.245057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028c263d522245a88ee3137154ada628'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:16.271449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028c263d522245a88ee3137154ada628'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:16.272296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028c263d522245a88ee3137154ada628'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:16.274228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028c263d522245a88ee3137154ada628'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:16.302323 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3755/7482] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:15 2022] DELETE /identity/v3/users/028c263d522245a88ee3137154ada628 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:16.304526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:16.305356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:16.305817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:16.352755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:16.356647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:16.399456 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:16.558409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3728/7483] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:16.568030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:16.571962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:16.746261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ff64-9b44-4ab2-aa69-6210f75931e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:16.755927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:16.756967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:16.759966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:16.760524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:16.786321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:16.788151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc36b-8fb1-4f12-946a-1d4774abcfae service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:16.814484 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3756/7484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:17.572879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:17.575127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:17.592363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a308f-ec11-492b-8476-6a03ec2aede3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:17.599229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:17.600136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:17.600917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:17.601443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] PATH_INFO: `/v3/projects/2020d598af4c4da6a7013733d7f4b800` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:17.602734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=2020d598af4c4da6a7013733d7f4b800)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:17.605199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:17.682177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2020d598af4c4da6a7013733d7f4b800', 'request_id': 'req-d13f98f8-8ba4-4122-b784-9b8e47953ade'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:17.692086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2020d598af4c4da6a7013733d7f4b800', 'request_id': 'req-d13f98f8-8ba4-4122-b784-9b8e47953ade'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:17.706304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2020d598af4c4da6a7013733d7f4b800', 'request_id': 'req-d13f98f8-8ba4-4122-b784-9b8e47953ade'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:17.724392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] The token cache is being invalidate because project 2020d598af4c4da6a7013733d7f4b800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:17.724748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:17.725522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d13f98f8-8ba4-4122-b784-9b8e47953ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:17.729689 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3729/7485] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:17 2022] DELETE /identity/v3/projects/2020d598af4c4da6a7013733d7f4b800 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:17.734897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:17.735358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:17.735596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:17.762734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:17.764377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:17.822556 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:17.852467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:17.852756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:17.853035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:17.857973 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3757/7486] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:17.878106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:17.879663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:17.892227 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3730/7487] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:17.898651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:17.916254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af684-22a7-47f6-b7ef-b455dd6889ae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:17.921070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:17.921758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:17.922323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:17.922462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:17.923046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:17.923348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:17.924963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:17.942648 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3758/7488] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:17.943678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:17.956880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba88e-5bdb-4852-8293-f36f07b90cce None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:17.961683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:17.962619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:17.962619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:17.962842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:17.963485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:17.965432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.000498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3731/7489] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:17 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:18.005680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.017205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1a35-df31-49bc-b2e9-c1827b90ffb1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.155476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.156180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.156514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.156792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.157614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.159595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.222261 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3759/7490] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:18 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:18.227011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.247149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa495-3bfe-47d0-8a4c-c1753a7db815 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.254479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.256147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.256583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.257223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.258078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.259874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.301458 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3732/7491] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:18.303231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.318981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893478aa-40d1-4dd5-89a9-2fe65e854f8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.331843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.332407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.333486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.333767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.334371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.336206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.350023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.355532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:18.364703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3760/7492] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:18.369926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.392470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0dfe6-72b3-4010-b874-5be83619694a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.399660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.400356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.400648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.400913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] PATH_INFO: `/v3/projects/7aea7aea0d1f4fe0accb246276562877/users/653b1c90682e4cd5b4f571086e2baa46/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.430540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aea7aea0d1f4fe0accb246276562877, user_id=653b1c90682e4cd5b4f571086e2baa46, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.434689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e4c2-dc2b-4555-ae89-70f00f14791f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.459637 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3761/7493] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:18 2022] PUT /identity/v3/projects/7aea7aea0d1f4fe0accb246276562877/users/653b1c90682e4cd5b4f571086e2baa46/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:18.471389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.471680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.472550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.497450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28344-c1bb-4466-9500-af1a45785d57 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.522199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] MFA Rules not processed for user `653b1c90682e4cd5b4f571086e2baa46`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:18.524375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:18.532773 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:18.602807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.603481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.603699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.603978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.606332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:18.627717 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3762/7494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:18.632265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.661383 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:18.696992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.698742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.706845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebca05-d649-4a59-ad30-b2c26e8a163c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.710929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3733/7495] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:18.725458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.726881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.727174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.727450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.728154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.731231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.765834 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3763/7496] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:18 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:18.770613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.790010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a571a-77c4-4ead-8b1f-608f453cd1b7 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.877373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.878033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.878606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.878893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.879656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.883848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.918512 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3734/7497] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:18 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:18.922308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.934472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e691559-25cd-42e6-a976-58adb98bdb67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.948125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.949070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.949632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.950373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:18.952043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:18.955017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:18.974398 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3764/7498] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:18.978900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:18.990275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7860f-5ce2-4c1d-ac9c-4e0d901c6982 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:18.996072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:18.996331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:18.996619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:18.996896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] PATH_INFO: `/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84/users/2ba37978619f42dbb19fd4464b9055c4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.017063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f9c7b7ca9848d9b8cf893daf71aa84, user_id=2ba37978619f42dbb19fd4464b9055c4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.019051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.039234 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3735/7499] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:18 2022] PUT /identity/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84/users/2ba37978619f42dbb19fd4464b9055c4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:19.042619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.070506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a8cf-6725-48a8-81ec-a7cc36012452 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.246827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.247557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.247907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.248250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.248968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.250806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951460a3-f381-4a10-8e36-e4755c43305c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.269566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3765/7500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:19.274333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.291946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a218e1-76f9-4855-9d12-f42fc2592aac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.303886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.306166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.306634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.308684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] PATH_INFO: `/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84/users/2ba37978619f42dbb19fd4464b9055c4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.315662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f9c7b7ca9848d9b8cf893daf71aa84, user_id=2ba37978619f42dbb19fd4464b9055c4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.320463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.367302 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3736/7501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:19 2022] PUT /identity/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84/users/2ba37978619f42dbb19fd4464b9055c4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:19.371078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.371489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.371819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.432025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] MFA Rules not processed for user `2ba37978619f42dbb19fd4464b9055c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:19.433377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:19.610825 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3766/7502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:19.618923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.634343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.638416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17f0a-1e4d-458b-860e-5f45c1008fa2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.645676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.646828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.647300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.648912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.650173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.652642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.692714 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:19.693996 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3737/7503] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 25 01:35:19 2022] POST /identity/v3/domains => generated 276 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:19.695866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.735966 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:19.743892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc6546-643a-408f-8ead-87d27597d0bb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.822694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.824076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.824526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.825117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.828090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:19.849499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152e4f-40c4-47c9-82eb-0b0e8a5aa710 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.862095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.862734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.863023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.863301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.863927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.867757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.904470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.906032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3738/7504] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:19 2022] POST /identity/v3/groups => generated 280 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:19.910764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:19.911181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.925992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3767/7505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:19.929333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0484-5693-44ff-b01b-731265c9cc4a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:19.936745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:19.937603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:19.938273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:19.938721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:19.946516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:update_group(group_id=bac1c63c9a8e47e4a15a8d1fda51e340)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:19.948450 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:19.948450 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:19.948450 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:19.950176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:19.982754 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3739/7506] 10.222.0.16 () {60 vars in 1247 bytes} [Sun Sep 25 01:35:19 2022] PATCH /identity/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340 => generated 292 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:19.984524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.003829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570e0e-2f1c-4816-a790-85b4ece48f2a service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.021499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.022387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.023621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.024062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.048727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:get_group(group_id=bac1c63c9a8e47e4a15a8d1fda51e340)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.050805 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:20.050805 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:35:20.050805 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:35:20.052041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.059660 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3768/7507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:19 2022] GET /identity/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340 => generated 292 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:20.063796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.090552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292edff-93bc-4365-81ca-0d7c2282a2b6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.098382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.099038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.099324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.099603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.107606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:update_group(group_id=bac1c63c9a8e47e4a15a8d1fda51e340)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.109346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.141773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3740/7508] 10.222.0.16 () {60 vars in 1246 bytes} [Sun Sep 25 01:35:20 2022] PATCH /identity/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340 => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:20.141974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.155192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60ae8c-37ee-4652-accb-9ed8ddee6dad tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.179207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.180330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.180662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.181070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.189488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bac1c63c9a8e47e4a15a8d1fda51e340)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.192147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.274955 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3769/7509] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:20 2022] DELETE /identity/v3/groups/bac1c63c9a8e47e4a15a8d1fda51e340 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:20.280252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.293107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1f07-5e9a-4067-a81d-be63a77935d5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.376586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.377568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.377986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.378358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.379722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.383551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.413750 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3741/7510] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:20 2022] POST /identity/v3/groups => generated 327 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:20.420956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.440192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eda56-03c7-40e1-a96d-f5eed46264e2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.447898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.448537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.448824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.449100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.449812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.453331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.492626 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3770/7511] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:20 2022] POST /identity/v3/users => generated 323 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:20.494250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.509448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cde5-5b41-4af5-8e2a-4a183d43026c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.516852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.517678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.518203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.518557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.544731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=1a1205f3351342008668026b1e814b98)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.547453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.603396 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3742/7512] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:35:20 2022] PUT /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:20.608153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.625364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4273f-7de3-4551-86d6-7a05c2913bc1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.634333 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:20.712379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.713852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.714150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.714433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.715236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.717899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.757450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3771/7513] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:20 2022] POST /identity/v3/users => generated 321 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:20.764322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.784645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc27e-ad7c-4f58-ae80-9f5cf0af58d3 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:20.791005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:20.792601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:20.792899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:20.793184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:20.811523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=36e7c83b711146598754c962357a45c9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:20.813429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:20.818567 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:20.864633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3743/7514] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:35:20 2022] PUT /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:20.869467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:20.887146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa087-f240-4173-9e0c-6a50b63578a6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.003847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.004932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.005444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.007766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.008628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.012189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.074267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3772/7515] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:20 2022] POST /identity/v3/users => generated 323 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:21.078261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.094253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764504-fd8e-4b57-b73a-6c7fdfa6dd3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.102477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.104212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.104670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.105131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.124216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=fbdbdfd18e5a4d00a7f1f3b8915a80bf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.127331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.173696 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3744/7516] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:35:21 2022] PUT /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:21.175103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.188653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57a69-491e-47aa-bfbe-8d1a1dfc902f tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.274674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.275331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.275617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.275894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.277067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=470bce58a9624dc2833f77f86a0b879b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.279026 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:21.279026 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:35:21.279026 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:35:21.280432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.307315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.311222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3773/7517] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:35:21 2022] GET /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users => generated 1083 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:21.327356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951aca-ba2a-4ced-8801-64e65cbf5926 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.332885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.333573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.333862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.334138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.336389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=1a1205f3351342008668026b1e814b98)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.337503 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:21.337503 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:21.337503 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:21.339238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.359818 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3745/7518] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 25 01:35:21 2022] HEAD /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:21.364225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.380708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742012a-3bfa-4ae3-b6aa-c345bb9a7e2d tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.396792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.397543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.397964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.398266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.400043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=1a1205f3351342008668026b1e814b98)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.402280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.440053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:21.453514 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:21.467577 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3774/7519] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:35:21 2022] DELETE /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/1a1205f3351342008668026b1e814b98 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:21.468616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.487684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d790a-2364-4be7-b9c1-b8219b5c64e6 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.586996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.587766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.588181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.588525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.592327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=36e7c83b711146598754c962357a45c9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.594739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.618154 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3746/7520] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 25 01:35:21 2022] HEAD /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:21.625600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.659245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5e8c-0632-4903-b8c4-82db2e42486e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.673757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.675048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.675048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.675261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.681304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=36e7c83b711146598754c962357a45c9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.683555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.701846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:21.728980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3775/7521] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:35:21 2022] DELETE /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/36e7c83b711146598754c962357a45c9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:21.733033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.763818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4fda-b2fc-40f4-9a7d-7d17e6e169dd tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.856106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.857045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.857946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.858232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.861884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=fbdbdfd18e5a4d00a7f1f3b8915a80bf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.864976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.890241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.890879 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3747/7522] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 25 01:35:21 2022] HEAD /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:21.903491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ca146-4c51-45eb-874a-1d675349ee5c tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:21.909182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:21.910278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:21.910773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:21.911423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:21.913679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=470bce58a9624dc2833f77f86a0b879b, user_id=fbdbdfd18e5a4d00a7f1f3b8915a80bf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:21.916259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:21.927046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:21.962515 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3776/7523] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 25 01:35:21 2022] DELETE /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:21.966712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:21.978050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800503-a255-4730-9cca-1ae539c4e0d1 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:22.025626 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:22.095158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:22.095806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:22.096089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:22.096363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:22.097600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=470bce58a9624dc2833f77f86a0b879b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:22.098779 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:22.098779 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:22.098779 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:22.099991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:22.117253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3748/7524] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:35:21 2022] GET /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b/users => generated 145 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:22.121844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:22.147324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302980-abfa-4752-83b5-4629763a1421 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:22.162713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:22.163415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:22.163897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:22.164188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:22.167295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fbdbdfd18e5a4d00a7f1f3b8915a80bf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:22.169250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:22.256852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.269067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.294605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.294605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.295694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdbdfd18e5a4d00a7f1f3b8915a80bf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.322006 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3777/7525] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:22 2022] DELETE /identity/v3/users/fbdbdfd18e5a4d00a7f1f3b8915a80bf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:22.326233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:22.327891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:22.350045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11291aa-b6d2-494a-b131-32cb324f6bb8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:22.472161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:22.472961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:22.473119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:22.473432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users/36e7c83b711146598754c962357a45c9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:22.474574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=36e7c83b711146598754c962357a45c9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:22.478093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:22.532236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.533043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.543399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.563315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.564514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e7c83b711146598754c962357a45c9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.586465 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3749/7526] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:22 2022] DELETE /identity/v3/users/36e7c83b711146598754c962357a45c9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:22.590860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:22.603317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565669a-f456-44ff-a32b-8590ada6bd82 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:22.697255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:22.698323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:22.698745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:22.699186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users/1a1205f3351342008668026b1e814b98` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:22.700484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1a1205f3351342008668026b1e814b98)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:22.702862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:22.755421 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:22.795914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.821737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.837052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.838240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.839049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1205f3351342008668026b1e814b98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:22.862311 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3778/7527] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:22 2022] DELETE /identity/v3/users/1a1205f3351342008668026b1e814b98 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:22.866286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:22.868626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:22.884897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a10c6-b37f-40cd-971d-926c92572a7a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:22.932940 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:22.990606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:22.992776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:22.997204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:22.997776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/470bce58a9624dc2833f77f86a0b879b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:22.999528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=470bce58a9624dc2833f77f86a0b879b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.003548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.081518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3750/7528] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:22 2022] DELETE /identity/v3/groups/470bce58a9624dc2833f77f86a0b879b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:23.088011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.091298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:23.127585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9551-8b8e-4fcb-bb15-da1eb3c71607 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.234770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.235432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.235717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.235995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.236636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.238591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.262800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3779/7529] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:23 2022] POST /identity/v3/groups => generated 326 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:23.266219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.280522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0363ef-64d6-4fe2-91a7-b830564f5ec4 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.292554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.293165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.293464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.293745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.294385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.296311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.318361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3751/7530] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:23 2022] POST /identity/v3/groups => generated 325 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:23.323011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.342179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3051dd-767e-4990-a62f-12c863fe8a5a tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.354455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.355105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.355393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.359615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.360428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.362475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.386372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3780/7531] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:23 2022] POST /identity/v3/groups => generated 324 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:23.392063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.408495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbccf-3f06-407c-ba90-3476a9fed9d2 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.426066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.429480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.433731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.434100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.434851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.437136 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:23.437136 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:23.437136 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:23.440316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.463576 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3752/7532] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:35:23 2022] GET /identity/v3/groups => generated 1485 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:23.468589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.484285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635e53-8955-41e3-bedd-9fa6726d0fc8 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.500832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.501758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.502121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.502770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/d95f515871d9478a93a29e6b1a6afd58` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.518954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d95f515871d9478a93a29e6b1a6afd58)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.523838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.599974 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3781/7533] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:23 2022] DELETE /identity/v3/groups/d95f515871d9478a93a29e6b1a6afd58 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:23.605430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.619268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe941c-7b89-45d9-b6c8-697ef0bb3daf tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:23.734844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:23.735779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:23.736306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:23.737140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/b77103ee647d45e4b6d32177c1cd8849` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:23.749740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b77103ee647d45e4b6d32177c1cd8849)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:23.757043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:23.875509 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3753/7534] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:23 2022] DELETE /identity/v3/groups/b77103ee647d45e4b6d32177c1cd8849 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:23.880052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:23.901612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c556-5e67-4573-a0b3-c902665fca3e tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.010067 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:24.082414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.083492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.083962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.084414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/e805cf6038fa4ae38216a1ad16069784` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.091278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e805cf6038fa4ae38216a1ad16069784)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.094352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.185000 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3782/7535] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:23 2022] DELETE /identity/v3/groups/e805cf6038fa4ae38216a1ad16069784 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:24.190838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.215104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb70b-7467-438e-8a4c-f1b1204278fe tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.271712 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:24.317229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.318238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.318756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.319704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.320491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.322830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.384387 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3754/7536] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:24 2022] POST /identity/v3/users => generated 323 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:24.392045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.410128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645dd04-9da5-452c-9c04-c49a315b5d33 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.433753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.434410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.434683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.434963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.435610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.437572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.474063 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3783/7537] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:24 2022] POST /identity/v3/groups => generated 325 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:24.480817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.495535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb7854-fc01-4304-814b-67029e9b2001 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.523530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.525131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.525701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.526212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/9b2b1ebecb7c4834bcc604239b957a05/users/89b02fbb0a9e4fbb9149423099182147` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.563073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9b2b1ebecb7c4834bcc604239b957a05, user_id=89b02fbb0a9e4fbb9149423099182147)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.570130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.621931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.622479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3755/7538] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:35:24 2022] PUT /identity/v3/groups/9b2b1ebecb7c4834bcc604239b957a05/users/89b02fbb0a9e4fbb9149423099182147 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:24.649750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baedd0c-383c-4dcc-8b65-3e0385d85a09 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.746409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.746968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.747258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.747538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.748186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.752993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.791991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3784/7539] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:35:24 2022] POST /identity/v3/groups => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:24.797535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.816802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618ca9-ac3d-4e08-b42a-70b4dc2d8270 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:24.828085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:24.828754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:24.829034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:24.829308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/e7d3ce8352804df39df43e50585f416b/users/89b02fbb0a9e4fbb9149423099182147` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:24.847898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e7d3ce8352804df39df43e50585f416b, user_id=89b02fbb0a9e4fbb9149423099182147)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:24.849934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:24.895429 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3756/7540] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 25 01:35:24 2022] PUT /identity/v3/groups/e7d3ce8352804df39df43e50585f416b/users/89b02fbb0a9e4fbb9149423099182147 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:24.900013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:24.918686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063cd0-13a0-441c-a046-3d6d6f4d60aa tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.043090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.044194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.045343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.045856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users/89b02fbb0a9e4fbb9149423099182147/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.047890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=89b02fbb0a9e4fbb9149423099182147)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.051178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.070558 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:25.079134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3785/7541] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:35:24 2022] GET /identity/v3/users/89b02fbb0a9e4fbb9149423099182147/groups => generated 836 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:25.080458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:25.095083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf74428-5cd5-4967-a68d-43150a0ad264 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.104675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.105568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.105953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.106880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/e7d3ce8352804df39df43e50585f416b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.107620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e7d3ce8352804df39df43e50585f416b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.110297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.181333 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3757/7542] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:25 2022] DELETE /identity/v3/groups/e7d3ce8352804df39df43e50585f416b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:25.182044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:25.195972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65116e6-bd65-42f0-a686-9c7516940e6b tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.307325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.308049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.308405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.308758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/groups/9b2b1ebecb7c4834bcc604239b957a05` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.310151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9b2b1ebecb7c4834bcc604239b957a05)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.312377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.371396 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3786/7543] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 25 01:35:25 2022] DELETE /identity/v3/groups/9b2b1ebecb7c4834bcc604239b957a05 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:25.376992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:25.405931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647c7b-4d58-49f7-b499-80ca3d425b79 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.503492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.505338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.506133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.506745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/users/89b02fbb0a9e4fbb9149423099182147` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.509018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_user(user_id=89b02fbb0a9e4fbb9149423099182147)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.511667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.519274 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:25.573574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b02fbb0a9e4fbb9149423099182147'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.574359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b02fbb0a9e4fbb9149423099182147'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.581807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b02fbb0a9e4fbb9149423099182147'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.595199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b02fbb0a9e4fbb9149423099182147'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.596038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b02fbb0a9e4fbb9149423099182147'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.614122 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3758/7544] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:25 2022] DELETE /identity/v3/users/89b02fbb0a9e4fbb9149423099182147 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:25.619938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:25.622206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:25.636270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0416a-8db2-4253-be54-e8fe2479f8e9 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.708999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.709583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.709913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.710196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/domains/3f96f4799ff342e88df47471df78c79c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.711992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3f96f4799ff342e88df47471df78c79c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.713521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.740487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.742022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.772158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.772922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.776393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3787/7545] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:35:25 2022] PATCH /identity/v3/domains/3f96f4799ff342e88df47471df78c79c => generated 277 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:25.780456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:25.795970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd750b-4e95-49ea-83a2-0299b61e2343 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:25.863458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba37978619f42dbb19fd4464b9055c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68f9c7b7ca9848d9b8cf893daf71aa84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:25.864143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:25.864429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:25.865086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] PATH_INFO: `/v3/domains/3f96f4799ff342e88df47471df78c79c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:25.881279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3f96f4799ff342e88df47471df78c79c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:25.883241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:25.919938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:25.926124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3f96f4799ff342e88df47471df78c79c'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.010830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.015478 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:26.032460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.045713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.069491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] The token cache is being invalidate because project 3f96f4799ff342e88df47471df78c79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:26.069974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.073219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.092423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.097229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.098746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3f96f4799ff342e88df47471df78c79c', 'request_id': 'req-be96babf-e7ec-4a21-9ff6-0ce586fed0e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.119885 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3759/7546] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:35:25 2022] DELETE /identity/v3/domains/3f96f4799ff342e88df47471df78c79c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:26.123865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:26.125541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:26.175497 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:26.323475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde7-69c6-4ca2-a666-9a78eb4ca640 tempest-GroupsV3TestJSON-543937251 tempest-GroupsV3TestJSON-543937251-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:26.436416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:26.437149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:26.440947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:26.440947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] PATH_INFO: `/v3/users/653b1c90682e4cd5b4f571086e2baa46` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:26.444991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=653b1c90682e4cd5b4f571086e2baa46)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:26.448020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:26.560693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653b1c90682e4cd5b4f571086e2baa46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.589566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653b1c90682e4cd5b4f571086e2baa46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.607286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653b1c90682e4cd5b4f571086e2baa46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.608456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653b1c90682e4cd5b4f571086e2baa46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.609435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653b1c90682e4cd5b4f571086e2baa46'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:26.648594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3788/7547] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:26 2022] DELETE /identity/v3/users/653b1c90682e4cd5b4f571086e2baa46 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:26.659478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:26.659991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:26.660638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:26.693243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:26.695777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:26.771101 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3760/7548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:26.783183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:26.784905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:26.856205 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:26.866170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737b57-da9c-40fa-b1cc-900c83d14cfc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:26.875116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:26.876041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:26.876515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:26.877094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:26.889737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:26.891466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:26.919598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3789/7549] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:27.533251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:27.534883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:27.569558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958491da-b01d-44ad-a14a-5348544f4041 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:27.576021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:27.577310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:27.577894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:27.578399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] PATH_INFO: `/v3/projects/7aea7aea0d1f4fe0accb246276562877` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:27.579769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aea7aea0d1f4fe0accb246276562877)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:27.581968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:27.641269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aea7aea0d1f4fe0accb246276562877', 'request_id': 'req-2c88d21c-9b28-46e0-92ad-45e9cf992a83'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.651370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aea7aea0d1f4fe0accb246276562877', 'request_id': 'req-2c88d21c-9b28-46e0-92ad-45e9cf992a83'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.662715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aea7aea0d1f4fe0accb246276562877', 'request_id': 'req-2c88d21c-9b28-46e0-92ad-45e9cf992a83'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.687913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] The token cache is being invalidate because project 7aea7aea0d1f4fe0accb246276562877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:27.688435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.689341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.691797 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3761/7550] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:27 2022] DELETE /identity/v3/projects/7aea7aea0d1f4fe0accb246276562877 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:27.695923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:27.711880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a45f5-7194-4c17-b448-528d4e0917ac service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:27.853185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:27.854470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:27.855136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:27.856028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] PATH_INFO: `/v3/users/2ba37978619f42dbb19fd4464b9055c4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:27.857665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba37978619f42dbb19fd4464b9055c4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:27.860268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:27.923157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba37978619f42dbb19fd4464b9055c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.933187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba37978619f42dbb19fd4464b9055c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.948559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba37978619f42dbb19fd4464b9055c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.949503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba37978619f42dbb19fd4464b9055c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.950225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d65045be-170a-4cd2-86e9-8d15cafca5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba37978619f42dbb19fd4464b9055c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:27.968246 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3790/7551] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:27 2022] DELETE /identity/v3/users/2ba37978619f42dbb19fd4464b9055c4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:28.307739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:28.309280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:28.334598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d21c-9b28-46e0-92ad-45e9cf992a83 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:28.427319 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:28.457582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:28.458329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.458682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.459029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] PATH_INFO: `/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.460307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f9c7b7ca9848d9b8cf893daf71aa84)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:28.462390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:28.535300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f9c7b7ca9848d9b8cf893daf71aa84', 'request_id': 'req-a89cf59a-fdc0-4d0c-9241-a2347b158e20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:28.543713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f9c7b7ca9848d9b8cf893daf71aa84', 'request_id': 'req-a89cf59a-fdc0-4d0c-9241-a2347b158e20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:28.550712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f9c7b7ca9848d9b8cf893daf71aa84', 'request_id': 'req-a89cf59a-fdc0-4d0c-9241-a2347b158e20'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:28.585794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] The token cache is being invalidate because project 68f9c7b7ca9848d9b8cf893daf71aa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:28.586758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:28.587885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a89cf59a-fdc0-4d0c-9241-a2347b158e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:28.592815 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3762/7552] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:28 2022] DELETE /identity/v3/projects/68f9c7b7ca9848d9b8cf893daf71aa84 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:28.596335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.596624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.596899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.618961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:28.620497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:28.714331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.714854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.715348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.719818 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3791/7553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:28.755012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:28.757370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:28.780959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3763/7554] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:28.782970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:28.799334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c693-1328-4089-8400-91d6ae87acc0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:28.809376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:28.810295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.810797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.811302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.812168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:28.812698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:28.815261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:28.824169 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:28.832282 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3792/7555] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:28.836907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:28.847672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee25a3e-60f3-45cb-a470-685733fe2877 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:28.861483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:28.862168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.862653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.863107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.863907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:28.867498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:28.906011 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3764/7556] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:28 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:28.910204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:28.922384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403e3c-1ddf-420b-b3c9-879eafeafb71 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:28.996039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:28.997196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:28.997941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:28.998500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:28.999442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.002893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.035713 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3793/7557] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:28 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:29.036455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.052551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f81c-0b7b-4d39-be4c-1e3a80285052 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.060904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.062131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.062656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.063146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.064092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.066855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.088071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.118763 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3765/7558] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:29.124998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8040-e45b-402e-ba66-c1f5733d6adb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.136227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.136908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.137194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.137554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.138381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.141388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1277a17-0cd4-4bd5-bf1e-033b229c2055 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.161443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3794/7559] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:29.164552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.178287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef019e5-9bc5-45b4-8c20-6668c20fb7e3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.190485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.191335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.193825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.194340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] PATH_INFO: `/v3/projects/711d3009a1b340248a192bfd0ce1b207/users/9fd7edee1b384a728432bc76ca28f8d0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.234725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=711d3009a1b340248a192bfd0ce1b207, user_id=9fd7edee1b384a728432bc76ca28f8d0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.237676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.263838 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3766/7560] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:29 2022] PUT /identity/v3/projects/711d3009a1b340248a192bfd0ce1b207/users/9fd7edee1b384a728432bc76ca28f8d0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:29.277731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.278030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.278421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.320672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] MFA Rules not processed for user `9fd7edee1b384a728432bc76ca28f8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:29.322511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:29.425480 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3795/7561] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:29.428770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.528937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a113-2527-48e9-881f-94aa8a0892ac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.535551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.536326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.536711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.537087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.538028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.540456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.563122 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:29.592582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.594994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3767/7562] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:29 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:29.605288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754c25-c7cd-4e00-a317-08ca7743116c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.731503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.732935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.733486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.733922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.734733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.736949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.751452 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:29.772216 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3796/7563] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:29 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:29.776212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.790840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd40b-98c4-4924-9815-65374e37ab51 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.806226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.806855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.807134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.807405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.808049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.811146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.839200 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3768/7564] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:29.840530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.853556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60957a-0e43-424b-9d8d-45c12abdb5b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:29.873730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:29.874614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:29.875065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:29.875498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] PATH_INFO: `/v3/projects/34b49692898e415ca11b6fb0ba316967/users/87290599ede344179cd6e102aff1538a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:29.909003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b49692898e415ca11b6fb0ba316967, user_id=87290599ede344179cd6e102aff1538a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:29.912707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:29.948866 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3797/7565] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:29 2022] PUT /identity/v3/projects/34b49692898e415ca11b6fb0ba316967/users/87290599ede344179cd6e102aff1538a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:29.950677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:29.988595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fcc7-4d6b-498a-89b3-b4613fe65c29 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.088695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.091517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:30.181219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff401-748d-46aa-817f-f4701e7ac5dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.192393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.193060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.195791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.196604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] PATH_INFO: `/v3/users/2675ae84e5834c04b3a592134cf937b4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.200380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2675ae84e5834c04b3a592134cf937b4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.202941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.204770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.205420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.207353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.207708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.209077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.216610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.247540 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3769/7566] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:30.258744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.288138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9340a-c64a-42f7-a20d-46895b916841 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.293089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2675ae84e5834c04b3a592134cf937b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:30.301724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.302567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.303108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.304223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] PATH_INFO: `/v3/projects/34b49692898e415ca11b6fb0ba316967/users/87290599ede344179cd6e102aff1538a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.307856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b49692898e415ca11b6fb0ba316967, user_id=87290599ede344179cd6e102aff1538a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.311923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4b092-06ce-4914-ac46-5d962ef83ff8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.313123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2675ae84e5834c04b3a592134cf937b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:30.342545 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3770/7567] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:30 2022] PUT /identity/v3/projects/34b49692898e415ca11b6fb0ba316967/users/87290599ede344179cd6e102aff1538a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:30.356973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.357522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.357888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.360211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2675ae84e5834c04b3a592134cf937b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:30.361608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2675ae84e5834c04b3a592134cf937b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:30.366767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99e1d135-8095-4525-aa24-5406a324dd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2675ae84e5834c04b3a592134cf937b4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:30.398407 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3798/7568] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:30 2022] DELETE /identity/v3/users/2675ae84e5834c04b3a592134cf937b4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:30.411266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.411573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.415332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.425897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] MFA Rules not processed for user `87290599ede344179cd6e102aff1538a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:30.427338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:30.461375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:30.463719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:30.576644 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:30.590873 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3771/7569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:30.593899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.618017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08fe3-5fe5-4f6b-937c-e6f8a205dc51 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.619191 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3799/7570] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:30.625548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.626959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.627406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.627852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.633995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.634616 n-d-master-1 devstack@keystone.service[81862]: WARNING oslo_log.versionutils [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:30.636390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:30.637175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.640823 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:30.640823 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:30.640823 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:30.641801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.690654 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3772/7571] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:30 2022] POST /identity/v3/policies => generated 230 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:30.696735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.711254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531379d-e70f-4db3-ae6b-e95e9ca744ee tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.717781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.718903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.719376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.720563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/f5ff762392ee455796449ff6aafdaaff` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.721878 n-d-master-1 devstack@keystone.service[81862]: WARNING oslo_log.versionutils [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:30.724963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=f5ff762392ee455796449ff6aafdaaff)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.727079 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:30.727079 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:30.727079 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:30.729425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.732310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e90e-8b50-49f0-b517-639cbeb59335 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.747893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.749192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.749904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.750779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.773810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.777218 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3773/7572] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 25 01:35:30 2022] PATCH /identity/v3/policies/f5ff762392ee455796449ff6aafdaaff => generated 237 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:30.778083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.780533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.836464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffba3dd-fc23-4c2d-8a01-4af61cfc5d82 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.839406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3800/7573] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:30.844605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.845309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.845626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.845905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/f5ff762392ee455796449ff6aafdaaff` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.846759 n-d-master-1 devstack@keystone.service[81862]: WARNING oslo_log.versionutils [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:30.847471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=f5ff762392ee455796449ff6aafdaaff)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.848870 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:30.848870 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:30.848870 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:30.849957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.863224 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3774/7574] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:35:30 2022] GET /identity/v3/policies/f5ff762392ee455796449ff6aafdaaff => generated 237 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:30.864746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.877394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f522f-d6de-45d2-99d9-55f26ad1020e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.884101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.884889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.885179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.885541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/f5ff762392ee455796449ff6aafdaaff` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.886377 n-d-master-1 devstack@keystone.service[81863]: WARNING oslo_log.versionutils [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:30.887002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f5ff762392ee455796449ff6aafdaaff)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.888425 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:30.888425 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:35:30.888425 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:35:30.889321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.913519 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3801/7575] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:30 2022] DELETE /identity/v3/policies/f5ff762392ee455796449ff6aafdaaff => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:30.918771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.938583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eeaa-9325-40b3-9eb3-2040902fdc48 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.946086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.947089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:30.948123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:30.948635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:30.950820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:30.952967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:30.977765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3775/7576] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:30 2022] POST /identity/v3/policies => generated 229 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:30.979034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:30.991902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cb53d-1729-47e8-bcd7-c10ef9f7a665 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:30.998176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:30.998810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.000151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.000452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.001445 n-d-master-1 devstack@keystone.service[81863]: WARNING oslo_log.versionutils [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:31.001930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.003743 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:31.003743 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:35:31.003743 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:35:31.021160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.082579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.091105 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:31.095471 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3802/7577] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:30 2022] POST /identity/v3/policies => generated 229 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:31.109651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f343e2-31e8-4eb9-ae54-2cdada8798f7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.119079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.120894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.121371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.122012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.125009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.127233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.158616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3776/7578] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:31 2022] POST /identity/v3/policies => generated 229 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:31.165475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.180275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c352f-2c51-403e-9216-02829bbbf573 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.188086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.189109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.189643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.190025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.190969 n-d-master-1 devstack@keystone.service[81863]: WARNING oslo_log.versionutils [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:31.193867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.196624 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:31.196624 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:35:31.196624 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:35:31.199255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.214095 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3803/7579] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:35:31 2022] GET /identity/v3/policies => generated 763 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:31.218744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.234316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952abe1-65bc-4526-870b-1ee487036a17 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.242042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.243562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.243562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.243562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/949ecfc58cd541e3b70325904b4957bf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.244238 n-d-master-1 devstack@keystone.service[81862]: WARNING oslo_log.versionutils [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 25 01:35:31.244911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=949ecfc58cd541e3b70325904b4957bf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.246817 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:35:31.246817 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:35:31.246817 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:35:31.247950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.271268 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3777/7580] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/policies/949ecfc58cd541e3b70325904b4957bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:31.275252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.287185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0acd59-2963-4dd6-b0dd-0acfebf493d7 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.294309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.295162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.295452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.295736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/c18c3e8b3139481ab78e4bb428105a44` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.297082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c18c3e8b3139481ab78e4bb428105a44)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.299377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.330228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3804/7581] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/policies/c18c3e8b3139481ab78e4bb428105a44 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:31.336697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.354300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd229-487d-470a-9db4-2827b4449ae1 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.376672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87290599ede344179cd6e102aff1538a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b49692898e415ca11b6fb0ba316967', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.377432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.377749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.378947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] PATH_INFO: `/v3/policies/2b66301f7173411896f95cb6a12c54fb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.390557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2b66301f7173411896f95cb6a12c54fb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.395487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.419770 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3778/7582] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/policies/2b66301f7173411896f95cb6a12c54fb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:31.424883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.427069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.443000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b549-6d99-498a-8612-70df3d6bf78a tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.449081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.450394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.450834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.451427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] PATH_INFO: `/v3/users/9fd7edee1b384a728432bc76ca28f8d0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.453091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd7edee1b384a728432bc76ca28f8d0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.455312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.536270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd7edee1b384a728432bc76ca28f8d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.550142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd7edee1b384a728432bc76ca28f8d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.580343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd7edee1b384a728432bc76ca28f8d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.582585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd7edee1b384a728432bc76ca28f8d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.590178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b872e9c-eee6-476f-abcf-d6b8b1578e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd7edee1b384a728432bc76ca28f8d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.613396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.618050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.636959 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3805/7583] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/users/9fd7edee1b384a728432bc76ca28f8d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:31.642071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.642446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.642923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.657917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e206c-26d5-402b-b99b-699661fac195 tempest-PoliciesTestJSON-30077930 tempest-PoliciesTestJSON-30077930-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.671375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:31.672658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.690171 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:31.750661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.751644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.752124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.752658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] PATH_INFO: `/v3/projects/aa1c5e38a7984066a6768784a7385706` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.753945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1c5e38a7984066a6768784a7385706)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.756392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:31.775766 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3806/7584] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:31.787330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.790472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.822989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1c5e38a7984066a6768784a7385706', 'request_id': 'req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.833513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1c5e38a7984066a6768784a7385706', 'request_id': 'req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.841421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1c5e38a7984066a6768784a7385706', 'request_id': 'req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.857257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] The token cache is being invalidate because project aa1c5e38a7984066a6768784a7385706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:31.857688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.858470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:31.860224 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3779/7585] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/projects/aa1c5e38a7984066a6768784a7385706 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:31.864077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:31.865583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.873371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f09ac-3e3d-4ec9-899b-1e40224fced4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.941990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.942799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.943175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.943537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.946480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:31.947145 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:31.975128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e581d0-23fb-47c9-9c1b-6234bd8c30b4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:31.985630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:31.987148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:31.987524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:31.988162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] PATH_INFO: `/v3/users/a06de78be33b40f499d64b228ccca8c7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:31.989731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06de78be33b40f499d64b228ccca8c7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:31.992766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:32.027413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:32.029278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:32.042086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3807/7586] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:32.056889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06de78be33b40f499d64b228ccca8c7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.057873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06de78be33b40f499d64b228ccca8c7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.066451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06de78be33b40f499d64b228ccca8c7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.081699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06de78be33b40f499d64b228ccca8c7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.082674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06de78be33b40f499d64b228ccca8c7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.098130 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3780/7587] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:31 2022] DELETE /identity/v3/users/a06de78be33b40f499d64b228ccca8c7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:32.485688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:32.496668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c937-00a4-4f63-8af5-81967f03385c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:32.538830 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:32.611661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:32.614186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:32.628397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:32.629926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:32.630809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:32.630809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] PATH_INFO: `/v3/projects/2c4f153171d842c3ab498ab1a51e2e90` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:32.632888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4f153171d842c3ab498ab1a51e2e90)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:32.639856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:32.723840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf890c6-1ed0-4727-a323-39465b040d62 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:32.732020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4f153171d842c3ab498ab1a51e2e90', 'request_id': 'req-a12b392d-43c3-47d8-8abc-b42f4f960a32'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.739734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4f153171d842c3ab498ab1a51e2e90', 'request_id': 'req-a12b392d-43c3-47d8-8abc-b42f4f960a32'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.747056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4f153171d842c3ab498ab1a51e2e90', 'request_id': 'req-a12b392d-43c3-47d8-8abc-b42f4f960a32'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.762642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] The token cache is being invalidate because project 2c4f153171d842c3ab498ab1a51e2e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:32.763081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.763800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.765932 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3808/7588] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:32 2022] DELETE /identity/v3/projects/2c4f153171d842c3ab498ab1a51e2e90 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:32.770074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:32.771557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:32.802930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:32.802930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:32.803255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:32.803505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] PATH_INFO: `/v3/projects/711d3009a1b340248a192bfd0ce1b207` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:32.804869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711d3009a1b340248a192bfd0ce1b207)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:32.806888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:32.847053 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:32.883904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b392d-43c3-47d8-8abc-b42f4f960a32 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:32.896837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711d3009a1b340248a192bfd0ce1b207', 'request_id': 'req-2e2dcba1-48fe-496d-bec1-829b558e8241'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.911144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711d3009a1b340248a192bfd0ce1b207', 'request_id': 'req-2e2dcba1-48fe-496d-bec1-829b558e8241'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.930050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711d3009a1b340248a192bfd0ce1b207', 'request_id': 'req-2e2dcba1-48fe-496d-bec1-829b558e8241'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.945226 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:32.952719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:32.953443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:32.953742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:32.955154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] The token cache is being invalidate because project 711d3009a1b340248a192bfd0ce1b207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:32.955587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] PATH_INFO: `/v3/users/ca420a914e03412cb88bb3f170517286` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:32.956005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.957591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca420a914e03412cb88bb3f170517286)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:32.958706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:32.960285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:32.964289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3781/7589] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:32 2022] DELETE /identity/v3/projects/711d3009a1b340248a192bfd0ce1b207 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:32.966247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:32.970130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:32.990070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcba1-48fe-496d-bec1-829b558e8241 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:33.002758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:33.003471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:33.003760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:33.004095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] PATH_INFO: `/v3/users/87290599ede344179cd6e102aff1538a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:33.005284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=87290599ede344179cd6e102aff1538a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:33.007337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:33.043417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca420a914e03412cb88bb3f170517286'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.052382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca420a914e03412cb88bb3f170517286'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.068289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca420a914e03412cb88bb3f170517286'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.069303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca420a914e03412cb88bb3f170517286'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.070035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca420a914e03412cb88bb3f170517286'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.073808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87290599ede344179cd6e102aff1538a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.075044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87290599ede344179cd6e102aff1538a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.083777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87290599ede344179cd6e102aff1538a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.088929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3809/7590] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:32 2022] DELETE /identity/v3/users/ca420a914e03412cb88bb3f170517286 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:33.098790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87290599ede344179cd6e102aff1538a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.099608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87290599ede344179cd6e102aff1538a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.125470 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3782/7591] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:32 2022] DELETE /identity/v3/users/87290599ede344179cd6e102aff1538a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:33.547466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:33.548953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:33.668357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38e80-7715-44d0-837d-be90eb701b08 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:33.770837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:33.771355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:33.771761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:33.772461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:33.772657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:33.772796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] PATH_INFO: `/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:33.774084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdd2dd2ccea4c229cab8be0458e4e66)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:33.777804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:33.794426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b1cb-6620-4289-99b4-1efbfb1937ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:33.810208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:33.810969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:33.811345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:33.811708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] PATH_INFO: `/v3/projects/34b49692898e415ca11b6fb0ba316967` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:33.813102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b49692898e415ca11b6fb0ba316967)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:33.815233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:33.860836 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:33.888187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdd2dd2ccea4c229cab8be0458e4e66', 'request_id': 'req-6b156c26-5cb8-409d-b7e9-908a75b6ba99'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.898695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdd2dd2ccea4c229cab8be0458e4e66', 'request_id': 'req-6b156c26-5cb8-409d-b7e9-908a75b6ba99'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.906818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdd2dd2ccea4c229cab8be0458e4e66', 'request_id': 'req-6b156c26-5cb8-409d-b7e9-908a75b6ba99'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.913656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b49692898e415ca11b6fb0ba316967', 'request_id': 'req-4a303995-84c8-4c54-94c8-11ed6b40a213'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.921607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b49692898e415ca11b6fb0ba316967', 'request_id': 'req-4a303995-84c8-4c54-94c8-11ed6b40a213'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.926340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] The token cache is being invalidate because project 1cdd2dd2ccea4c229cab8be0458e4e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:33.926646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.928230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6b156c26-5cb8-409d-b7e9-908a75b6ba99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.928432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b49692898e415ca11b6fb0ba316967', 'request_id': 'req-4a303995-84c8-4c54-94c8-11ed6b40a213'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.932173 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3810/7592] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:33 2022] DELETE /identity/v3/projects/1cdd2dd2ccea4c229cab8be0458e4e66 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:33.937201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4c75-e320-45d2-abdd-486981bc130a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:33.938560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4c75-e320-45d2-abdd-486981bc130a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:33.938959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4c75-e320-45d2-abdd-486981bc130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:33.944709 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=73,keystone:DELETE=24,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:33.953025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] The token cache is being invalidate because project 34b49692898e415ca11b6fb0ba316967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:33.953748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.955544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4a303995-84c8-4c54-94c8-11ed6b40a213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:33.960670 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3783/7593] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:33 2022] DELETE /identity/v3/projects/34b49692898e415ca11b6fb0ba316967 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:33.962411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-227f4c75-e320-45d2-abdd-486981bc130a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:33.962571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87de06-b650-4568-bb54-3f0baa235a2e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:33.963093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87de06-b650-4568-bb54-3f0baa235a2e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:33.963844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87de06-b650-4568-bb54-3f0baa235a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:33.964042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-227f4c75-e320-45d2-abdd-486981bc130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:34.011890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cd87de06-b650-4568-bb54-3f0baa235a2e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:34.015170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cd87de06-b650-4568-bb54-3f0baa235a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:34.052372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3811/7594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:34.063600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.063980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.064769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.096374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:34.098624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:34.112512 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3812/7595] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:34.113867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.124739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6f5b-8eaa-4cff-b19c-3595405a168e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.129952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.130621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.130902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.131169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.132158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:34.132424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.134295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.155871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3784/7596] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:34.170988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.171428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.171819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.177858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3813/7597] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:34.185667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.207717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1e7a-6a09-4195-b5b9-52943054a8e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.217150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.218073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.218516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.218951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.219904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.222365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.231532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:34.236407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:34.256009 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3785/7598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:34.262492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.276989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3814/7599] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:34.283379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.286987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680fd1d-f227-4936-a835-07f8e607b224 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.403265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.404285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.404449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.404958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.405755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:34.406132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.407958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.428314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95d26-4b95-46cf-9a4d-8717ef79e72a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.437043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3786/7600] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:34.441220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.442269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.442899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.444452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.444731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.445386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.453352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.468570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b20f6-e6ae-4b59-9b33-0d435e7a3fb7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.479449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.480073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.480354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.480630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.483942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.486039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.503007 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3815/7601] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:34.507571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.512934 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:34.519802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581ef5-1c9c-463c-9b58-43f8a4645e63 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.530763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.532950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.533959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.534478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.536852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.541957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.544909 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3787/7602] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/projects => generated 395 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:34.548803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.570355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3816/7603] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:34.576083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.597664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40843-2e5b-4154-9cb1-527c6d5fffe9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.677093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6258-a66e-46dd-921b-e75e1427dd8e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.693680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.694479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.694852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.695248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.696394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.698513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.719509 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:34.744638 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3788/7604] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:34.748004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.748685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.748976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.749260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.749397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.750010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.752019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.773936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0281-b38b-4c63-99b1-3dfb9ae7a587 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.782649 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3817/7605] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:34.792024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.803118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.804969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.805360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.805778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.806590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.808387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.811131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e88cf-138a-4894-bdd5-6559a7197f66 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.819773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.821461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.821634 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3789/7606] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:34.821735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.821735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] PATH_INFO: `/v3/projects/9fc88b6325354757a7ea5e3546d14efb/users/b6b57ffc9fdb48549c0c55195dd04d37/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.824676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.848052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c215f1-a8cd-46c2-baad-1f8543a23df6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.858978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:34.859879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.860550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.861003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.861698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.862973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc88b6325354757a7ea5e3546d14efb, user_id=b6b57ffc9fdb48549c0c55195dd04d37, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:34.863580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.868014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130b01a-4e03-4fcb-bcc5-54e297dea857 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:34.884368 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3790/7607] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:34.888451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:34.901164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f8d9-3e24-4fab-b457-adde01216028 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:34.907530 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3818/7608] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:34 2022] PUT /identity/v3/projects/9fc88b6325354757a7ea5e3546d14efb/users/b6b57ffc9fdb48549c0c55195dd04d37/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:34.909358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:34.909676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:34.909952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:34.965112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] MFA Rules not processed for user `b6b57ffc9fdb48549c0c55195dd04d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:34.967932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:35.046312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.047458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.048063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.048593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] PATH_INFO: `/v3/projects/98190031c1d44232a6788d8f498a18b9/users/598a830c9555448aa8010d4bd8dd82ef/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.075393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98190031c1d44232a6788d8f498a18b9, user_id=598a830c9555448aa8010d4bd8dd82ef, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.081261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fd457-3c62-49bb-a5d3-44375956ca0f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.104370 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3791/7609] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:34 2022] PUT /identity/v3/projects/98190031c1d44232a6788d8f498a18b9/users/598a830c9555448aa8010d4bd8dd82ef/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:35.115546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3819/7610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:35.116256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.116649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.117262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.127079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.128507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:35.165201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] MFA Rules not processed for user `598a830c9555448aa8010d4bd8dd82ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:35.166783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:35.222840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d6866-e954-4e38-add6-7acae0d176c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.230485 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:35.255970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3792/7611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:35.259989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.288450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.289853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.289853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.290195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.335569 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:35.359017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806182af-78db-4174-b7c8-7e8890b456b4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.366017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.373250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.373963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.374407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.375248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.378925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.404556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.406093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.421061 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3793/7612] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:35 2022] POST /identity/v3/projects => generated 397 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:35.431043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.435025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3820/7613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:35.525980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2f9c-96de-4d8c-91f2-e033a6fed8f4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.533610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.534509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.534889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.535260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.535999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.538300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.582633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3794/7614] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:35 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:35.587300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.600943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea9a4-b0bd-49a4-84c3-119856b9fb5b service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.609272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.610030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.610317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.610598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.611304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.612977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.627601 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3821/7615] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:35.633167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.648707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13809-56df-4a19-bd26-7a9844d9b54d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.669614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.671525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.671830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.672119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] PATH_INFO: `/v3/projects/a6ec16e1dff04d41b6dea950ee489d01/users/6f84ce1263d24d468a3bbd2e6cbabde8/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.701949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec16e1dff04d41b6dea950ee489d01, user_id=6f84ce1263d24d468a3bbd2e6cbabde8, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.705388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.727307 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3795/7616] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:35 2022] PUT /identity/v3/projects/a6ec16e1dff04d41b6dea950ee489d01/users/6f84ce1263d24d468a3bbd2e6cbabde8/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:35.731829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.745696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10eaf3-5ba9-4710-abd2-ae1182d3831f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.848638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.849600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.850069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.850866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.851698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.853836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fb3b6-e2e5-4ae7-ba19-c6ab8bcfa588 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.871059 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3822/7617] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:35.875874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:35.907495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b76294-1c63-4b50-808c-e2d3627f2a3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:35.924788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:35.931598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:35.931950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:35.932227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] PATH_INFO: `/v3/projects/a6ec16e1dff04d41b6dea950ee489d01/users/6f84ce1263d24d468a3bbd2e6cbabde8/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:35.938224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec16e1dff04d41b6dea950ee489d01, user_id=6f84ce1263d24d468a3bbd2e6cbabde8, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:35.940856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:35.986062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3796/7618] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:35 2022] PUT /identity/v3/projects/a6ec16e1dff04d41b6dea950ee489d01/users/6f84ce1263d24d468a3bbd2e6cbabde8/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:36.000945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.001357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.001580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.091549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] MFA Rules not processed for user `6f84ce1263d24d468a3bbd2e6cbabde8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:36.092790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:36.187609 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:36.265878 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3823/7619] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:36.267497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.367658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69e4a-fa5a-42a0-8fed-e28171e481c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.379108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598a830c9555448aa8010d4bd8dd82ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98190031c1d44232a6788d8f498a18b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.380510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.380997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.381734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.382840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Sep 25 01:35:36.399169 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 25 01:35:36.400410 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.408065 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3797/7620] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:36 2022] POST /identity/v3/projects => generated 136 bytes in 137 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:35:36.409681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.426293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565a6d2-7c59-467c-9ae3-b093a0ea69d3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.433654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.434586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.435119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.435605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.436440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.439210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invalid input for field 'name': '' is too short Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: On instance['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: '' Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise error Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application '' Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.448529 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:35:36.450307 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application '' Sep 25 01:35:36.451547 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.463826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.464404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3824/7621] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:36 2022] POST /identity/v3/projects => generated 283 bytes in 54 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:35:36.492168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75daecf-91d1-40b8-aa34-736c0af79d12 tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.497532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.498220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.498570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.498916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.499604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.502250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: On instance['name']: Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: On instance['name']: Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise error Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:35:36.513487 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.519044 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application On instance['name']: Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.520560 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3798/7622] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:36 2022] POST /identity/v3/projects => generated 412 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 25 01:35:36.521684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.531881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c80af-dc3b-4470-b5cb-0a5863bc5ea7 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.538979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.539728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.540110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.540480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects/e658012dcd1541a4a4a9aaf4d69b3dbe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.549927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e658012dcd1541a4a4a9aaf4d69b3dbe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.552212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Could not find project: e658012dcd1541a4a4a9aaf4d69b3dbe.: keystone.exception.ProjectNotFound: Could not find project: e658012dcd1541a4a4a9aaf4d69b3dbe. Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 25 01:35:36.570337 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e658012dcd1541a4a4a9aaf4d69b3dbe. Sep 25 01:35:36.571407 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:35:36.576130 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3825/7623] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:36 2022] DELETE /identity/v3/projects/e658012dcd1541a4a4a9aaf4d69b3dbe => generated 113 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:35:36.577085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.595711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778a92-56f8-4835-8caa-f5d4e805ef3d tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.602748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598a830c9555448aa8010d4bd8dd82ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98190031c1d44232a6788d8f498a18b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.603779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.604285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.604806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.605840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Sep 25 01:35:36.614290 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._list_projects() Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 25 01:35:36.615352 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.620015 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3799/7624] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 25 01:35:36 2022] GET /identity/v3/projects => generated 135 bytes in 43 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:35:36.624147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.635414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5a12-795f-4dcf-9b5c-dcabeec26aef tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.653140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.653834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.657456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.657691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.658369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.660447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:36.698384 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3826/7625] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:36 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:36.702635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.734656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e522a-0042-49ac-9e7e-086a7c72c46a tempest-ProjectsNegativeStaticTestJSON-929125938 tempest-ProjectsNegativeStaticTestJSON-929125938-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.765994 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:36.828355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.828992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.829282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.829618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.830262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.833449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:36.863736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.sql.core [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2036518633' for key 'project.ixu_project_name_domain_id'") Sep 25 01:35:36.863736 n-d-master-1 devstack@keystone.service[81862]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 01:35:36.863736 n-d-master-1 devstack@keystone.service[81862]: [parameters: {'id': '06ddd3d09d09419cb5dd3bcaee6dee35', 'name': 'tempest-project-dup-2036518633', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 01:35:36.863736 n-d-master-1 devstack@keystone.service[81862]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81862) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2036518633, project id 06ddd3d09d09419cb5dd3bcaee6dee35.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2036518633, project id 06ddd3d09d09419cb5dd3bcaee6dee35. Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:35:36.896872 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-2036518633' for key 'project.ixu_project_name_domain_id'") Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 01:35:36.898404 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application yield resource Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application next(self.gen) Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.rollback() Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.force_reraise() Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise self.value Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 25 01:35:36.903323 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application session.commit() Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._prepare_impl() Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.session.flush() Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._flush(objects) Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application compat.raise_( Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application flush_context.execute() Sep 25 01:35:36.906027 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rec.execute(self) Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 25 01:35:36.908080 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result = self._query(query) Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application conn.query(q) Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application result.read() Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:35:36.910547 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2036518633' for key 'project.ixu_project_name_domain_id'") Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [parameters: {'id': '06ddd3d09d09419cb5dd3bcaee6dee35', 'name': 'tempest-project-dup-2036518633', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.911822 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-2036518633 at domain ID default. Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:35:36.913857 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2036518633, project id 06ddd3d09d09419cb5dd3bcaee6dee35. Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:35:36.915004 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3800/7626] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 25 01:35:36 2022] POST /identity/v3/projects => generated 285 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 25 01:35:36.915721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:36.934313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754737-f6b5-4d93-8390-f1f4aaf2d650 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:36.940098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f84ce1263d24d468a3bbd2e6cbabde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ec16e1dff04d41b6dea950ee489d01', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:36.940754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:36.941083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:36.941366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] PATH_INFO: `/v3/projects/6e5365bf05904ddcb8ccfb2197924a49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:36.942559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e5365bf05904ddcb8ccfb2197924a49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:36.944745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:37.018129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5365bf05904ddcb8ccfb2197924a49', 'request_id': 'req-e8326e84-cfc9-4aa9-a8e1-31c18d197039'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.028553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5365bf05904ddcb8ccfb2197924a49', 'request_id': 'req-e8326e84-cfc9-4aa9-a8e1-31c18d197039'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.036647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5365bf05904ddcb8ccfb2197924a49', 'request_id': 'req-e8326e84-cfc9-4aa9-a8e1-31c18d197039'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.067062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] The token cache is being invalidate because project 6e5365bf05904ddcb8ccfb2197924a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:37.067461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.068417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e8326e84-cfc9-4aa9-a8e1-31c18d197039 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.074298 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3827/7627] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:36 2022] DELETE /identity/v3/projects/6e5365bf05904ddcb8ccfb2197924a49 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:37.075973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:37.078135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:37.169551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae8bf-51c3-4f9b-b90b-e086bcb52618 tempest-ProjectsNegativeStaticTestJSON-1290900554 tempest-ProjectsNegativeStaticTestJSON-1290900554-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:37.261299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:37.262180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:37.262563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:37.262906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] PATH_INFO: `/v3/users/598a830c9555448aa8010d4bd8dd82ef` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:37.264140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598a830c9555448aa8010d4bd8dd82ef)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:37.266452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:37.320933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598a830c9555448aa8010d4bd8dd82ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.321885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598a830c9555448aa8010d4bd8dd82ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.329610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598a830c9555448aa8010d4bd8dd82ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.340711 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:37.351592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598a830c9555448aa8010d4bd8dd82ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.352732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598a830c9555448aa8010d4bd8dd82ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:37.377421 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3801/7628] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:37 2022] DELETE /identity/v3/users/598a830c9555448aa8010d4bd8dd82ef => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:37.383794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:37.384564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:37.385010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:37.417527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:37.420363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:37.507560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3828/7629] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:37.517209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:37.518777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:37.607298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8020b1-b4f3-4dc4-8e57-3cd86e119550 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:37.610989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:37.611751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:37.612031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:37.612301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:37.622367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:37.623939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:37.635213 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3802/7630] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:37.980656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:37.983179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:38.019046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbaf2-13b6-4f8c-a0da-b9f9a0e8cb68 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:38.032934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:38.035278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.036993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.038160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] PATH_INFO: `/v3/projects/98190031c1d44232a6788d8f498a18b9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.041335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98190031c1d44232a6788d8f498a18b9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:38.046959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:38.080631 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:38.176296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98190031c1d44232a6788d8f498a18b9', 'request_id': 'req-c1f41b53-18b4-4979-b499-27d14176dabd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.191204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98190031c1d44232a6788d8f498a18b9', 'request_id': 'req-c1f41b53-18b4-4979-b499-27d14176dabd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.206329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98190031c1d44232a6788d8f498a18b9', 'request_id': 'req-c1f41b53-18b4-4979-b499-27d14176dabd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.265966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] The token cache is being invalidate because project 98190031c1d44232a6788d8f498a18b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:38.266454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.267480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.270350 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3829/7631] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:37 2022] DELETE /identity/v3/projects/98190031c1d44232a6788d8f498a18b9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:38.274268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:38.287933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa06b9-388f-4fb5-a67f-8bc7a54c0114 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:38.374669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:38.375419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.375812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.376166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] PATH_INFO: `/v3/users/6f84ce1263d24d468a3bbd2e6cbabde8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.377992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f84ce1263d24d468a3bbd2e6cbabde8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:38.383308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:38.459900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:38.461350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:38.479673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f84ce1263d24d468a3bbd2e6cbabde8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.480352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f84ce1263d24d468a3bbd2e6cbabde8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.481104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41b53-18b4-4979-b499-27d14176dabd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:38.489221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f84ce1263d24d468a3bbd2e6cbabde8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.494452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:38.496067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.496634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.497851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] PATH_INFO: `/v3/users/646079702a0247898508f7ac5226e49e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.503752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646079702a0247898508f7ac5226e49e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:38.507453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:38.509305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f84ce1263d24d468a3bbd2e6cbabde8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.510724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c94b119f-a812-4c91-9b38-53939665e237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f84ce1263d24d468a3bbd2e6cbabde8'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.523630 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:38.531265 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3803/7632] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:38 2022] DELETE /identity/v3/users/6f84ce1263d24d468a3bbd2e6cbabde8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:38.589595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646079702a0247898508f7ac5226e49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.606779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646079702a0247898508f7ac5226e49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.628057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646079702a0247898508f7ac5226e49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.628860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646079702a0247898508f7ac5226e49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.629573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646079702a0247898508f7ac5226e49e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.661448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3830/7633] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:38 2022] DELETE /identity/v3/users/646079702a0247898508f7ac5226e49e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:38.664391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.664601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.664877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.708884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:38.711751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:38.812481 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3804/7634] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:38.822747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:38.824190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:38.874907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:38.876795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:38.894847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80c6b-801b-4541-ba24-007f99b0bee7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:38.904605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:38.905305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.905760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.906097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] PATH_INFO: `/v3/projects/a6ec16e1dff04d41b6dea950ee489d01` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.907199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f7b1-7e8e-4a7f-aafe-3b556d020423 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:38.907352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ec16e1dff04d41b6dea950ee489d01)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:38.909324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:38.912252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:38.913272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:38.913751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:38.914254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:38.927396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:38.929485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3585a4-c2ff-4ccd-a327-0c32dc6485a3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:38.941036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3831/7635] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:38.982709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ec16e1dff04d41b6dea950ee489d01', 'request_id': 'req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:38.989815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ec16e1dff04d41b6dea950ee489d01', 'request_id': 'req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.000462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ec16e1dff04d41b6dea950ee489d01', 'request_id': 'req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.022653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] The token cache is being invalidate because project a6ec16e1dff04d41b6dea950ee489d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:39.023240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.024433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a2a788bb-b478-4e60-ab59-90c4e71e7c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.028046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3805/7636] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:38 2022] DELETE /identity/v3/projects/a6ec16e1dff04d41b6dea950ee489d01 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:39.033379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.033901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.034252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.056336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:39.057836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.072772 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:39.141553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3832/7637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:39.148974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.149753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.150165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.165016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.167844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.188691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:39.188962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e466cc-d99b-414b-8ee5-26ed4f3651a2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.190497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.195979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.198238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.199119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.200483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] PATH_INFO: `/v3/projects/ebc395f4dead482fb8a04a0a81dfb675` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.202239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc395f4dead482fb8a04a0a81dfb675)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.206837 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3806/7638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:39.210542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.212916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.225570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245a816-8eb9-47ca-a126-b9b9f748528a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.230884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.231499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.231804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.232161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.232698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:39.233063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.235342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.253592 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3807/7639] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:39.258194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.274397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e2ff-3d4a-4d09-b55a-376e44d1d438 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.281596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc395f4dead482fb8a04a0a81dfb675', 'request_id': 'req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.289589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc395f4dead482fb8a04a0a81dfb675', 'request_id': 'req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.297577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc395f4dead482fb8a04a0a81dfb675', 'request_id': 'req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.312395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] The token cache is being invalidate because project ebc395f4dead482fb8a04a0a81dfb675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:39.312824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.313565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c780f0f6-2e55-4e33-b2ba-d5b4d1e930a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:39.315909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3833/7640] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:39 2022] DELETE /identity/v3/projects/ebc395f4dead482fb8a04a0a81dfb675 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:39.320234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726f1-2f7b-4f45-8945-a5007cadfc06 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.320519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726f1-2f7b-4f45-8945-a5007cadfc06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.320793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726f1-2f7b-4f45-8945-a5007cadfc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.342951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-168726f1-2f7b-4f45-8945-a5007cadfc06 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:39.344324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-168726f1-2f7b-4f45-8945-a5007cadfc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.351590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.352348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.352772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.353147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.353928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.356335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.369223 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:39.392751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3808/7641] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:39.396605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.399043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.437492 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3834/7642] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:39.439177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.439469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.439828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.469207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:39.469207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.515958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b31-b176-4364-8612-d5d666bdb6e6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.521546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.522863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.523251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.523541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.524183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.526465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.538761 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:39.551467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3809/7643] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:39.557542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.569983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41d169-d808-4eba-a68c-2bca7eb3c550 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.575248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.576058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.576403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.576763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.577424 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3835/7644] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:39.577554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.579150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.581324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.594156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04ed39-10a0-4963-bdda-1e4b4875c35e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.594866 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3810/7645] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:39.595741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.600183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.601685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.602197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.602654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.603513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:39.603970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.605760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.609126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918d11-17f7-4fb1-a52a-07583df4ea9f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.614665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.615272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.615556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.615916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.616914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.619401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.627795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3836/7646] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:39.632068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.632971 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3811/7647] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:39.637086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.649585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735892-e4e7-4579-ac1a-a986e798ce24 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.649920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cea35-9580-4845-87ce-70a5430ad17a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.657549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.658350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.659191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.659874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.660470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.660794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.661161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] PATH_INFO: `/v3/projects/9fe72408deff4875afa720321ea2e935/users/a47b36073c2e4efcb03cadf29f5998af/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.661563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.662292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.664980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ba3a3-ed3f-4db5-946e-5f7a9e7a55ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.682952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe72408deff4875afa720321ea2e935, user_id=a47b36073c2e4efcb03cadf29f5998af, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.687694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.704100 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3837/7648] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:39.706256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3812/7649] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:39 2022] PUT /identity/v3/projects/9fe72408deff4875afa720321ea2e935/users/a47b36073c2e4efcb03cadf29f5998af/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:39.718136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.719516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0391-6284-414f-a084-565210027d67 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.720049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0391-6284-414f-a084-565210027d67 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.720582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0391-6284-414f-a084-565210027d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.758145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-95ea0391-6284-414f-a084-565210027d67 None None] MFA Rules not processed for user `a47b36073c2e4efcb03cadf29f5998af`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:39.759832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95ea0391-6284-414f-a084-565210027d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:39.798238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f012-81bd-4f70-9a31-c038daa857c7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.845070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3838/7650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:39.849431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea0391-6284-414f-a084-565210027d67 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.852025 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:39.865272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea0391-6284-414f-a084-565210027d67 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.871132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47b36073c2e4efcb03cadf29f5998af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe72408deff4875afa720321ea2e935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.872195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.872705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.873197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.874832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.875442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.875720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.875991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.876622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.877756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3839/7651] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3 => generated 255 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:39.883097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.883356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.910175 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3813/7652] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:39 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:39.914457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.916265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c82a-9947-45d2-b3bd-5706b1e91f76 tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.925241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672cc6e-fe54-4d33-b395-1634b58e0683 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.929095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47b36073c2e4efcb03cadf29f5998af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe72408deff4875afa720321ea2e935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.930162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.930688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.930812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.931334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.931466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.931659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.931874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.932573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.934407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.948527 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3840/7653] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3 => generated 255 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:39.949368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.950523 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3814/7654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:39.954587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.963353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc058-ab02-40c5-b553-47336c497d2f tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.967216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206e80f-d5ab-46c2-8f64-b4c598ff07e5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:39.967921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b017d32-69d6-40e4-b024-1d616b3361ca tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47b36073c2e4efcb03cadf29f5998af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe72408deff4875afa720321ea2e935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.968639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017d32-69d6-40e4-b024-1d616b3361ca tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.969028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017d32-69d6-40e4-b024-1d616b3361ca tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.969425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017d32-69d6-40e4-b024-1d616b3361ca tempest-TestApiDiscovery-1995585354 tempest-TestApiDiscovery-1995585354-project] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.970868 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3841/7655] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:39.976212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:39.976379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0c367-8361-4e51-92d2-08a2212a3870 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.976785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0c367-8361-4e51-92d2-08a2212a3870 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.976941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.977082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.977340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0c367-8361-4e51-92d2-08a2212a3870 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.977476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.978003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:39.979209 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3842/7656] 10.222.0.16 () {56 vars in 895 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:35:39.982841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:39.983462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf25-01cb-4267-bd41-93b92d477fb1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:39.983843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf25-01cb-4267-bd41-93b92d477fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:39.984224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf25-01cb-4267-bd41-93b92d477fb1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:39.985614 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3843/7657] 10.222.0.16 () {56 vars in 895 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 25 01:35:39.989758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aaf25-01cb-4267-bd41-93b92d477fb1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:39.999846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3815/7658] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:40.005833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.006160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aaf25-01cb-4267-bd41-93b92d477fb1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.012362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.013105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.013413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.013714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] PATH_INFO: `/v3/users/a47b36073c2e4efcb03cadf29f5998af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.015332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47b36073c2e4efcb03cadf29f5998af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.018006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.018614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b601ac-28e4-44bf-92a0-926ac21a7bc0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.026843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.027925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.028302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.028674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] PATH_INFO: `/v3/projects/89a6e3ef7cce4c4c9ccd92d1aac36914/users/65e31af04fa644938e47831160bc582d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.050518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a6e3ef7cce4c4c9ccd92d1aac36914, user_id=65e31af04fa644938e47831160bc582d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.056136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226fbc0-aa55-4814-8067-362145aa68ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.075848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47b36073c2e4efcb03cadf29f5998af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.076405 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3816/7659] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:40 2022] PUT /identity/v3/projects/89a6e3ef7cce4c4c9ccd92d1aac36914/users/65e31af04fa644938e47831160bc582d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:40.086878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.087216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.087585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.090374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47b36073c2e4efcb03cadf29f5998af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.110123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47b36073c2e4efcb03cadf29f5998af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.111022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47b36073c2e4efcb03cadf29f5998af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.111762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-884c451b-54c9-42cc-9d9b-ecb3a4c2a0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47b36073c2e4efcb03cadf29f5998af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.114903 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:40.127924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] MFA Rules not processed for user `65e31af04fa644938e47831160bc582d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:40.129557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.145329 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3844/7660] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:39 2022] DELETE /identity/v3/users/a47b36073c2e4efcb03cadf29f5998af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:40.147147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.147334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.147580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.193584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:40.195841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.210160 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3817/7661] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:40.222700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.224328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.295411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3845/7662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:40.305519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.306301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b70830-229d-4487-860b-058f4225a7f4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.345775 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:40.376941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.376941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.376941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.377424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.392320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d0c8-74b5-40b0-b791-e10b644c5cc5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.396509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.397909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.398408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.398777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.409514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.411577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.429854 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3846/7663] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:40.448724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.450492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd623-b4dd-474b-a808-b6a71faef02b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.463521 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3818/7664] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:40.481081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.482724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.499444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751dbc3-b559-4829-9f53-addd485f9d90 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.505666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.506990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.507452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.507995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] PATH_INFO: `/v3/users/65e31af04fa644938e47831160bc582d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.509327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e31af04fa644938e47831160bc582d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.511806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.622679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e31af04fa644938e47831160bc582d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.633578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e31af04fa644938e47831160bc582d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.649553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e31af04fa644938e47831160bc582d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.650378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e31af04fa644938e47831160bc582d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.651106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e31af04fa644938e47831160bc582d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.670910 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3847/7665] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:40 2022] DELETE /identity/v3/users/65e31af04fa644938e47831160bc582d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:40.672361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.672645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.672913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.698077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:40.699768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.791667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.793195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.802112 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3819/7666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:40.814182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:40.816046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.817690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef70a8a-0aff-4403-8d97-e1a58708daa1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.828040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.828801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.828999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.829244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] PATH_INFO: `/v3/projects/9fe72408deff4875afa720321ea2e935` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.834667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe72408deff4875afa720321ea2e935)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:40.838189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:40.842070 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:40.909959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31357940-2238-44dc-b159-d43a4e16dabb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:40.910182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe72408deff4875afa720321ea2e935', 'request_id': 'req-3a422076-a58b-4f22-8115-3408a2fd30d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.919589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe72408deff4875afa720321ea2e935', 'request_id': 'req-3a422076-a58b-4f22-8115-3408a2fd30d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.927776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe72408deff4875afa720321ea2e935', 'request_id': 'req-3a422076-a58b-4f22-8115-3408a2fd30d7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.950465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] The token cache is being invalidate because project 9fe72408deff4875afa720321ea2e935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:40.950787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.952112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3a422076-a58b-4f22-8115-3408a2fd30d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:40.958536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3848/7667] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:40 2022] DELETE /identity/v3/projects/9fe72408deff4875afa720321ea2e935 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:40.959071 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:40.961196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643fc6-d889-45d0-baf5-13627eecc3de None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.961517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643fc6-d889-45d0-baf5-13627eecc3de None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.961801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1643fc6-d889-45d0-baf5-13627eecc3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.982265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:40.982933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:40.983222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:40.983498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:40.985547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:40.996289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e1643fc6-d889-45d0-baf5-13627eecc3de None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:40.998684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e1643fc6-d889-45d0-baf5-13627eecc3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.064453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.066256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.085378 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3849/7668] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:41.089739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3820/7669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:41.095798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.096096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.096377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.124670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:41.126651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.137317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3850/7670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:41.141672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.156388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361c2f-7647-4926-9ac0-3786c7d5d74f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.164561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.165185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.165627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.165910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.166572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:41.167425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.170278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.191520 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3821/7671] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:41.192642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.204536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba40858-62e0-44ad-a66f-61eb754206d9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.211232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.211873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.212386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.212886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.213575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.216223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.271448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3851/7672] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:41.273418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.290112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dc90-84a6-4bd9-8800-f74500462021 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.371339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.372002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.372221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.372499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.373131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.375110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.413397 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3822/7673] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:41.422163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.436108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a184e2-e1e7-42fc-9d45-0887a95109d4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.443466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.444270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.444560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.444840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.445655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.449911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.452172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.463991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.483685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3852/7674] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:41.484984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.492010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83d1a6-549a-49f9-97ff-16cb935f005a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.500767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.501973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.502267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.503047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] PATH_INFO: `/v3/projects/89a6e3ef7cce4c4c9ccd92d1aac36914` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.504402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a6e3ef7cce4c4c9ccd92d1aac36914)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.506368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa8987-e4fa-49f0-9bf0-71bf82ee8af1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.506503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.512312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.513208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.513965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.514477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.515446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.517766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.534197 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3853/7675] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:41.535824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.549127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e061e9-3109-4b7c-82b7-ca4a638f386d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.556224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.557200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.558464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.558959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] PATH_INFO: `/v3/projects/e3f42e944fe543519830a61ff017ad5a/users/fe146423146144e3b60c7aad5551d00a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.578043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f42e944fe543519830a61ff017ad5a, user_id=fe146423146144e3b60c7aad5551d00a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.582047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1510a-fa1f-4f20-96ce-929baa926ffb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.599036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a6e3ef7cce4c4c9ccd92d1aac36914', 'request_id': 'req-4eef6cda-85fb-4717-b9df-a56c6a571820'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:41.608834 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3854/7676] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:41 2022] PUT /identity/v3/projects/e3f42e944fe543519830a61ff017ad5a/users/fe146423146144e3b60c7aad5551d00a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:41.612465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a6e3ef7cce4c4c9ccd92d1aac36914', 'request_id': 'req-4eef6cda-85fb-4717-b9df-a56c6a571820'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:41.620271 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:41.620848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.621211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.621580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.622136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a6e3ef7cce4c4c9ccd92d1aac36914', 'request_id': 'req-4eef6cda-85fb-4717-b9df-a56c6a571820'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:41.641482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] The token cache is being invalidate because project 89a6e3ef7cce4c4c9ccd92d1aac36914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:41.641915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:41.642786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4eef6cda-85fb-4717-b9df-a56c6a571820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:41.645517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3823/7677] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:41 2022] DELETE /identity/v3/projects/89a6e3ef7cce4c4c9ccd92d1aac36914 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:41.651686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ddca5-c788-4970-9828-d2b19abc1c76 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.653857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ddca5-c788-4970-9828-d2b19abc1c76 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.653857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ddca5-c788-4970-9828-d2b19abc1c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.665061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] MFA Rules not processed for user `fe146423146144e3b60c7aad5551d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:41.666451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.672575 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:41.687378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e67ddca5-c788-4970-9828-d2b19abc1c76 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:41.688872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e67ddca5-c788-4970-9828-d2b19abc1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.754289 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3855/7678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:41.770901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.773084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.775217 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3824/7679] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:41.782842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.783194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.783545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.822191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:41.826711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:41.841912 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3825/7680] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:41.845392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.857794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887b4f-2960-4322-b387-13c58a3860e9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.862787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.863395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.863679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.863953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.864695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:41.864997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.866934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.871314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dbaf2-7ab4-4f5b-93e5-b7e8854695e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.876004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.876899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.877551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.878339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.880249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3826/7681] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:41.886477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.889459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.891174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.897912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2832e7-7f7c-4416-b4b6-c98b4741ffa1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:41.903454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:41.904421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:41.905095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:41.905672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:41.907026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:41.907914 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3856/7682] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:41.909449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:41.951105 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3827/7683] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:41.952659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:41.963803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15313-a874-464a-9bd8-3169a3fc4acf service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.053689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.054531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.054807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.055085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.055758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.057952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9368b-45ae-4dc8-a41f-4aaf8fa3f7b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.083686 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3857/7684] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:41 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:42.088165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:42.105371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44ba8-641f-49b0-a0f5-5bb5182e6228 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.109992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.110498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.110802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.119805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.122225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.122762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.123339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.124175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.126146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.134983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:42.136339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:42.140885 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3828/7685] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:42.145228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:42.158713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae1cf-4c1f-4f1e-8f38-10ff3e0ee30e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.165132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.165842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.166133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.166490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.167248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.168935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.182578 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3829/7686] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:42.183122 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:42.186756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:42.207844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb921f0-01ac-4431-8252-7b31d0d1cbfc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.220056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.222161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.222453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.222735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] PATH_INFO: `/v3/projects/2872679e43b84fa58c858a305d9859c4/users/82797b822f224d21b4b3cab42613afab/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.239945 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3858/7687] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:42.240188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2872679e43b84fa58c858a305d9859c4, user_id=82797b822f224d21b4b3cab42613afab, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.243151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbd95c-02a3-464f-842c-bf24f3929909 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.265134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3830/7688] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:42 2022] PUT /identity/v3/projects/2872679e43b84fa58c858a305d9859c4/users/82797b822f224d21b4b3cab42613afab/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:42.276373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:42.277366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.277965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.278242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.278533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:42.309313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] MFA Rules not processed for user `82797b822f224d21b4b3cab42613afab`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:42.310851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:42.374692 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:42.409208 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3831/7689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:42.416505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884ba2-ddf5-4147-bd3b-eb5eb75c79ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.426038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:42.427651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:42.499372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.500264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.500651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.501030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.508590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2102a5-2849-4b14-b514-2d8f6e9e73d1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:42.515743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:42.516361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:42.516914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:42.517191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:42.529625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.531513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9affd3-09a5-48f7-8964-b7c8a5440064 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.546922 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3832/7690] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:42.573341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:42.575888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:42.586678 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3859/7691] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:43.017498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af779d7-fbf8-483e-a947-0c041d3dff33 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:43.017900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af779d7-fbf8-483e-a947-0c041d3dff33 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:43.018351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af779d7-fbf8-483e-a947-0c041d3dff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:43.041571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0af779d7-fbf8-483e-a947-0c041d3dff33 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:43.043975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0af779d7-fbf8-483e-a947-0c041d3dff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:43.052414 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3833/7692] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:43.078798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:43.094170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3eb4-ae4d-4bf6-ad36-1192afea62c8 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:43.101217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:43.102273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:43.102746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:43.103361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:43.114748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:43.117239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:43.128694 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3860/7693] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:43.667927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61642-1371-4c6d-b809-179987176382 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:43.669657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61642-1371-4c6d-b809-179987176382 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:43.670141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61642-1371-4c6d-b809-179987176382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:43.703355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8ec61642-1371-4c6d-b809-179987176382 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:43.706191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8ec61642-1371-4c6d-b809-179987176382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:43.726224 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3834/7694] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:43.733918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:43.754756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04482-6d15-499b-bb93-24ea1251e001 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:43.762109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:43.762942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:43.763321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:43.763693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:43.777177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:43.779128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:43.795715 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3861/7695] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:44.005950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79cfa-b19c-4e05-a202-5433ed68b53b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:44.006346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79cfa-b19c-4e05-a202-5433ed68b53b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:44.006872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79cfa-b19c-4e05-a202-5433ed68b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:44.046518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8da79cfa-b19c-4e05-a202-5433ed68b53b None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:44.047741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8da79cfa-b19c-4e05-a202-5433ed68b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:44.056031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3835/7696] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:44.067846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:44.081543 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:44.096114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b3f0-d99a-45f3-9a6c-56bf04b03a0d service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:44.118958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:44.119709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:44.120007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:44.120284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:44.130101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:44.132765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:44.142986 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3862/7697] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:44.618294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:44.618860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:44.619304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:44.642776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:44.644220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:44.653581 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3836/7698] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:44.669574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:44.695167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60de45-636e-4363-94e1-f7a02aed90e9 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:44.712756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:44.713182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:44.713635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:44.713918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:44.737002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:44.738906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c52b65-6900-455d-8fbf-8352a2794bae service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:44.749228 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3863/7699] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:44.989534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:44.991772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.049964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.050189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.050460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.088991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:45.091190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.101599 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3864/7700] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:45.124896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00ca0-20b5-4558-81e2-16d7dd227630 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:45.130034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:45.131978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.132416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.133202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.136230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.137910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:45.164695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a683c8-9b82-427c-914e-49aa0425c16f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:45.172356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:45.176867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.177359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.177872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.191070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:45.193332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:45.206594 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3865/7701] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:35:45.260387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:45.262311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9d562-e7b8-4fed-af3e-7dc97edc20d7 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:45.279240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3837/7702] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:45.376191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:45.379499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.489142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dea9-dfd8-46aa-9726-46c734a2b312 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:45.495577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:45.496228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.496541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.496822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] PATH_INFO: `/v3/users/fe146423146144e3b60c7aad5551d00a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.498349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe146423146144e3b60c7aad5551d00a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:45.500282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:45.567880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe146423146144e3b60c7aad5551d00a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:45.577510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe146423146144e3b60c7aad5551d00a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:45.592341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe146423146144e3b60c7aad5551d00a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:45.593152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe146423146144e3b60c7aad5551d00a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:45.593883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe146423146144e3b60c7aad5551d00a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:45.611115 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3866/7703] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:45 2022] DELETE /identity/v3/users/fe146423146144e3b60c7aad5551d00a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:45.615748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.616399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.617069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.637324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:45.639291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.643364 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:45.708837 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3838/7704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:45.720060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:45.721626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:45.779513 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:45.810938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1facf14-ed45-42f7-9e8a-87c2e8904894 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:45.816699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:45.818222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:45.818642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:45.819168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:45.833160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:45.836035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a9761-19c6-4fd4-a6c6-578969075103 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:45.847863 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3867/7705] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:46.339534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:46.341072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:46.365134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa130-31bb-40d0-897e-71a495556ca9 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:46.379510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:46.380175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:46.380462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:46.381417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] PATH_INFO: `/v3/projects/e3f42e944fe543519830a61ff017ad5a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:46.383221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f42e944fe543519830a61ff017ad5a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:46.385178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:46.479611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f42e944fe543519830a61ff017ad5a', 'request_id': 'req-4d242809-ce1b-4caa-87ed-1ee929ff7cce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:46.489188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f42e944fe543519830a61ff017ad5a', 'request_id': 'req-4d242809-ce1b-4caa-87ed-1ee929ff7cce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:46.497167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f42e944fe543519830a61ff017ad5a', 'request_id': 'req-4d242809-ce1b-4caa-87ed-1ee929ff7cce'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:46.515712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] The token cache is being invalidate because project e3f42e944fe543519830a61ff017ad5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:46.516298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:46.517889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4d242809-ce1b-4caa-87ed-1ee929ff7cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:46.525726 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3839/7706] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:46 2022] DELETE /identity/v3/projects/e3f42e944fe543519830a61ff017ad5a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:46.527318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:46.528100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:46.528269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:46.566108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:46.567999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:46.676387 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3868/7707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:46.685068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:46.685452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:46.685988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:46.714543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:46.716231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:46.730931 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3840/7708] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:46.731377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:46.770035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26630a-4a51-477e-a1bd-fee246539b82 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:46.778706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:46.779347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:46.779626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:46.779892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:46.780646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:46.780957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:46.782714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:46.803272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3869/7709] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:46.807580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:46.831982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbdf5e-84cd-4818-bfe0-30ac0915aff0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:46.841453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:46.842375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:46.842969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:46.843553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:46.844613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:46.848390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:46.867079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:46.872044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:46.922518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3841/7710] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:46 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:46.927743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:46.994781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c186-b445-412b-a698-9c518791592d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.077125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9959f1-96b0-4994-9c93-19d7a2985ec4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.090608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.092274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.092751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.093607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.094703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.098493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.103272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.104043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.104392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.105070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.107972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:47.114452 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:47.140629 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3842/7711] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:46 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:47.140849 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:47.150462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:47.165396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768522c-2942-40a4-8680-1f9c1c6a652b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.175406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.176140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.177345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.178445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.186903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.192980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.215802 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3843/7712] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:47.219535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:47.236240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0c7d-60ae-4a3a-871d-e4baf7e40e2a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.244452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.245347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.245709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.246048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.248128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.250491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.266351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.268462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12911386-59ac-4f1c-928e-0f5bf3a60d82 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.283765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3844/7713] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:47.287229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:47.300671 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3870/7714] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:35:47.303656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964704ca-9a45-466b-aaf0-4386df6515cf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.312611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.313304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.313619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.313897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] PATH_INFO: `/v3/projects/a71239154821473791d4430460070484/users/4d8ef30ecbdb4f7e9e65b966a4d233cc/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.345205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71239154821473791d4430460070484, user_id=4d8ef30ecbdb4f7e9e65b966a4d233cc, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.348710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.377116 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3845/7715] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:47 2022] PUT /identity/v3/projects/a71239154821473791d4430460070484/users/4d8ef30ecbdb4f7e9e65b966a4d233cc/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:47.389504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.390165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.390728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.462467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] MFA Rules not processed for user `4d8ef30ecbdb4f7e9e65b966a4d233cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:47.463697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:47.626792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3871/7716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:47.627591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:47.738182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fbaf-6dfa-4665-a7ca-608f20720343 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.749892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.751247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.751958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.752495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.754022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.756422 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:47.808759 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3846/7717] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:47 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:47.812793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:47.829071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5813-b059-49eb-b03b-75d3a8b9f3e4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:47.972101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:47.972992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:47.973514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:47.973946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:47.974945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:47.978298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.011448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3872/7718] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:47 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:48.016150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:48.048011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db093-a3d2-4efc-a8e0-523126564a19 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:48.062960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:48.063609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.063889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.066373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.067914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:48.074977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.092173 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3847/7719] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:48.096046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:48.111156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6b28-805a-44b0-83fa-7b171ab4566f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:48.124974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:48.125684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.125967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.126278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] PATH_INFO: `/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27/users/ff90b086f76148b8aac320b402057ffe/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.158890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ea94da8fe74dc1ba8d32866a31ab27, user_id=ff90b086f76148b8aac320b402057ffe, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:48.178897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.199802 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3873/7720] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:48 2022] PUT /identity/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27/users/ff90b086f76148b8aac320b402057ffe/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:48.203775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:48.216712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755163d0-ff27-4bf5-8732-54c7a7abf7e3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:48.338079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:48.338703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.338981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.339249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.339891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:48.342293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04071fdd-d0ef-4559-97e2-2ef6f471b5d2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.366499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3848/7721] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:48.367321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:48.374549 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:48.379424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04da90-6a3b-4946-8a24-bd9c5eddeebd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:48.391293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:48.391877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.392169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.392600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] PATH_INFO: `/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27/users/ff90b086f76148b8aac320b402057ffe/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.395173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ea94da8fe74dc1ba8d32866a31ab27, user_id=ff90b086f76148b8aac320b402057ffe, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:48.398243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.426456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3874/7722] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:48 2022] PUT /identity/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27/users/ff90b086f76148b8aac320b402057ffe/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:48.430918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.431844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.432225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.466598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] MFA Rules not processed for user `ff90b086f76148b8aac320b402057ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:48.468229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:48.474347 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:48.599048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3849/7723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:48.600062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:48.602287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:48.715281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ab28-e35b-4847-9067-26db51d04de2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:48.722249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:48.723180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:48.723564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:48.724196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:48.735891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:48.737618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:48.750458 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3875/7724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:51.961385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:51.983260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffbb70-212b-4d86-8bc2-2faff32ef4f7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:51.997836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:51.998864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:51.999319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:51.999751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:52.094623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:52.096196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:52.123408 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3850/7725] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:53.229853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:53.356787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704570-071a-4b38-a049-5363b3cc9013 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:53.370009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:53.370776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.371137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.373144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] PATH_INFO: `/v3/users/4d8ef30ecbdb4f7e9e65b966a4d233cc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.376337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8ef30ecbdb4f7e9e65b966a4d233cc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:53.385445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:53.449683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:53.451208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:53.474153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b22e-6fdf-4e61-8231-b6c397605883 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:53.479359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:53.480279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.480889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.481014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8ef30ecbdb4f7e9e65b966a4d233cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.481543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] PATH_INFO: `/v3/users/82797b822f224d21b4b3cab42613afab` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.482887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82797b822f224d21b4b3cab42613afab)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:53.485199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:53.498966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8ef30ecbdb4f7e9e65b966a4d233cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.539427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8ef30ecbdb4f7e9e65b966a4d233cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.542097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8ef30ecbdb4f7e9e65b966a4d233cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.542892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8fe3ef9c-e74f-4064-ad90-5b348c07a9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8ef30ecbdb4f7e9e65b966a4d233cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.558135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82797b822f224d21b4b3cab42613afab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.559060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82797b822f224d21b4b3cab42613afab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.571466 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3876/7726] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:53 2022] DELETE /identity/v3/users/4d8ef30ecbdb4f7e9e65b966a4d233cc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:53.576569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.578086 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.578608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.592024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82797b822f224d21b4b3cab42613afab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.614626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:53.617370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:53.635352 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:53.650062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82797b822f224d21b4b3cab42613afab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.651651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-eb2b6f30-25b0-46da-b6c9-b4e079c55907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82797b822f224d21b4b3cab42613afab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:53.685209 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3851/7727] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:53 2022] DELETE /identity/v3/users/82797b822f224d21b4b3cab42613afab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:53.690084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.690607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.690953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.742503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:53.744116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:53.757598 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:53.759553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3877/7728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:53.770332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:53.772712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:53.846633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3852/7729] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:53.856757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:53.858192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:53.885147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf18a-533e-4f34-9c90-19fcaaafbc6e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:53.928913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2f38-0cef-4e73-97db-b36d6f0c3b8b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:53.933038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:53.933908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.935820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.936109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.945427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:53.946316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:53.946671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:53.947679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:53.952827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:53.955070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:53.958601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:53.960480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:53.971825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3853/7730] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:53.985504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3878/7731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:54.340169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.355755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.425510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b1900-ae5c-4a4c-b69a-54dae26cf679 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:54.433937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:54.434672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.435781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.436190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] PATH_INFO: `/v3/projects/2872679e43b84fa58c858a305d9859c4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.437618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2872679e43b84fa58c858a305d9859c4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:54.440204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:54.491565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.494310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.516584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d076-3901-40d1-a9c0-dce8e7e2fbe8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:54.522942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:54.524000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.524458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.525358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] PATH_INFO: `/v3/projects/a71239154821473791d4430460070484` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.527463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71239154821473791d4430460070484)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:54.531782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:54.544482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2872679e43b84fa58c858a305d9859c4', 'request_id': 'req-fdaffd60-6996-4993-8121-038784a833a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.554828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2872679e43b84fa58c858a305d9859c4', 'request_id': 'req-fdaffd60-6996-4993-8121-038784a833a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.561318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2872679e43b84fa58c858a305d9859c4', 'request_id': 'req-fdaffd60-6996-4993-8121-038784a833a4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.578190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] The token cache is being invalidate because project 2872679e43b84fa58c858a305d9859c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:54.579896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.581171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-fdaffd60-6996-4993-8121-038784a833a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.583332 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3854/7732] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:54 2022] DELETE /identity/v3/projects/2872679e43b84fa58c858a305d9859c4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:54.588783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef88bf-3bbd-450a-ad7b-d0b15e5af707 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.589114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef88bf-3bbd-450a-ad7b-d0b15e5af707 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.589500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef88bf-3bbd-450a-ad7b-d0b15e5af707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.612497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-76ef88bf-3bbd-450a-ad7b-d0b15e5af707 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:54.613479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71239154821473791d4430460070484', 'request_id': 'req-729b54c0-4abf-406f-b88a-d81a9b07788b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.613764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-76ef88bf-3bbd-450a-ad7b-d0b15e5af707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.622607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71239154821473791d4430460070484', 'request_id': 'req-729b54c0-4abf-406f-b88a-d81a9b07788b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.666612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71239154821473791d4430460070484', 'request_id': 'req-729b54c0-4abf-406f-b88a-d81a9b07788b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.678431 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:54.686389 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:54.698489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] The token cache is being invalidate because project a71239154821473791d4430460070484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:54.699078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.702366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.704142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3879/7733] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:54 2022] DELETE /identity/v3/projects/a71239154821473791d4430460070484 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:54.708400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.713723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.749978 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3855/7734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:54.759097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.759660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.760140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.789265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:54.790921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.806043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3856/7735] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:54.809181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.827275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3a2c-0d49-4221-8731-c1208c3a7795 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:54.832341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:54.833126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.833428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.833820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.834529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:54.836307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:54.837378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b54c0-4abf-406f-b88a-d81a9b07788b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:54.844286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:54.845014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.845598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.845944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] PATH_INFO: `/v3/users/ff90b086f76148b8aac320b402057ffe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.847209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff90b086f76148b8aac320b402057ffe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:54.849609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:54.855531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:54.872968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3857/7736] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:35:54.877643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.890394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd62-2097-47d4-ac91-01a40dfd7437 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:54.905775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:54.906393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:54.906670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:54.906938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:54.908055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:54.910608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:54.934444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff90b086f76148b8aac320b402057ffe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.944559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff90b086f76148b8aac320b402057ffe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.960129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff90b086f76148b8aac320b402057ffe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.961113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff90b086f76148b8aac320b402057ffe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.962257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff90b086f76148b8aac320b402057ffe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:54.981000 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3880/7737] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:54 2022] DELETE /identity/v3/users/ff90b086f76148b8aac320b402057ffe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:54.982379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.986000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:54.989958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3858/7738] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:54 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:54.994841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:54.996505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:55.069349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafae8d-789b-46c6-976b-1ca3544c0392 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.083690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72908035-93d3-4a3f-b8fb-2c5c002d4ea9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.089434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.090090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.090460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.091571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.092230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.094341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.138397 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:55.168246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3859/7739] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:54 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:55.170122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.170849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.171267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.171267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.174119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:55.187399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:55.199075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c044-7c3c-4ca3-be7e-ee1ec853ca8b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.217034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.217830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.218208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.218574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.219335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.221162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.253609 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3860/7740] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:55.256098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:55.279278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fbc42-a5ad-4e5d-a9ff-e4d9519cfb28 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.290627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.291414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.292598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.292986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.293973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.296495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.318518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3861/7741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:55.320048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:55.336094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.337593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f71f95-aa8a-4f98-b064-24c40e45b992 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.338505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7dbd-c588-4106-a90e-f48663b6bbb5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.344956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.346239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.346531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.347110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] PATH_INFO: `/v3/projects/9afec3107f204188981219ba5ecfebd4/users/b79499a13e8a4e288cf6fbfc2c594e6c/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.363375 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3881/7742] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:55.377569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afec3107f204188981219ba5ecfebd4, user_id=b79499a13e8a4e288cf6fbfc2c594e6c, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.381165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.417375 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3862/7743] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:55 2022] PUT /identity/v3/projects/9afec3107f204188981219ba5ecfebd4/users/b79499a13e8a4e288cf6fbfc2c594e6c/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:55.419128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.425156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.425578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.450918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:55.452990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:55.548266 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3882/7744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:55.559599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:55.561506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:55.658274 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:55.680463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75297e-5c47-4209-93a5-4f1403d08f84 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.685763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.686481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.686939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.687491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.701715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.701980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374b8c-32d2-4666-9301-2cd896b7e324 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.726460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:55.727908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:55.742311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e2d5-1a01-43af-aea6-e306b7ecc2e5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:55.742682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3863/7745] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:55.748513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:55.749177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.749500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.749778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] PATH_INFO: `/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.750983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ea94da8fe74dc1ba8d32866a31ab27)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:55.756170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:55.860375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ea94da8fe74dc1ba8d32866a31ab27', 'request_id': 'req-5034441f-3044-411c-8469-ab5dc5df623f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:55.872774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ea94da8fe74dc1ba8d32866a31ab27', 'request_id': 'req-5034441f-3044-411c-8469-ab5dc5df623f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:55.894994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ea94da8fe74dc1ba8d32866a31ab27', 'request_id': 'req-5034441f-3044-411c-8469-ab5dc5df623f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:55.904152 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:55.920109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] The token cache is being invalidate because project 95ea94da8fe74dc1ba8d32866a31ab27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:55.920405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:55.923399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5034441f-3044-411c-8469-ab5dc5df623f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:55.933867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3883/7746] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:55 2022] DELETE /identity/v3/projects/95ea94da8fe74dc1ba8d32866a31ab27 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:55.935303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:55.935576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:55.935909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:55.970184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:55.972378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:56.125568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3864/7747] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:56.128849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.129360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.129676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.154199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:56.155022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:56.170222 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3884/7748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:35:56.171146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.182384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15516bf6-e736-4834-b4f3-cce635fc95ae None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.187389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.188011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.188294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.188576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.189261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:56.189618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.191245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.205808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3865/7749] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:56.210987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.235992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd2cc-f86b-43f0-91a9-c16186cea922 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.250544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.251175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.251454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.251727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.252361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.254312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.325210 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3885/7750] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:56 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:56.331058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.350913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc4cf-fa93-4680-8315-2aba4efaa9d4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.435045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.435755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.436128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.436474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.437213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.439287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.464595 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3866/7751] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:56 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:56.468838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.480405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaece28-3ee7-4a02-94a0-39713d69b6f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.487118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.487860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.488262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.488637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.489448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.491812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.505504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3886/7752] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:56.507402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.518741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a4796-5328-476c-9b7d-a1ef047ffe9e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.525788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.526413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.526699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.526972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.528325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.529775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c95d-10c9-477c-adb2-d2a2413b9aeb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.551518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.552046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3867/7753] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:56.564656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aedcc0-d51d-4b05-85dd-5adb161185aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.570614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.571383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.571667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.571938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] PATH_INFO: `/v3/projects/068f771d7749497bafa81c4fc9250c94/users/fafbd20ec319447ab6278711690c6b1b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.593088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f771d7749497bafa81c4fc9250c94, user_id=fafbd20ec319447ab6278711690c6b1b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.596911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.619714 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3887/7754] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:56 2022] PUT /identity/v3/projects/068f771d7749497bafa81c4fc9250c94/users/fafbd20ec319447ab6278711690c6b1b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:56.631914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48a78-f91e-45f6-9308-dc74dd07e906 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.632540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48a78-f91e-45f6-9308-dc74dd07e906 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.632540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48a78-f91e-45f6-9308-dc74dd07e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.663385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-12b48a78-f91e-45f6-9308-dc74dd07e906 None None] MFA Rules not processed for user `fafbd20ec319447ab6278711690c6b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:56.664725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-12b48a78-f91e-45f6-9308-dc74dd07e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:56.708844 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:56.754377 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3868/7755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:56.758084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:56.762099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:56.846896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1c60f-4edf-4a4d-9d73-4db320eba127 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:56.853722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:56.854686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:56.855126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:56.855606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:56.882029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:56.883868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:56.905668 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3888/7756] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:35:57.350667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:57.351039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:57.351322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:57.432650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] MFA Rules not processed for user `b79499a13e8a4e288cf6fbfc2c594e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:57.438935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:57.485162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:57.585810 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3869/7757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:57.586788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:57.587411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7d38-1f69-47a0-a307-e99be6aad602 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:57.588304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:57.596354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:57.597498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:57.598676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:57.599132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] PATH_INFO: `/v3/users/fafbd20ec319447ab6278711690c6b1b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:57.601683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafbd20ec319447ab6278711690c6b1b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:57.604380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:57.605926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b0bbd-2b1a-490e-905d-b9e0acbc30a7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:57.614107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:57.614352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:57.614512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:57.615891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:57.617111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:57.623918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:57.664851 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:57.676824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafbd20ec319447ab6278711690c6b1b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:57.692395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafbd20ec319447ab6278711690c6b1b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:57.695030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3870/7758] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:57 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:57.704570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:57.721084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafbd20ec319447ab6278711690c6b1b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:57.722257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafbd20ec319447ab6278711690c6b1b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:57.722622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e42f1ffe-fcfa-4723-a3f0-0f34d740aa7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafbd20ec319447ab6278711690c6b1b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:57.743708 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3889/7759] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:35:57 2022] DELETE /identity/v3/users/fafbd20ec319447ab6278711690c6b1b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:57.748666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:57.749803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:57.750363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:57.784999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:57.786711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:57.862487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e803e-1f0e-47ba-a841-79aaf1148e4a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:57.958437 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3890/7760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:57.971824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:57.973462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:57.981293 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:58.017391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.018137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.018534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.018901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.022132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.024792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.074483 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3871/7761] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:57 2022] POST /identity/v3/users => generated 309 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:58.077613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b875fc-2e41-4307-a10e-aeaf45a4fcb5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:58.078411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:58.081950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.082577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.082730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:58.082852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.083147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.101243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.101243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.107960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3891/7762] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:35:58.110718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8e56-8af5-4559-a865-e6cbdd1c49ab admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:58.129304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.130352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.130692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.131145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.132317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.135525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.160416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:58.160946 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3872/7763] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:58.179789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b392-7103-4467-bb4d-c6afc2c337db service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:58.190753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.191445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.192370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.192596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] PATH_INFO: `/v3/projects/a29a83d48080436686e2cfefe5ae731c/users/81c33ed957da44eaaeb13afabf774bb4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.237237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a83d48080436686e2cfefe5ae731c, user_id=81c33ed957da44eaaeb13afabf774bb4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.239932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.276644 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3892/7764] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:58 2022] PUT /identity/v3/projects/a29a83d48080436686e2cfefe5ae731c/users/81c33ed957da44eaaeb13afabf774bb4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:58.277997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:58.294993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454036-cfed-4998-89b8-1ce825c6771c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:58.467313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.468727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.469204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.469713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.470761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.473007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.487627 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3873/7765] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:35:58.491903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:58.504843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9311de-1463-4668-8e0e-6bf5c350bf02 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:58.510005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:58.510813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:58.511200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:58.511580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] PATH_INFO: `/v3/projects/a29a83d48080436686e2cfefe5ae731c/users/81c33ed957da44eaaeb13afabf774bb4/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:58.514159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a83d48080436686e2cfefe5ae731c, user_id=81c33ed957da44eaaeb13afabf774bb4, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:58.517606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4277-dd85-4ce9-8b25-637ed89357b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:58.536179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3893/7766] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:35:58 2022] PUT /identity/v3/projects/a29a83d48080436686e2cfefe5ae731c/users/81c33ed957da44eaaeb13afabf774bb4/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:35:58.864521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:58.868421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:58.931694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81194-3e16-469c-85c4-564db2ec14bd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.079332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.080960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.082408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.083272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] PATH_INFO: `/v3/projects/068f771d7749497bafa81c4fc9250c94` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.085796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=068f771d7749497bafa81c4fc9250c94)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:59.088912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:59.184570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068f771d7749497bafa81c4fc9250c94', 'request_id': 'req-d1abfe04-79af-465f-991d-413aa9cea4fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:59.198790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068f771d7749497bafa81c4fc9250c94', 'request_id': 'req-d1abfe04-79af-465f-991d-413aa9cea4fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:59.214701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068f771d7749497bafa81c4fc9250c94', 'request_id': 'req-d1abfe04-79af-465f-991d-413aa9cea4fc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:59.234456 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:59.240013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] The token cache is being invalidate because project 068f771d7749497bafa81c4fc9250c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:35:59.241039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:59.243307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1abfe04-79af-465f-991d-413aa9cea4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:35:59.248466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3874/7767] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:35:58 2022] DELETE /identity/v3/projects/068f771d7749497bafa81c4fc9250c94 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:35:59.250665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.251183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.251296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.299655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:59.305980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:59.393601 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:59.537798 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3894/7768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:59.545269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.545755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.546203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.578287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:35:59.580760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:35:59.591922 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3875/7769] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:35:59.597045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:59.621789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933b05-2fea-4ae2-8bfc-6a536b45eb41 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.628008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.629723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.630133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.630526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.631663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:35:59.632190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:59.634608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:59.652067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3895/7770] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:35:59.656689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:59.668251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3402d-dbf3-4592-8282-523862d32bc7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.673266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.674051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.674405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.674792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.675488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:59.678068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:59.731937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:59.733261 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3876/7771] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:35:59 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:35:59.756099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31447f8-9243-4727-85cd-4ef5312194b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.851559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.852435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.852725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.853134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.854126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:59.856674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:59.887959 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3896/7772] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:35:59 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:35:59.891822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:59.916421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abe04b-9fb1-4891-9927-569c665e12f5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.925953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.926889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.927325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.927952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.929189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:35:59.931071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64cef6-c2d9-476a-853c-2a144f1b0a4b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:35:59.944900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3877/7773] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:35:59.949067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:35:59.980899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d357b4-6d5a-4805-8d4c-551f2c53aa44 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:35:59.993330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.993932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.994391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:35:59.995884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:35:59.996580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:35:59.997240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:35:59.997976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:00.002230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:00.008645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:00.057456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3897/7774] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:00.058653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:00.059603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] MFA Rules not processed for user `81c33ed957da44eaaeb13afabf774bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:00.060927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:00.072832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ac1-69a8-4759-9664-76d5db43f866 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:00.080486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:00.081718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:00.082614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:00.083098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] PATH_INFO: `/v3/projects/092b065d83444235a92697d053e2615c/users/978050f13c1f43169ebece06e16a1a82/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:00.111112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092b065d83444235a92697d053e2615c, user_id=978050f13c1f43169ebece06e16a1a82, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:00.115452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad59f4-6f0c-4d8d-a137-dc9d57190516 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:00.156400 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3898/7775] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:00 2022] PUT /identity/v3/projects/092b065d83444235a92697d053e2615c/users/978050f13c1f43169ebece06e16a1a82/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:00.158067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:00.158360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:00.158636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:00.200570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3878/7776] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:00.239250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] MFA Rules not processed for user `978050f13c1f43169ebece06e16a1a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:00.241919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:00.335975 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:00.399188 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3899/7777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:00.413836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:00.415874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:00.534197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc816f-a97d-4014-bd72-7ef5d94b0430 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:00.598071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:00.598839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:00.599198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:00.599683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:00.622968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:00.626567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895928b7-1390-4762-a4cc-3981befed7df service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:00.647830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3879/7778] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:02.104200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:02.107231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:02.225416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eff85-16e3-4f50-aff4-2d48a2aebf34 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:02.231924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:02.233597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:02.234472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:02.234763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] PATH_INFO: `/v3/users/b79499a13e8a4e288cf6fbfc2c594e6c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:02.235969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79499a13e8a4e288cf6fbfc2c594e6c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:02.238033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:02.304351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79499a13e8a4e288cf6fbfc2c594e6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:02.312962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79499a13e8a4e288cf6fbfc2c594e6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:02.329679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79499a13e8a4e288cf6fbfc2c594e6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:02.330473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79499a13e8a4e288cf6fbfc2c594e6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:02.331248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79499a13e8a4e288cf6fbfc2c594e6c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:02.349206 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3900/7779] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:02 2022] DELETE /identity/v3/users/b79499a13e8a4e288cf6fbfc2c594e6c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:02.654287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:02.654788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:02.655999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:02.663616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:02.665595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:02.679142 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:02.726730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] MFA Rules not processed for user `0f8c7f57af21464684837dcce49d4d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:02.747120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:02.852124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc43e1d-3711-4824-a185-4a30b607c7ef admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:02.861331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:02.867178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:02.867678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:02.872750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] PATH_INFO: `/v3/projects/9afec3107f204188981219ba5ecfebd4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:02.872968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3880/7780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:02.874225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afec3107f204188981219ba5ecfebd4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:02.876646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:02.898808 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:03.014663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afec3107f204188981219ba5ecfebd4', 'request_id': 'req-559f25e6-ba7c-4df4-b106-3b5f107c1e05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.041603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afec3107f204188981219ba5ecfebd4', 'request_id': 'req-559f25e6-ba7c-4df4-b106-3b5f107c1e05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.049253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afec3107f204188981219ba5ecfebd4', 'request_id': 'req-559f25e6-ba7c-4df4-b106-3b5f107c1e05'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.074916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] The token cache is being invalidate because project 9afec3107f204188981219ba5ecfebd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:03.075403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.077817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.084591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3901/7781] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:02 2022] DELETE /identity/v3/projects/9afec3107f204188981219ba5ecfebd4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:03.088289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:03.119945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf115db-4914-4ed5-82bf-705d97c20a06 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:03.258270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:03.258825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:03.259162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:03.259445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] PATH_INFO: `/v3/users/81c33ed957da44eaaeb13afabf774bb4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:03.261008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c33ed957da44eaaeb13afabf774bb4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:03.263060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:03.409629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c33ed957da44eaaeb13afabf774bb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.410759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c33ed957da44eaaeb13afabf774bb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.441266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c33ed957da44eaaeb13afabf774bb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.481714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c33ed957da44eaaeb13afabf774bb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.484217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ea519227-31a5-4be4-8f3d-1617f19d82c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c33ed957da44eaaeb13afabf774bb4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:03.512152 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3881/7782] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:03 2022] DELETE /identity/v3/users/81c33ed957da44eaaeb13afabf774bb4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:03.970417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:03.972188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:04.006556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f25e6-ba7c-4df4-b106-3b5f107c1e05 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:04.122848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:04.125230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.126547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.126835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] PATH_INFO: `/v3/projects/a29a83d48080436686e2cfefe5ae731c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.148924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29a83d48080436686e2cfefe5ae731c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:04.155250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:04.233491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29a83d48080436686e2cfefe5ae731c', 'request_id': 'req-c6604fdd-0000-4ca6-94ff-e17a84c8053b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:04.242979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29a83d48080436686e2cfefe5ae731c', 'request_id': 'req-c6604fdd-0000-4ca6-94ff-e17a84c8053b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:04.251840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29a83d48080436686e2cfefe5ae731c', 'request_id': 'req-c6604fdd-0000-4ca6-94ff-e17a84c8053b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:04.302424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] The token cache is being invalidate because project a29a83d48080436686e2cfefe5ae731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:04.303018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:04.304102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6604fdd-0000-4ca6-94ff-e17a84c8053b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:04.305970 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3902/7783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:03 2022] DELETE /identity/v3/projects/a29a83d48080436686e2cfefe5ae731c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:04.310553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.311011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.311240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.337339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:04.339142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:04.379630 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:04.442646 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3882/7784] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:04.442892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.443172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.443434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.483174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:04.484562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:04.511152 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3903/7785] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:36:04.513011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:04.546840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d719f-2765-49cc-8924-b6ba1b3b0a77 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:04.559978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:04.560761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.561152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.561561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.562336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:04.562745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:04.564793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:04.607240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3883/7786] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:36:04.607569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:04.618653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02146cd-ca8b-435c-b2e3-f747dec7d2a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:04.635493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:04.636563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.636996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.637442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.638349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:04.640955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:04.715381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:04.724127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3904/7787] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:04 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:36:04.728290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee35a-2839-45b3-8d88-ed7f17f656c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:04.895032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:04.896002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.897053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.897570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.898411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:04.900784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:04.935185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:04.937862 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3884/7788] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:04 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:04.946042 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:04.958321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6e3e2-7e68-4265-9ccd-da01675e9c31 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:04.965852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:04.966760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:04.967287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:04.967783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:04.968752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:04.970839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:04.985141 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3905/7789] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:04.989384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.003596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149434-78ba-413e-adaa-7deacd94bce0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.010515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.011829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.012305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.013465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.014354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.016002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05564d0-a169-4c2c-8ade-247c03d895a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.028891 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3885/7790] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:05.033818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.045337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad79e-0f1e-4767-a39f-27c7356277fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.050754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.051458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.051744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.053243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] PATH_INFO: `/v3/projects/ab439506be91406c9834030cc02a3ff6/users/5bb4065705374263866557d41a604d65/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.072961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab439506be91406c9834030cc02a3ff6, user_id=5bb4065705374263866557d41a604d65, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.075937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.097593 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3906/7791] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:05 2022] PUT /identity/v3/projects/ab439506be91406c9834030cc02a3ff6/users/5bb4065705374263866557d41a604d65/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:05.109083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.109395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.109702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.144775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] MFA Rules not processed for user `5bb4065705374263866557d41a604d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:05.144775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:05.266358 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3886/7792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:05.270844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.437555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424a05-a44b-4a39-97b6-06f81a2bc4ad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.459656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.460846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.460960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.461206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.461891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.464414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.504169 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3907/7793] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:05 2022] POST /identity/v3/projects => generated 363 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:05.507991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.523306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321eb93-ded8-440e-880f-47f63f8be923 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.553216 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:05.598070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.598693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.598968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.599777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.600477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.602443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.626119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3887/7794] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:05 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:36:05.631067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.643082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad949a-d71d-4d64-aec6-2da94241b0fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.650738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.651666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.652236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.652556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.653611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.655225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.668353 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3908/7795] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:36:05.672027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.694077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cebcb-f60c-4f0a-882e-7c851a5743ea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.707749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.708711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.709099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.709518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] PATH_INFO: `/v3/projects/9ea0d00c14e248fca119562f5061920a/users/d0dbde6b483247b4999d7927bd633b11/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.728678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea0d00c14e248fca119562f5061920a, user_id=d0dbde6b483247b4999d7927bd633b11, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.731814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.749439 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3888/7796] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:05 2022] PUT /identity/v3/projects/9ea0d00c14e248fca119562f5061920a/users/d0dbde6b483247b4999d7927bd633b11/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:05.751427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.764074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471112-1c09-4f50-bd83-2bd981e321f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.877151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.878149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.878455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.878795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.879879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.883237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580e7d-0d24-4c55-8133-3480fcadef6b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.899488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3909/7797] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:05.903691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:05.923788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff5aa7-3ac6-4233-9930-a59f8b214f54 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:05.930127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:05.930815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.931107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.931384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] PATH_INFO: `/v3/projects/9ea0d00c14e248fca119562f5061920a/users/d0dbde6b483247b4999d7927bd633b11/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:05.944479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea0d00c14e248fca119562f5061920a, user_id=d0dbde6b483247b4999d7927bd633b11, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:05.945267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:05.964174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3889/7798] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:05 2022] PUT /identity/v3/projects/9ea0d00c14e248fca119562f5061920a/users/d0dbde6b483247b4999d7927bd633b11/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:05.975791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:05.976330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:05.976330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:06.024235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] MFA Rules not processed for user `d0dbde6b483247b4999d7927bd633b11`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:06.025660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:06.080654 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:06.170509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3910/7799] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:06.182564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:06.186742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:06.262233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bc8eb-dcf2-4486-9df6-dd49d49cd8cb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:06.265981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:06.266924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:06.267202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:06.267474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:06.280296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:06.282107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc919e-522b-4a77-b80f-ae5376d2b55b service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:06.294959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3890/7800] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:07.031062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:07.192600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37928-c785-44e1-9d1f-d2151d3867e3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:07.205463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:07.206552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:07.207109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:07.208020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] PATH_INFO: `/v3/users/5bb4065705374263866557d41a604d65` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:07.211381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb4065705374263866557d41a604d65)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:07.214100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:07.323720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb4065705374263866557d41a604d65'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:07.344865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb4065705374263866557d41a604d65'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:07.370940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb4065705374263866557d41a604d65'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:07.372161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb4065705374263866557d41a604d65'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:07.372896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb4065705374263866557d41a604d65'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:07.391406 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3911/7801] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:07 2022] DELETE /identity/v3/users/5bb4065705374263866557d41a604d65 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:07.398050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:07.399351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:07.399886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:07.429786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:07.448678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:07.583048 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3891/7802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:07.612575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:07.613332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:07.713819 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:07.737801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0a24-2ff7-4c7d-9c26-0b7063137bdb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:07.742493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:07.743184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:07.743474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:07.743752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:07.755391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:07.758927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:07.770227 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3912/7803] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:08.644339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:08.646123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:08.667025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c6f82-14cf-4a1d-b8b1-a64d5f2d1d12 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:08.687396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:08.688133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:08.688455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:08.690046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] PATH_INFO: `/v3/projects/ab439506be91406c9834030cc02a3ff6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:08.691613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab439506be91406c9834030cc02a3ff6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:08.698907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:08.747163 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:08.802446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab439506be91406c9834030cc02a3ff6', 'request_id': 'req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:08.810338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab439506be91406c9834030cc02a3ff6', 'request_id': 'req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:08.817022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab439506be91406c9834030cc02a3ff6', 'request_id': 'req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:08.858633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] The token cache is being invalidate because project ab439506be91406c9834030cc02a3ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:08.860905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:08.862353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:08.867195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3892/7804] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:08 2022] DELETE /identity/v3/projects/ab439506be91406c9834030cc02a3ff6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:08.888810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:08.904885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38ff0-4f7d-406f-b038-bccca6ad612c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:09.009954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:09.010620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:09.010949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:09.011434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] PATH_INFO: `/v3/users/d0dbde6b483247b4999d7927bd633b11` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:09.012882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0dbde6b483247b4999d7927bd633b11)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:09.015234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:09.097758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0dbde6b483247b4999d7927bd633b11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:09.112769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0dbde6b483247b4999d7927bd633b11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:09.136919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0dbde6b483247b4999d7927bd633b11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:09.137722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0dbde6b483247b4999d7927bd633b11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:09.138350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0d0a3f2-896b-4923-87f2-313d04fc6e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0dbde6b483247b4999d7927bd633b11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:09.165215 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3913/7805] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:08 2022] DELETE /identity/v3/users/d0dbde6b483247b4999d7927bd633b11 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:09.935053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:09.936507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:09.971053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89ff-c1dc-4578-abe1-34275e94f3b9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:10.064489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:10.065284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.065660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.066002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] PATH_INFO: `/v3/projects/9ea0d00c14e248fca119562f5061920a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.067424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea0d00c14e248fca119562f5061920a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:10.072195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:10.177181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea0d00c14e248fca119562f5061920a', 'request_id': 'req-338fc7d5-7288-4212-a8e6-de736e1788d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:10.186857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea0d00c14e248fca119562f5061920a', 'request_id': 'req-338fc7d5-7288-4212-a8e6-de736e1788d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:10.197397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea0d00c14e248fca119562f5061920a', 'request_id': 'req-338fc7d5-7288-4212-a8e6-de736e1788d4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:10.237772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] The token cache is being invalidate because project 9ea0d00c14e248fca119562f5061920a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:10.238071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:10.241933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-338fc7d5-7288-4212-a8e6-de736e1788d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:10.247229 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3893/7806] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:09 2022] DELETE /identity/v3/projects/9ea0d00c14e248fca119562f5061920a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:10.251425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.251880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.251992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.295876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:10.299444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:10.453374 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3914/7807] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:10.457876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.458168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.458445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.512351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:10.513516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:10.537372 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3894/7808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:10.541544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:10.547745 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:10.554037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c20a1-d746-4c46-a333-31c24daef3e1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:10.562533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:10.563423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.563892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.564335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.565152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:10.565671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:10.568446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:10.598192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3915/7809] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:36:10.600677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:10.618307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab053-dcc0-4081-be6d-9cc8af9ccb42 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:10.634075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:10.634729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.635012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.635285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.635939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:10.640176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:10.712172 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3895/7810] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:10 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:10.715413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:10.733736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e784c-7d78-48f8-b13a-6c3b883b6851 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:10.895244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:10.895878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.896849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.897135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.897812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:10.899775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:10.947855 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3916/7811] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:10 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:10.952123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:10.963553 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:10.968211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e5243-9295-4681-bf6b-cd43abfef955 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:10.986128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:10.986412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:10.986698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:10.987069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:10.987920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:10.994398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.020256 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3896/7812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:11.025298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.068614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222286-0d55-48c4-a835-961f3b305a02 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.078594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.079237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.079521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.079801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.080466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.084571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d158c-d24c-4893-aee3-e965bcb0a414 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.116952 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3917/7813] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:11.121759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.136673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2afa-0354-4a11-a428-963b91fe31b1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.150269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.153166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.153691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.154132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] PATH_INFO: `/v3/projects/2ca6f500e8814e02ade160ecc2269d39/users/82005944407d498fbad15873b68801c2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.194128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6f500e8814e02ade160ecc2269d39, user_id=82005944407d498fbad15873b68801c2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.197287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.226421 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3897/7814] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:11 2022] PUT /identity/v3/projects/2ca6f500e8814e02ade160ecc2269d39/users/82005944407d498fbad15873b68801c2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:11.238071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.238364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.238645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.279869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] MFA Rules not processed for user `82005944407d498fbad15873b68801c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:11.282015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:11.421184 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3918/7815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:11.425481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.523696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503ab77-1585-4118-8d83-98f68393fd87 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.530334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.531045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.531397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.531744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.532470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.534770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.577463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3898/7816] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:11 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:11.579135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.594569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6f8f1-d557-42f6-852e-6f1a2d29954f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.727351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.728112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.728659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.729042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.729825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.733456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.743711 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:11.764703 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3919/7817] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:11 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:11.766446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.791200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b17d-dad2-4982-84b1-00dc012715a5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.839360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.844956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.845634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.846084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.846956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.850937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.890344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3899/7818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:11.891008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:11.904556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048430d-6fa4-4968-baee-34b806cafd46 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:11.923990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:11.925041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:11.925586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:11.926332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] PATH_INFO: `/v3/projects/e065bf758fab4f33bf2c48681118c2ad/users/842ca75ef6e2406994d07ab850760076/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:11.962490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e065bf758fab4f33bf2c48681118c2ad, user_id=842ca75ef6e2406994d07ab850760076, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:11.965211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:11.999812 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3920/7819] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:11 2022] PUT /identity/v3/projects/e065bf758fab4f33bf2c48681118c2ad/users/842ca75ef6e2406994d07ab850760076/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:12.003573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:12.017174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd5d25-55bf-4844-922b-ae5a165a5995 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:12.175143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:12.175951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:12.176338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:12.176720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:12.177651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:12.179435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6bbdf-749d-49ad-a741-f3b0d63fd1eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:12.210958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:12.211198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3900/7820] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:12.239911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7550-84b4-4847-9376-de16c4d7b7a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:12.249801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:12.250617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:12.250877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:12.251155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] PATH_INFO: `/v3/projects/e065bf758fab4f33bf2c48681118c2ad/users/842ca75ef6e2406994d07ab850760076/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:12.258079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e065bf758fab4f33bf2c48681118c2ad, user_id=842ca75ef6e2406994d07ab850760076, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:12.279714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:12.311410 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3921/7821] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:12 2022] PUT /identity/v3/projects/e065bf758fab4f33bf2c48681118c2ad/users/842ca75ef6e2406994d07ab850760076/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:12.321781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:12.332442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:12.332893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:12.404387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] MFA Rules not processed for user `842ca75ef6e2406994d07ab850760076`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:12.407516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:12.455761 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:12.557987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3901/7822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:12.569389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:12.571236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:12.680275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e783d-751f-466a-b6d9-1cbb8df32348 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:12.689795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:12.691245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:12.691797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:12.692057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:12.717868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:12.719352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:12.750433 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3922/7823] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:36:12.810957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:12.812742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:12.829935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa007-29b3-4c83-9d34-aecffddf8173 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:12.834596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:12.835908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:12.835908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:12.836141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:12.912990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:12.915231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d66080-11b7-481b-9b27-95de522c73bb service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:12.926830 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3902/7824] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:17.654914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:17.752516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01e95-a7df-46e3-88f5-6b1005a1d2ad service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:17.760051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:17.760897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:17.761303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:17.761712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] PATH_INFO: `/v3/users/82005944407d498fbad15873b68801c2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:17.762985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82005944407d498fbad15873b68801c2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:17.765040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:18.036806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82005944407d498fbad15873b68801c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:18.036806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82005944407d498fbad15873b68801c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:18.036806 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:18.036806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82005944407d498fbad15873b68801c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:18.036806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82005944407d498fbad15873b68801c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:18.045012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82005944407d498fbad15873b68801c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:18.045012 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3923/7825] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:17 2022] DELETE /identity/v3/users/82005944407d498fbad15873b68801c2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:18.046365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:18.046365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:18.046365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:18.046365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:18.046365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:18.078017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3903/7826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:18.088311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:18.089764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:18.210648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9d84e-8d26-4dff-bd52-c163e2d1eb12 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:18.215153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:18.215782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:18.216070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:18.216408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:18.230372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:18.232978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:18.264459 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3924/7827] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:18.794782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:18.800523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:18.846432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f006a-c369-4452-bfcc-52f3b8d28a26 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:18.853791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:18.854812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:18.855266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:18.855732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] PATH_INFO: `/v3/projects/2ca6f500e8814e02ade160ecc2269d39` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:18.857205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca6f500e8814e02ade160ecc2269d39)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:18.860174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:18.983427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca6f500e8814e02ade160ecc2269d39', 'request_id': 'req-38ec025f-9746-48f9-986a-fe76a8555d77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.002367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca6f500e8814e02ade160ecc2269d39', 'request_id': 'req-38ec025f-9746-48f9-986a-fe76a8555d77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.008285 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:19.011513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca6f500e8814e02ade160ecc2269d39', 'request_id': 'req-38ec025f-9746-48f9-986a-fe76a8555d77'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.047708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] The token cache is being invalidate because project 2ca6f500e8814e02ade160ecc2269d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:19.048300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.048798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.053383 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3904/7828] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:18 2022] DELETE /identity/v3/projects/2ca6f500e8814e02ade160ecc2269d39 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:19.057479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:19.072128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a18c82-bb7b-46bd-a549-b606142c0298 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:19.168595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:19.169258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:19.169580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:19.169855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] PATH_INFO: `/v3/users/842ca75ef6e2406994d07ab850760076` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:19.171278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842ca75ef6e2406994d07ab850760076)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:19.173791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:19.253210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842ca75ef6e2406994d07ab850760076'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.267379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842ca75ef6e2406994d07ab850760076'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.288818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842ca75ef6e2406994d07ab850760076'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.289742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842ca75ef6e2406994d07ab850760076'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.290434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d928ddaa-319c-4299-8c37-933f12b98ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842ca75ef6e2406994d07ab850760076'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:19.294977 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:19.314338 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3925/7829] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:19 2022] DELETE /identity/v3/users/842ca75ef6e2406994d07ab850760076 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:20.422044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:20.428082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:20.454557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec025f-9746-48f9-986a-fe76a8555d77 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:20.556415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:20.559213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:20.559513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:20.560538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] PATH_INFO: `/v3/projects/e065bf758fab4f33bf2c48681118c2ad` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:20.563661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e065bf758fab4f33bf2c48681118c2ad)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:20.575805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:20.671984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e065bf758fab4f33bf2c48681118c2ad', 'request_id': 'req-0ac2b72b-37cc-4545-9743-2d7f97733f9a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:20.683548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e065bf758fab4f33bf2c48681118c2ad', 'request_id': 'req-0ac2b72b-37cc-4545-9743-2d7f97733f9a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:20.692394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e065bf758fab4f33bf2c48681118c2ad', 'request_id': 'req-0ac2b72b-37cc-4545-9743-2d7f97733f9a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:20.723348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] The token cache is being invalidate because project e065bf758fab4f33bf2c48681118c2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:20.723684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:20.724514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0ac2b72b-37cc-4545-9743-2d7f97733f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:20.726438 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3905/7830] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:20 2022] DELETE /identity/v3/projects/e065bf758fab4f33bf2c48681118c2ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:20.730974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:20.731479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:20.731663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:20.782433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:20.783784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:20.894747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3926/7831] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:20.904701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:20.905088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:20.905524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:20.942049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:20.943955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:20.954030 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3906/7832] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:20.958121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:20.972301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae846d-676e-4cd2-a2f0-4a893bb10696 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:20.987229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:20.987955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:20.988324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:20.988602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:20.990194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:20.990512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:20.992351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.023303 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3927/7833] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:36:21.027847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.040787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491bd00-4167-486a-8cce-ed0c0fcae4ab None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.054843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.056025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.056610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.057053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.057894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.060266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.122925 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3907/7834] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:21 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:21.126624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.148020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50559a-f174-4742-aebc-d13722ee092e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.280345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.280983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.281353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.281684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.282332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.285080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.311591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3928/7835] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:21 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:21.315717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.328287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1fe0-2eb2-4e24-a2dd-d48c7542afb7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.335985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.336628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.336905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.337173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.337849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.339803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.352970 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3908/7836] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:21.356621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.372574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f41cb-dc25-4ea5-8cb3-d58327c21e89 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.383287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.386938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.387300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.389461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.389461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.389937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9b45-858a-4b86-8af5-613aeb27b175 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.444224 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3929/7837] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:21.448432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.464568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dce3b-f99f-41ac-82e5-e4e232e2c1ce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.474763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.476058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.476556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.477074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] PATH_INFO: `/v3/projects/0c10ab1acdea4f2a8a6c680e00edc119/users/3db3fc5abec14e5ca2d9df225e0f7424/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.547071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c10ab1acdea4f2a8a6c680e00edc119, user_id=3db3fc5abec14e5ca2d9df225e0f7424, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.564796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.596158 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3909/7838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:21 2022] PUT /identity/v3/projects/0c10ab1acdea4f2a8a6c680e00edc119/users/3db3fc5abec14e5ca2d9df225e0f7424/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:21.597904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.598128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.598504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.646325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.652001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:21.661147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] MFA Rules not processed for user `3db3fc5abec14e5ca2d9df225e0f7424`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:21.667640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:21.708996 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:21.797383 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:21.848707 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3930/7839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:36:21.853279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:21.856049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5a16-eec5-4f3c-ae95-372ce27d1b3c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:21.873299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:21.874192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:21.874581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:21.874958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:21.877291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:21.910840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:21.914407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:21.937255 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3910/7840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:21.993365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c4f1-7973-4836-a9f1-47d35a182f9b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.002808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.003549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.006545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.006958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.007694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.009712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.074940 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3931/7841] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:21 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:36:22.075657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:22.117594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f2e0-f130-4b72-9e6e-8d1b7bb45f6b service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.298896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.299531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.299813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.300080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.300717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.302745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.347794 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3911/7842] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:22 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:22.352335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:22.366301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62bdf-c989-44ce-b9de-ee5c677625f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.375081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.376532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.376819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.377197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.377811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.379438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.391532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3932/7843] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:22.395488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:22.411139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdec98-e02a-4504-88fc-de0fa45468eb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.426112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.426802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.427260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.427690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] PATH_INFO: `/v3/projects/3076d2abed7b43b8bf5709b833a8e082/users/364da2c4911b4ba2a6d9aea77be5e122/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.483239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3076d2abed7b43b8bf5709b833a8e082, user_id=364da2c4911b4ba2a6d9aea77be5e122, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.497599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.524262 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3912/7844] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:22 2022] PUT /identity/v3/projects/3076d2abed7b43b8bf5709b833a8e082/users/364da2c4911b4ba2a6d9aea77be5e122/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:22.525538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:22.556403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d62a3-b6c3-4373-acfd-41d3d501af7d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.757654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.758393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.758760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.759138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.759899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.763944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043b84-d872-4254-a936-3f5ae01bfea1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.789394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3933/7845] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:36:22.790930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:22.807319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc926-e5e6-441b-b18e-eac7f8ff0b22 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:22.820048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:22.820850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.821235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.821636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] PATH_INFO: `/v3/projects/3076d2abed7b43b8bf5709b833a8e082/users/364da2c4911b4ba2a6d9aea77be5e122/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.823841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3076d2abed7b43b8bf5709b833a8e082, user_id=364da2c4911b4ba2a6d9aea77be5e122, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:22.832256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:22.857663 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3913/7846] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:22 2022] PUT /identity/v3/projects/3076d2abed7b43b8bf5709b833a8e082/users/364da2c4911b4ba2a6d9aea77be5e122/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:22.869238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:22.869238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:22.869908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:22.927706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] MFA Rules not processed for user `364da2c4911b4ba2a6d9aea77be5e122`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:22.932014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:23.042864 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:23.089161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3934/7847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:23.104209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:23.107400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:23.218550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196171-5d7e-42b5-b4bf-9e8f73cd2cb0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:23.223121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:23.224460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:23.224839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:23.225123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:23.233059 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:23.237775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:23.241151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1cf3-916c-48fa-80a9-072c03699d25 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:23.255218 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3914/7848] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:23.526826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:23.696737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85066c0-1257-4a23-b2e1-0b83d6afbc35 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:23.702116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:23.702340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:23.702614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:23.702788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] PATH_INFO: `/v3/users/3db3fc5abec14e5ca2d9df225e0f7424` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:23.705955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db3fc5abec14e5ca2d9df225e0f7424)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:23.707953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:23.808743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db3fc5abec14e5ca2d9df225e0f7424'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:23.826529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db3fc5abec14e5ca2d9df225e0f7424'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:23.848956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db3fc5abec14e5ca2d9df225e0f7424'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:23.869396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db3fc5abec14e5ca2d9df225e0f7424'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:23.874258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db3fc5abec14e5ca2d9df225e0f7424'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:23.920161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3935/7849] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:23 2022] DELETE /identity/v3/users/3db3fc5abec14e5ca2d9df225e0f7424 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:23.923242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:23.923729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:23.924091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:23.964978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:23.966416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:24.087878 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3915/7850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:36:24.094769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:24.096382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:24.195527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8566b-ee28-44c5-a283-86ac45ceae48 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:24.210611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:24.213654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:24.213939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:24.214214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:24.231491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:24.233262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:24.253744 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3936/7851] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:25.013155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:25.014803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:25.030450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558d38-ec13-47d8-b577-008a2530fb33 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:25.035918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:25.037789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:25.038073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:25.038507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] PATH_INFO: `/v3/projects/0c10ab1acdea4f2a8a6c680e00edc119` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:25.039723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c10ab1acdea4f2a8a6c680e00edc119)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:25.042077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:25.151990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c10ab1acdea4f2a8a6c680e00edc119', 'request_id': 'req-bb739a24-09a2-41a6-8a30-3458a2ab1eef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.166103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c10ab1acdea4f2a8a6c680e00edc119', 'request_id': 'req-bb739a24-09a2-41a6-8a30-3458a2ab1eef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.189929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c10ab1acdea4f2a8a6c680e00edc119', 'request_id': 'req-bb739a24-09a2-41a6-8a30-3458a2ab1eef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.209712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] The token cache is being invalidate because project 0c10ab1acdea4f2a8a6c680e00edc119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:25.209962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.210672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.214020 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3916/7852] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:25 2022] DELETE /identity/v3/projects/0c10ab1acdea4f2a8a6c680e00edc119 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:25.218545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:25.243856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc12996-d4a0-433a-854f-8a9b8c412d4b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:25.249155 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:25.331383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:25.332493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:25.333028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:25.334250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] PATH_INFO: `/v3/users/364da2c4911b4ba2a6d9aea77be5e122` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:25.337046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=364da2c4911b4ba2a6d9aea77be5e122)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:25.339399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:25.414456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364da2c4911b4ba2a6d9aea77be5e122'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.424092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364da2c4911b4ba2a6d9aea77be5e122'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.440159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364da2c4911b4ba2a6d9aea77be5e122'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.441354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364da2c4911b4ba2a6d9aea77be5e122'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.442395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b78e8605-c0dc-4945-973d-3bae1bdf4c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364da2c4911b4ba2a6d9aea77be5e122'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:25.476409 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3937/7853] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:25 2022] DELETE /identity/v3/users/364da2c4911b4ba2a6d9aea77be5e122 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:26.236609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:26.238765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:26.268333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb739a24-09a2-41a6-8a30-3458a2ab1eef admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:26.399550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:26.399550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:26.399550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:26.399550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] PATH_INFO: `/v3/projects/3076d2abed7b43b8bf5709b833a8e082` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:26.400855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3076d2abed7b43b8bf5709b833a8e082)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:26.402812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:26.432428 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:26.471847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3076d2abed7b43b8bf5709b833a8e082', 'request_id': 'req-99da2a0a-0a6c-456d-a995-32185bce1f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:26.479510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3076d2abed7b43b8bf5709b833a8e082', 'request_id': 'req-99da2a0a-0a6c-456d-a995-32185bce1f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:26.486750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3076d2abed7b43b8bf5709b833a8e082', 'request_id': 'req-99da2a0a-0a6c-456d-a995-32185bce1f8e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:26.504901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] The token cache is being invalidate because project 3076d2abed7b43b8bf5709b833a8e082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:26.505985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:26.507533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-99da2a0a-0a6c-456d-a995-32185bce1f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:26.509308 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3917/7854] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:26 2022] DELETE /identity/v3/projects/3076d2abed7b43b8bf5709b833a8e082 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:26.515541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:26.516107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:26.516261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:26.550374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:26.551774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:26.753664 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3938/7855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:26.762855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:26.763439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:26.763888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:26.818884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:26.823075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:26.862364 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3918/7856] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:26.867352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:26.878027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fa50-69ed-4d85-bec9-6e873489289f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:26.883603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:26.884163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:26.884551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:26.884702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:26.885365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:26.885715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:26.887413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:26.902501 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3939/7857] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:36:26.906929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:26.919752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470549e-0a62-4756-b8c7-16bac2fb6ba7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:26.937151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:26.937151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:26.937151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:26.937151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:26.937653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:26.939808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:26.998029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3919/7858] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:26 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:27.001985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.015959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab021-b0bb-4e25-8b28-4b5047606c5e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.037321 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:27.116832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.117561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.118004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.118346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.119183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.122080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.163917 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3940/7859] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:27 2022] POST /identity/v3/users => generated 305 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:27.166229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.196841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a0d8a-fe10-4e8c-852a-052ff9e74136 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.204984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.206030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.206520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.207651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.208691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.211878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.225201 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3920/7860] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:27.233383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.261352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4185-71bc-4ef1-8ec5-c351ba6d9ca3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.268633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.269550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.270076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.270669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.271662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.273736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc181c0-08fc-42f4-a511-d01ba7af6f96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.297533 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3941/7861] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:27.300081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.327427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d7925-330e-4cbf-bdab-b4018a1a0414 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.334954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.335930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.336759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.337559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] PATH_INFO: `/v3/projects/ed67252556f24427b3f064967c1a57c4/users/b912661e4ff249f4ab148deab6f88fc0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.414827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed67252556f24427b3f064967c1a57c4, user_id=b912661e4ff249f4ab148deab6f88fc0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.418501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.454263 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3921/7862] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:27 2022] PUT /identity/v3/projects/ed67252556f24427b3f064967c1a57c4/users/b912661e4ff249f4ab148deab6f88fc0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:27.465162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.465492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.465933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.517966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] MFA Rules not processed for user `b912661e4ff249f4ab148deab6f88fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:27.520059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:27.634450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3942/7863] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:27.639507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.747157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bb9-801e-42c3-b4fd-f541d2e9e8ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.752505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.753176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.753493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.753771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.754403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.757254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.818285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3922/7864] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:27 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:27.823172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.842748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389cbd-7ef0-449b-a827-438b12bb8d19 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.928664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.929296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.929622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.929899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.930544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:27.933318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:27.962607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3943/7865] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:27 2022] POST /identity/v3/users => generated 311 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:27.966413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:27.984040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ffb54-43de-4dcd-8461-d02d56115148 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:27.995253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:27.996001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:27.996465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:27.996755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:27.997468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:28.007119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:28.029092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3923/7866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:28.033192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:28.050866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5484c-4255-4978-8f5d-8e70808e9f99 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:28.058867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:28.059577 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:28.059860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:28.060140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] PATH_INFO: `/v3/projects/9da143789ce34f47b145026c5b1e34cc/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:28.077244 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:28.083999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da143789ce34f47b145026c5b1e34cc, user_id=fbcb3d57e27f4ed293ba5b5c01e1f5f7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:28.087181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:28.120638 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3944/7867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:28 2022] PUT /identity/v3/projects/9da143789ce34f47b145026c5b1e34cc/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:28.125634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:28.143133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5ef2-ae6e-4359-ba70-90c10cab1f70 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:28.188001 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:28.343690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:28.344473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:28.344583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:28.344863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:28.345524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:28.353453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e88d79-37eb-48eb-b1bb-b2649bc554ea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:28.393184 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3924/7868] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:28.393441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:28.419688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b2e2-a7ac-477e-9112-be8bbfc96279 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:28.425444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:28.426149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:28.426437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:28.426719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] PATH_INFO: `/v3/projects/9da143789ce34f47b145026c5b1e34cc/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:28.430444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da143789ce34f47b145026c5b1e34cc, user_id=fbcb3d57e27f4ed293ba5b5c01e1f5f7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:28.433992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:28.448739 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3945/7869] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:28 2022] PUT /identity/v3/projects/9da143789ce34f47b145026c5b1e34cc/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:28.460436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:28.460724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:28.461799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:28.547985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] MFA Rules not processed for user `fbcb3d57e27f4ed293ba5b5c01e1f5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:28.549820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:28.709621 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3925/7870] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:28.719042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:28.721310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:28.904918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58226a-fd46-4730-94e5-22e961211dfd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:28.919663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:28.920410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:28.920697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:28.920976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:28.944168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:28.945680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:28.957564 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3946/7871] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:29.257758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:29.278821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad66f-fc89-4b43-aabc-2b6e120767ca None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:29.286133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:29.287150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:29.287579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:29.287929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:29.425556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:29.428265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:29.451557 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3926/7872] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:31.494159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:31.495659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:31.618999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e9cea-6634-43f5-b41e-ffb5fc78ee3a service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:31.625555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:31.626259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:31.627206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:31.627565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:31.629697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:31.657470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:31.659252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504918d8-168f-4130-8181-84ae18115cc2 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:31.682634 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3947/7873] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:39.435536 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=83 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:41.668442 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=67,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:42.194898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:42.330621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29437a-1669-44c0-ad74-ff754fa8c15c service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:42.343572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:42.344527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:42.345129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:42.345530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] PATH_INFO: `/v3/users/b912661e4ff249f4ab148deab6f88fc0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:42.347872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b912661e4ff249f4ab148deab6f88fc0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:42.353147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:42.487561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b912661e4ff249f4ab148deab6f88fc0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:42.488546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b912661e4ff249f4ab148deab6f88fc0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:42.510431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b912661e4ff249f4ab148deab6f88fc0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:42.579569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b912661e4ff249f4ab148deab6f88fc0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:42.581765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b912661e4ff249f4ab148deab6f88fc0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:42.610019 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3927/7874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:42 2022] DELETE /identity/v3/users/b912661e4ff249f4ab148deab6f88fc0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:42.623479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:42.623769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:42.624046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:42.682704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:42.685539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:42.848107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3948/7875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:42.866856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:42.868289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:43.003791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca619860-512f-4031-8043-3909c2164f5a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:43.008180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:43.008936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:43.009278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:43.009666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:43.020339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:43.022870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:43.034148 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3928/7876] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:43.534011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:43.536475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:43.568852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff274921-167d-42f9-bada-aaea2cf8b2cf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:43.581483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:43.582919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:43.586634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:43.587157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] PATH_INFO: `/v3/projects/ed67252556f24427b3f064967c1a57c4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:43.588803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed67252556f24427b3f064967c1a57c4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:43.590881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:43.695127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed67252556f24427b3f064967c1a57c4', 'request_id': 'req-18679fc2-6756-414e-a5f2-aee4207208c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.703611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed67252556f24427b3f064967c1a57c4', 'request_id': 'req-18679fc2-6756-414e-a5f2-aee4207208c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.709795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed67252556f24427b3f064967c1a57c4', 'request_id': 'req-18679fc2-6756-414e-a5f2-aee4207208c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.730474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] The token cache is being invalidate because project ed67252556f24427b3f064967c1a57c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:43.730778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.731624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.736448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3949/7877] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:43 2022] DELETE /identity/v3/projects/ed67252556f24427b3f064967c1a57c4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:43.737748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:43.763760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957ac5-1502-43a7-934e-af2343fa4f43 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:43.790253 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:43.851135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:43.852136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:43.852670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:43.853167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] PATH_INFO: `/v3/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:43.855152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcb3d57e27f4ed293ba5b5c01e1f5f7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:43.857476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:43.917944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcb3d57e27f4ed293ba5b5c01e1f5f7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.918647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcb3d57e27f4ed293ba5b5c01e1f5f7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.929064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcb3d57e27f4ed293ba5b5c01e1f5f7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.948168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcb3d57e27f4ed293ba5b5c01e1f5f7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.949289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51e3f4a2-e7c7-410f-ac4c-12234a9a712a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcb3d57e27f4ed293ba5b5c01e1f5f7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:43.970637 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3929/7878] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:43 2022] DELETE /identity/v3/users/fbcb3d57e27f4ed293ba5b5c01e1f5f7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:44.436652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:44.438149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:44.460120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679fc2-6756-414e-a5f2-aee4207208c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:44.565166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:44.566160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:44.566645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:44.567771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] PATH_INFO: `/v3/projects/9da143789ce34f47b145026c5b1e34cc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:44.569380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da143789ce34f47b145026c5b1e34cc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:44.571821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:44.620826 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:44.651246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da143789ce34f47b145026c5b1e34cc', 'request_id': 'req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:44.659661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da143789ce34f47b145026c5b1e34cc', 'request_id': 'req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:44.682395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da143789ce34f47b145026c5b1e34cc', 'request_id': 'req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:44.712955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] The token cache is being invalidate because project 9da143789ce34f47b145026c5b1e34cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:44.714201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:44.715688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-583ff3e4-64c5-4aeb-addf-7a2dfd6dbe20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:44.718450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3950/7879] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:44 2022] DELETE /identity/v3/projects/9da143789ce34f47b145026c5b1e34cc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:36:44.723124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:44.723610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:44.724067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:44.748512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:44.749757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:44.817216 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3930/7880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:44.826456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:44.826748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:44.827023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:44.877955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:44.879441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:44.893391 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3951/7881] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:44.894478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:44.907593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bcaa4-c717-4dc9-94ad-56eb76a02919 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:44.915446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:44.916379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:44.916864 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:44.917366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:44.918826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:44.919205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:44.921071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:44.943681 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3931/7882] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:36:44.947931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:44.959105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88c8e-ebce-4247-87f0-3da471c620c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:44.964123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:44.964803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:44.965061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:44.965336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:44.965998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:44.968642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.004547 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3952/7883] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:44 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:45.008437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:45.026755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c7d8-112e-4722-b682-0bb2e71f3ab5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:45.081853 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:45.136375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:45.137232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.137619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.137964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.138681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:45.140905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.169488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3932/7884] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:45 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:45.173903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:45.188409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2f4f-0eae-42e7-9674-d8ad16cecdf9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:45.195541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:45.196482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.197153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.198093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.198994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:45.200902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.220801 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3953/7885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:45.224860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:45.238571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124219ae-5bf9-4c9f-a854-04175ccd1591 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:45.244607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:45.245721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.246343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.246807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.249135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:45.252070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485263c-f985-4ad6-98e9-1595c66de0ec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.268342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3933/7886] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:45.273321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:45.285385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a6d34-1081-45a7-9087-d9b9c72c9411 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:45.291778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:45.292516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.292807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.293138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] PATH_INFO: `/v3/projects/066f19b0e51f43a2876c337530bb168b/users/1fb26cd4a8ca44deb40905d51a9c05fe/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.316218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066f19b0e51f43a2876c337530bb168b, user_id=1fb26cd4a8ca44deb40905d51a9c05fe, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:45.320587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.351237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3954/7887] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:45 2022] PUT /identity/v3/projects/066f19b0e51f43a2876c337530bb168b/users/1fb26cd4a8ca44deb40905d51a9c05fe/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:45.361918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.362250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.362536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.418598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] MFA Rules not processed for user `1fb26cd4a8ca44deb40905d51a9c05fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:45.419922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:45.573854 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3934/7888] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:45.576358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:45.578886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:45.671217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3327-85e0-4329-a972-3f732e774f82 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:45.676325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:45.677313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:45.677636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:45.677960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:45.688903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:45.690642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f6260-d9ea-4465-b7a7-32a2acdefd34 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:45.702264 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3955/7889] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:49.716774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:49.718344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:49.884974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceee9e-2aed-4ec9-822d-f6f045510135 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:49.902901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:49.903903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:49.904261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:49.904612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] PATH_INFO: `/v3/users/b6b57ffc9fdb48549c0c55195dd04d37` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:49.908733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b57ffc9fdb48549c0c55195dd04d37)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:49.911499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:49.992890 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:50.007075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b57ffc9fdb48549c0c55195dd04d37'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:50.008008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b57ffc9fdb48549c0c55195dd04d37'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:50.026080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b57ffc9fdb48549c0c55195dd04d37'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:50.043674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b57ffc9fdb48549c0c55195dd04d37'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:50.044564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b57ffc9fdb48549c0c55195dd04d37'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:50.063933 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3935/7890] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:49 2022] DELETE /identity/v3/users/b6b57ffc9fdb48549c0c55195dd04d37 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:50.065890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:50.066351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:50.066615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:50.090864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:50.092105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:50.209674 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:50.245123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3956/7891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:36:50.263240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:50.265039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:50.410455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b5c9-38ba-4cac-b41c-e5a72d3e5db7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:50.430347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:50.431095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:50.431637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:50.432384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:50.466203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:50.470973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b70a-5109-43b6-b35a-d7d52f34d6cc service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:50.519344 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3936/7892] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:50.984268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:50.989947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:51.057166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d21f-d606-4b7a-aa84-4d82cfea97c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:51.073103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:51.093822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:51.094466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:51.097270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] PATH_INFO: `/v3/projects/9fc88b6325354757a7ea5e3546d14efb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:51.099348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc88b6325354757a7ea5e3546d14efb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:51.111111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:51.290322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc88b6325354757a7ea5e3546d14efb', 'request_id': 'req-2385d33c-fb7f-43d3-81c5-a35cec9db28c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:51.312067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc88b6325354757a7ea5e3546d14efb', 'request_id': 'req-2385d33c-fb7f-43d3-81c5-a35cec9db28c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:51.320090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc88b6325354757a7ea5e3546d14efb', 'request_id': 'req-2385d33c-fb7f-43d3-81c5-a35cec9db28c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:51.349234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] The token cache is being invalidate because project 9fc88b6325354757a7ea5e3546d14efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:51.349808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:51.351669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2385d33c-fb7f-43d3-81c5-a35cec9db28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:51.356980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3957/7893] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:50 2022] DELETE /identity/v3/projects/9fc88b6325354757a7ea5e3546d14efb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:51.362298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:51.362736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:51.362736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:51.407332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:51.424206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:51.620104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3937/7894] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:51.622238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:51.622532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:51.622808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:51.674432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:51.678460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:51.726472 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3958/7895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:51.730539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:51.748329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7456c-396c-422f-aa74-b912c625e8b5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:51.756843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:51.757519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:51.757806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:51.758081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:51.758755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:51.759061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:51.760772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:51.783035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3938/7896] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:36:51.790146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:51.812635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320d12d-9729-451b-87ef-15b77626d7a8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:51.828626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:51.830357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:51.835287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:51.836572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:51.840022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:51.845582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:51.922698 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3959/7897] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:51 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:51.926817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:51.939943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9625ec-ae89-4739-bd0a-d6a6e01500ce admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:51.997120 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:52.038757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.039391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.039677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.039952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.040665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.042548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:52.104721 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3939/7898] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:51 2022] POST /identity/v3/users => generated 281 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:52.106262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:52.119866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e26c-adfa-4893-aeb5-0f0b2475ea2d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:52.133651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.134708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.135281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.135673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.136471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.141590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:52.175395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3960/7899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:52.178340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:52.196886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f46d-0c10-4f0e-807a-c351b999b408 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:52.219020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.219664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.219953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.220231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.220904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.228728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe767f-c075-49a7-8eb1-ed94955345b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:52.249394 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3940/7900] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:52.250600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:52.269015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50798-3136-4b0a-8810-468e2d516708 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:52.280905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.293908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.294284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.294629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] PATH_INFO: `/v3/projects/7a3f4687e42d4abbb68fec7c476f9dd8/users/f0e4ebf6cc004650b6bb6699dd634e8b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.320373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3f4687e42d4abbb68fec7c476f9dd8, user_id=f0e4ebf6cc004650b6bb6699dd634e8b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.327154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:52.354647 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3961/7901] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:52 2022] PUT /identity/v3/projects/7a3f4687e42d4abbb68fec7c476f9dd8/users/f0e4ebf6cc004650b6bb6699dd634e8b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:52.364926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.367945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.368411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.449915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] MFA Rules not processed for user `f0e4ebf6cc004650b6bb6699dd634e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:52.451795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:52.605708 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3941/7902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:36:52.607794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:52.611266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:52.723031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3ff07-bb9d-4ac3-9149-d30e35b21f5e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:52.737973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.737973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.737973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.737973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.739951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:52.741738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:52.750620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.752673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22281c89-e52c-41e6-bf7a-026e2fd4395f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:52.792179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3962/7903] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:36:52.904433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba957-7b78-46de-b414-60049e098e43 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:52.919683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:52.921447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:52.922186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:52.922631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] PATH_INFO: `/v3/users/1fb26cd4a8ca44deb40905d51a9c05fe` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:52.924041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb26cd4a8ca44deb40905d51a9c05fe)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:52.926439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:53.036881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb26cd4a8ca44deb40905d51a9c05fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:53.037723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb26cd4a8ca44deb40905d51a9c05fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:53.054554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb26cd4a8ca44deb40905d51a9c05fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:53.056205 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:53.081173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb26cd4a8ca44deb40905d51a9c05fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:53.082055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb26cd4a8ca44deb40905d51a9c05fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:53.136937 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3942/7904] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:36:52 2022] DELETE /identity/v3/users/1fb26cd4a8ca44deb40905d51a9c05fe => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:53.139278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:53.139723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:53.140362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:53.177430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:53.181192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:53.209533 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:53.355884 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3963/7905] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:53.367785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:53.370411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:53.487384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed464dec-7cd1-41e3-8a44-dcb3707c1adb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:53.494189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:53.495082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:53.495509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:53.496012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:53.507779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:53.509248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b568-d57a-43de-925e-2cc768c7f8b3 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:53.522137 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3943/7906] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:36:54.261649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:54.263475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:54.311647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad253e-a8c7-4a3b-9524-9d3a466fc45f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:54.326365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:54.328297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:54.329770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:54.330154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] PATH_INFO: `/v3/projects/066f19b0e51f43a2876c337530bb168b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:54.333636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066f19b0e51f43a2876c337530bb168b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:54.339003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:54.513836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066f19b0e51f43a2876c337530bb168b', 'request_id': 'req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:54.546410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066f19b0e51f43a2876c337530bb168b', 'request_id': 'req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:54.561010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066f19b0e51f43a2876c337530bb168b', 'request_id': 'req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:54.599306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] The token cache is being invalidate because project 066f19b0e51f43a2876c337530bb168b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:36:54.600163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:54.601170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ff0fa6bc-b32d-45f4-a53a-99476b0e9a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:36:54.606834 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3964/7907] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:36:54 2022] DELETE /identity/v3/projects/066f19b0e51f43a2876c337530bb168b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:54.612071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20538-1489-45db-b67b-c891d05205ce None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:54.612705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20538-1489-45db-b67b-c891d05205ce None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:54.612705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20538-1489-45db-b67b-c891d05205ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:54.650761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2df20538-1489-45db-b67b-c891d05205ce None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:54.652999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2df20538-1489-45db-b67b-c891d05205ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:54.762441 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3944/7908] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:54.771621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:54.772265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:54.772540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:54.807840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:54.809612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:54.818922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3965/7909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:54.822831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df20538-1489-45db-b67b-c891d05205ce None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:54.835177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df20538-1489-45db-b67b-c891d05205ce None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:54.840100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:54.840809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:54.841093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:54.841381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:54.842066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:36:54.842371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:54.844137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:54.863472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3945/7910] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:36:54.868324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:54.882928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd5b2-48b6-4252-ad6d-e3ef8977af6f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:54.893018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:54.893951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:54.894417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:54.895452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:54.896206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:54.898168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:54.932411 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3966/7911] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:36:54 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:36:54.936537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:54.955760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107d97-b80d-4f26-a146-ce7118fff549 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:55.032385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:55.033149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.033661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.033950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.034822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:55.037790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:55.048376 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:55.067517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3946/7912] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:36:54 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:36:55.072036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:55.084057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8708d-42bd-4f67-9ec5-b11a67e528aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:55.089983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:55.091529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.091910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.092460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.093096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:55.095129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:55.115467 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3967/7913] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:36:55.119859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:55.131055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898302-8f49-4efd-b812-103b6ed39641 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:55.141649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:55.142270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.142549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.142817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.143460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:55.145315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263020ad-2d89-4066-b82e-f474955fa065 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:55.162998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3947/7914] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:36:55.167015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:55.182120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e4072-c089-4bb2-a29f-3d370e29609a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:55.189999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:55.190909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.191410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.191904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] PATH_INFO: `/v3/projects/f51e96acfcc54b72a21f8e3a37e94334/users/5d6feba7a168449ba584115b112bc8b3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.223364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51e96acfcc54b72a21f8e3a37e94334, user_id=5d6feba7a168449ba584115b112bc8b3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:55.226836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:55.249071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3968/7915] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:36:55 2022] PUT /identity/v3/projects/f51e96acfcc54b72a21f8e3a37e94334/users/5d6feba7a168449ba584115b112bc8b3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:36:55.260444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.260810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.261154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.323820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] MFA Rules not processed for user `5d6feba7a168449ba584115b112bc8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:36:55.325324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:55.452486 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3948/7916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:36:55.467073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:36:55.468818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:36:55.539780 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:55.575453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5ce4-48b8-4350-b6c8-9452626cadcd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:36:55.579682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:36:55.580465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:36:55.580914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:36:55.581332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:36:55.596459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:36:55.599485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9190d09-08d3-4fcf-8bdd-4de3e549db71 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:36:55.617107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3969/7917] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:36:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:05.343089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:05.345114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:05.511898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a891-8e4d-41c0-b023-558bbe759289 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:05.529909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:05.530546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:05.530827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:05.531104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:05.534792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:05.610182 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:05.670486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:05.674336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:05.693289 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3949/7918] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:14.633498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:14.634399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:14.634853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:14.667555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:14.669353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:14.865220 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3970/7919] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:14.957201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:14.959698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:14.999794 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:15.073724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16be4c9-0ce2-4bab-a3e4-942868920153 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:15.084888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:15.086580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:15.087013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:15.087801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:15.098637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:15.100606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0fa7-f5ea-4446-8603-7d23277ef4dc service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:15.111082 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3950/7920] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:37:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:37:15.358452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:15.362146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:15.523817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829e737-8a6a-4ddd-a27c-e29a045770a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:15.544448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:15.545134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:15.545457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:15.546958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] PATH_INFO: `/v3/users/978050f13c1f43169ebece06e16a1a82` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:15.550712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978050f13c1f43169ebece06e16a1a82)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:15.552769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:15.680424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978050f13c1f43169ebece06e16a1a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:15.699679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978050f13c1f43169ebece06e16a1a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:15.787400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978050f13c1f43169ebece06e16a1a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:15.791336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978050f13c1f43169ebece06e16a1a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:15.792989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978050f13c1f43169ebece06e16a1a82'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:15.832630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3971/7921] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:37:15 2022] DELETE /identity/v3/users/978050f13c1f43169ebece06e16a1a82 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:15.835213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:15.835667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:15.836051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:15.874737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:15.877770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:16.009822 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3951/7922] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:16.016659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:16.018916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:16.118939 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:16.195298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0376a1-a08c-4e64-9fb9-e899890d0062 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:16.204720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:16.205515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:16.205902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:16.206286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:16.230061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:16.235322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:16.259237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3972/7923] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:16.750491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:16.752865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:16.851654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:16.853318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:16.879436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2773a-3fc4-4f39-9ba7-697aa19647c0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:16.890321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:16.891122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:16.891246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:16.891500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] PATH_INFO: `/v3/projects/092b065d83444235a92697d053e2615c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:16.897955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092b065d83444235a92697d053e2615c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:16.899924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:17.021460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092b065d83444235a92697d053e2615c', 'request_id': 'req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:17.033716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092b065d83444235a92697d053e2615c', 'request_id': 'req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:17.040632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092b065d83444235a92697d053e2615c', 'request_id': 'req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:17.065573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] The token cache is being invalidate because project 092b065d83444235a92697d053e2615c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:37:17.065875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:17.069153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c976c7db-7d03-4bf4-98a4-7dc8f8f996f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:17.071882 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3973/7924] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:37:16 2022] DELETE /identity/v3/projects/092b065d83444235a92697d053e2615c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:17.076848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aea6b-8ea4-4bf9-b024-4aa79a37c747 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:17.077429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aea6b-8ea4-4bf9-b024-4aa79a37c747 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:17.077725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9aea6b-8ea4-4bf9-b024-4aa79a37c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:17.110187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14d927-3b21-4a4c-82b4-754804210c92 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:17.170488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6b9aea6b-8ea4-4bf9-b024-4aa79a37c747 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:17.171725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b9aea6b-8ea4-4bf9-b024-4aa79a37c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:17.245277 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:17.323035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:17.324126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:17.327067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:17.328997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:17.334800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:17.338147 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3974/7925] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:17.346012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:17.346524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:17.346965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:17.366638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:17.373131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:17.404997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:17.409692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:17.414334 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3952/7926] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:17.443005 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3975/7927] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:17.447890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:17.465639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2a66-68ad-49fa-b19e-6ae4e3efbc6e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:17.479125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:17.480306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:17.481883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:17.483352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:17.484205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:37:17.485379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:17.489191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:17.527438 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3953/7928] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:37:17.531888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:17.559392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cad64-2fe7-45cb-8461-0d195fcd8d7c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:17.590547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:17.591190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:17.591466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:17.591743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:17.592689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:17.594753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:17.742967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:17.750820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3976/7929] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:37:17 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:37:17.759779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97c2f-36de-4602-81f1-7b82cf9c0079 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:18.020745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:18.023015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:18.091448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:18.092097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.092379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.092653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.093531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:18.096998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:18.142462 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:18.168219 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3954/7930] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:37:17 2022] POST /identity/v3/users => generated 288 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:37:18.172906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:18.185610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c0882-834e-4a86-91d4-bc4216c5cc5b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:18.208845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:18.209706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.210096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.210814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.211763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:18.214000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:18.240893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc1895-bc7d-448a-95e8-3fa4fe2bd51d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:18.241544 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3955/7931] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:18.242662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:18.245005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:18.245673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.245956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.246232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.248168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:18.266099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:18.267403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20f893-5077-410a-aff5-2a13525054cd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:18.267767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:18.276598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:18.277218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.279710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.280029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.280698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:18.282421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30a70-b090-4bc3-b170-fa828b010b28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:18.299716 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3977/7932] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:18.309638 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3956/7933] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:18.313081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:18.373264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd5dd-faa4-4d18-b7ae-e3e305c8affb service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:18.402660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:18.403667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.404467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.404467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] PATH_INFO: `/v3/projects/5f868dd093444adb91bf0e90e694d634/users/4fcd18d654394b8ba2076edb260fa1bb/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.481333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868dd093444adb91bf0e90e694d634, user_id=4fcd18d654394b8ba2076edb260fa1bb, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:18.484264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:18.533043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:18.533338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:18.533651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:18.536963 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3978/7934] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:37:18 2022] PUT /identity/v3/projects/5f868dd093444adb91bf0e90e694d634/users/4fcd18d654394b8ba2076edb260fa1bb/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:18.612742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] MFA Rules not processed for user `4fcd18d654394b8ba2076edb260fa1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:18.614563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:18.879181 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3957/7935] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:18.895085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:18.897369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:19.063258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c453ee-20f1-44d1-8542-5886960e90a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:19.073564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:19.078787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:19.087739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:19.091952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:19.141329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:19.156009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:19.182882 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3979/7936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:28.868421 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:29.169859 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:33.053153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:33.055320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:33.240328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7804d4-91c4-401b-8c5b-6f7db0d42307 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:33.252341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:33.253235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:33.255868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:33.256438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:33.260494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:33.522506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:33.524401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:33.545922 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3958/7937] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:43.537750 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=56 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:50.194731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:50.214653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e01e-c484-41e9-adc3-80f3cdd29303 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:50.227991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:50.228629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:50.228915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:50.229187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:50.231123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:50.252633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:50.254757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:50.272758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3980/7938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:50.371241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:50.538708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82cc56-f97b-4da9-b595-570e85b8c4ad service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:50.563347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:50.563954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:50.564232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:50.564506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] PATH_INFO: `/v3/users/4fcd18d654394b8ba2076edb260fa1bb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:50.568780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcd18d654394b8ba2076edb260fa1bb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:50.573920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:50.676894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcd18d654394b8ba2076edb260fa1bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:50.677805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcd18d654394b8ba2076edb260fa1bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:50.717594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcd18d654394b8ba2076edb260fa1bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:50.722470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:50.743374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb798c-6345-4546-8229-1b58ecc10b23 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:50.758209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:50.760159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:50.761677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:50.773571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:50.781865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcd18d654394b8ba2076edb260fa1bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:50.783394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:50.784534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53ce68dd-e792-453b-9e53-5fae05148e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcd18d654394b8ba2076edb260fa1bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:50.812779 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3959/7939] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:37:50 2022] DELETE /identity/v3/users/4fcd18d654394b8ba2076edb260fa1bb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:50.817118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:50.817662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:50.818159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:50.825089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:50.826668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:50.855561 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3981/7940] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:50.859813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:50.861376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:50.962689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:50.964651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:50.968259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3960/7941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:37:50.978789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:50.980508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:51.021176 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:51.095894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826f821-df62-4591-af87-164fd63f3b71 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:51.102272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:51.102960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:51.103248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:51.103559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:51.107834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c530-6a54-4b35-99c3-28d00b117309 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:51.115639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:51.118938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:51.132426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3961/7942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:51.205659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:51.205659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:51.205659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:51.205659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:51.208901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:51.227204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:51.236832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1b49-b0b3-4598-a30e-537c5fc5a5bd service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:51.263439 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3982/7943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:37:51.481626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:51.483319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:51.509530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a55-340b-4a77-b265-aa0e38e6e7b0 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:51.532517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:51.533576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:51.535180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:51.535645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] PATH_INFO: `/v3/projects/5f868dd093444adb91bf0e90e694d634` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:51.536877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f868dd093444adb91bf0e90e694d634)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:51.538907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:51.654763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f868dd093444adb91bf0e90e694d634', 'request_id': 'req-4af687fd-46a5-431a-be02-c82784c78b4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:51.673652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f868dd093444adb91bf0e90e694d634', 'request_id': 'req-4af687fd-46a5-431a-be02-c82784c78b4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:51.683617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f868dd093444adb91bf0e90e694d634', 'request_id': 'req-4af687fd-46a5-431a-be02-c82784c78b4a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:51.731577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] The token cache is being invalidate because project 5f868dd093444adb91bf0e90e694d634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:37:51.732130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:51.734359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4af687fd-46a5-431a-be02-c82784c78b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:51.745313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3962/7944] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:37:51 2022] DELETE /identity/v3/projects/5f868dd093444adb91bf0e90e694d634 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:51.747173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:51.747683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:51.748144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:51.781121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:51.783112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:51.919067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3983/7945] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:51.927961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:51.928249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:51.928533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:51.960654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:51.962732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:51.976728 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3963/7946] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:51.984622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.001284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f04a-f3c9-4544-88fb-59ff501075de None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.009212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.009964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.010253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.010579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.011329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:37:52.011862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.014863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.018573 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:52.040066 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3984/7947] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:37:52.040255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.052742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdc236-3c94-467e-93b1-4dbdf2b1172d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.066646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.068507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.069917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.070433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.073664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.085946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.157449 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3964/7948] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:37:52 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:37:52.165572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.193865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70867b00-1e0c-4bbb-9d03-2c3880350e57 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.305623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.306927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.307415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.307889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.308744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.310923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.337842 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3985/7949] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:37:52 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:37:52.350022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.354836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77dcc8-aa44-4db5-b5ff-8cd4bbb30f16 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.360760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.361373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.361687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.362628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.363669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.365844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.376912 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3965/7950] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:52.382348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.394350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb09c4-de8b-4f2d-a8de-39b2a7aae8b0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.399747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.400362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.400648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.401008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.401621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.403234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e26fb-6a42-41f2-92e2-95e2fa226217 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.418840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3986/7951] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:52.421279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.433548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55c4c-55cd-439d-81c4-85acb9b9bb9c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.438448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.439131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.439408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.439687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] PATH_INFO: `/v3/projects/c668d62917804accb92b41a1b8b7194f/users/4c7e6ae000224658baa547eb1f388cef/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.458367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c668d62917804accb92b41a1b8b7194f, user_id=4c7e6ae000224658baa547eb1f388cef, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.461330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.494409 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3966/7952] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:37:52 2022] PUT /identity/v3/projects/c668d62917804accb92b41a1b8b7194f/users/4c7e6ae000224658baa547eb1f388cef/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:52.507431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.507746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.508025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.546397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.548912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:52.564009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] MFA Rules not processed for user `4c7e6ae000224658baa547eb1f388cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:52.568856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:52.656860 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:52.702441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52d787-a4c5-490f-9ce2-72d728c66633 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.720412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.722437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.723738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.724329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.727279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:52.734155 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3987/7953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:52.742284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:52.758880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad1249-bf63-427b-bddb-a0c3e415e464 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:52.761125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.762635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.762913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:52.763531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:52.764441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:52.764733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:52.777763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:52.780009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a799d-a538-477f-b29f-e75c71d4f2c5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:52.788198 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3967/7954] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:52.811992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3988/7955] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:37:53.770384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:53.864354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b900-9f8f-44b4-85a0-e7f37ac1b2f8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:53.876888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:53.878053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:53.878451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:53.878832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] PATH_INFO: `/v3/users/4c7e6ae000224658baa547eb1f388cef` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:53.880173 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7e6ae000224658baa547eb1f388cef)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:53.883025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:53.951600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7e6ae000224658baa547eb1f388cef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:53.952398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7e6ae000224658baa547eb1f388cef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:53.962583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7e6ae000224658baa547eb1f388cef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:53.977707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7e6ae000224658baa547eb1f388cef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:53.978818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7e6ae000224658baa547eb1f388cef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:54.001443 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3968/7956] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:37:53 2022] DELETE /identity/v3/users/4c7e6ae000224658baa547eb1f388cef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:54.006338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:54.006865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:54.007499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:54.031538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:54.033087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:54.101362 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:54.121653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3989/7957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:54.136484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:54.137974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:54.265801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367e55-3646-45f6-b69f-423abf64037a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:54.271064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:54.271917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:54.272202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:54.272487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:54.284673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:54.286248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bafcb3-f22c-4569-87de-02722ecd176f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:54.319833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3969/7958] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:37:54.836294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:54.837945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:54.853870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fa78-80d3-4270-931e-e0d993b54820 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:54.862815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:54.863759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:54.864236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:54.880636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] PATH_INFO: `/v3/projects/c668d62917804accb92b41a1b8b7194f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:54.889846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c668d62917804accb92b41a1b8b7194f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:54.897078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:54.996432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c668d62917804accb92b41a1b8b7194f', 'request_id': 'req-7d27fdeb-c324-469b-8e86-993fce5c3f06'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:55.014925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c668d62917804accb92b41a1b8b7194f', 'request_id': 'req-7d27fdeb-c324-469b-8e86-993fce5c3f06'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:55.034186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c668d62917804accb92b41a1b8b7194f', 'request_id': 'req-7d27fdeb-c324-469b-8e86-993fce5c3f06'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:55.062447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] The token cache is being invalidate because project c668d62917804accb92b41a1b8b7194f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:37:55.063932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:55.077679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d27fdeb-c324-469b-8e86-993fce5c3f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:37:55.083653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3990/7959] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:37:54 2022] DELETE /identity/v3/projects/c668d62917804accb92b41a1b8b7194f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:55.088596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.089171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.089171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.107906 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:55.116135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:55.117664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:55.248660 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3970/7960] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:55.249369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.249754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.250102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.286019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:55.289395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:55.319832 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3991/7961] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:55.325915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.337826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81604687-807d-40b3-8a5f-4a9513e9a168 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.342843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.343672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.343954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.344228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.344888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:37:55.345191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.346888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.367884 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3971/7962] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:37:55.368874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.382183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136349b-44ba-4729-a897-58580cf5be3e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.390046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.390046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.390500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.390787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.391579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.393980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.445044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.445723 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3992/7963] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:37:55.456068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911d20-fbfb-40b2-baf7-d21d1fcb4651 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.537249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.538157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.540064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.540620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.541655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.544086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58f8b4-0e28-49c9-8227-2c35b484263b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.571872 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3972/7964] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:37:55.576188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.587546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6352bb-70be-49da-a3db-b4e6f9208ec1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.593268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.609324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.609795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.612474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.615074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.618713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.672569 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3993/7965] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:55.679683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.680121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.680571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.684877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.701779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8e59-de84-4d0f-8366-1feb0a993005 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.711909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:55.717910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.718552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.718838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.719115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.719770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.722095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.726733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:55.744523 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3994/7966] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:55.749455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.775937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c6772-573e-4201-ad7d-93729bdff3a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:55.803553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:55.804246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.804533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.804812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] PATH_INFO: `/v3/projects/7088cccc6a63496d88727478b0d1b4da/users/460a0f5364d8457681518a2cb29f45c5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.839622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7088cccc6a63496d88727478b0d1b4da, user_id=460a0f5364d8457681518a2cb29f45c5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:55.842372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608813-edf5-4cfc-82c9-9139b3668f3c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:55.864666 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3973/7967] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:37:55.875450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3995/7968] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:37:55 2022] PUT /identity/v3/projects/7088cccc6a63496d88727478b0d1b4da/users/460a0f5364d8457681518a2cb29f45c5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:55.880564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:55.883579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:55.887045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:55.887806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:55.889010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:55.963628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] MFA Rules not processed for user `460a0f5364d8457681518a2cb29f45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:55.965152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:55.970105 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:56.074517 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:56.076136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b8c4-5a6a-45a1-95fd-fc423b8e30ec None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.140087 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3996/7969] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:56.147012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:56.234874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.235732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.236092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.237904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.279616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1200ee3-c1f5-4a6c-9adc-5d52631b2945 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.289969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.291103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.291607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.292102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.292959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.295385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.338168 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3997/7970] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:37:56 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:37:56.341589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:56.343407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.346944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.362253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3974/7971] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:37:56.476831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734a77-66c1-4c44-8460-36f1a35df952 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.489941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.490631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.490914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.491194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.491848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.494888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.540097 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3998/7972] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:37:56 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:37:56.542258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:56.563598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2af9d-a9c8-4b09-b0fa-6c327733c400 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.581365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.582225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.582515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.582795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.583545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.585709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.622472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3975/7973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:37:56.631148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:56.672845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6717-36eb-4b4c-bd8f-7f4e8592b88d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.695721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.697448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.697744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.699428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] PATH_INFO: `/v3/projects/126690244ca946239e7a2b76374128ee/users/a3ce69a2067a41828efa15c691bbfd4c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.756040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126690244ca946239e7a2b76374128ee, user_id=a3ce69a2067a41828efa15c691bbfd4c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.759428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.783255 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3999/7974] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:37:56 2022] PUT /identity/v3/projects/126690244ca946239e7a2b76374128ee/users/a3ce69a2067a41828efa15c691bbfd4c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:56.787166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:56.802798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785e2a-4ee4-4faa-8e16-c114e2970997 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:56.976121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:56.977564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:56.978610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:56.979853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:56.980619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:56.984532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db39bd-f8db-4499-a0ba-8ad9435f74a7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:56.990100 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:57.010025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3976/7975] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:37:57.014132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:57.046554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493310-0184-486c-8f8a-37b27960c246 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:57.076548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:57.077369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:57.078001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:57.078871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] PATH_INFO: `/v3/projects/126690244ca946239e7a2b76374128ee/users/a3ce69a2067a41828efa15c691bbfd4c/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:57.084772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126690244ca946239e7a2b76374128ee, user_id=a3ce69a2067a41828efa15c691bbfd4c, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:57.095070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:57.134207 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4000/7976] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:37:57 2022] PUT /identity/v3/projects/126690244ca946239e7a2b76374128ee/users/a3ce69a2067a41828efa15c691bbfd4c/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:37:57.145709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:57.146022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:57.146352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:57.227476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] MFA Rules not processed for user `a3ce69a2067a41828efa15c691bbfd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:37:57.228702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:57.425097 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3977/7977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:37:57.442049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:37:57.444585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:37:57.535835 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:57.624993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d204-ebf6-47a5-8b18-291eef915659 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:37:57.629810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:37:57.630436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:37:57.630721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:37:57.630992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:37:57.744364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:37:57.746252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:37:57.762536 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4001/7978] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:05.738508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:05.770606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96bb1-ee83-450d-9e71-bc80d43785ea None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:05.781763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:05.782394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:05.782676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:05.782946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:05.812481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:05.816287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7820-6f10-4d87-a52d-0245d7ec8fc9 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:05.837752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3978/7979] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:07.757028 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=37 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:15.832863 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=41 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:18.047673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:18.221179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5cc7f-176e-4c90-b728-892529986864 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:18.232647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:18.233323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:18.233612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:18.233883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] PATH_INFO: `/v3/users/460a0f5364d8457681518a2cb29f45c5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:18.235043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=460a0f5364d8457681518a2cb29f45c5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:18.238107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:18.324518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460a0f5364d8457681518a2cb29f45c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:18.344024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460a0f5364d8457681518a2cb29f45c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:18.374642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460a0f5364d8457681518a2cb29f45c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:18.378289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460a0f5364d8457681518a2cb29f45c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:18.381508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6660f0b2-9f6c-41fb-a0ee-48f5b15f3f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460a0f5364d8457681518a2cb29f45c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:18.428972 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4002/7980] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:18 2022] DELETE /identity/v3/users/460a0f5364d8457681518a2cb29f45c5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:18.433571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:18.434092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:18.434199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:18.476143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:18.477377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:18.480533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:18.480817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:18.481088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:18.535059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:18.536313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:18.662528 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3979/7981] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:18.669103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:18.670789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:18.678014 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4003/7982] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:38:18.700902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:18.703185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:18.759927 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:18.816128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a2b1-db06-4a60-a5d8-c3349207bbc0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:18.826133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:18.829103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:18.833394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:18.833986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:18.874765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:18.876246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:18.892164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf729de-f96d-4c63-8a01-257936d4fd1e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:18.900015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:18.900780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:18.901421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:18.901565 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3980/7983] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:18.901922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:18.922696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:18.925004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:18.945260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4004/7984] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:38:19.656325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:19.658495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:19.681375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaaacc-54f1-4ab9-8137-2dec1c321030 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:19.687043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:19.688498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:19.689174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:19.690001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] PATH_INFO: `/v3/projects/7088cccc6a63496d88727478b0d1b4da` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:19.691564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7088cccc6a63496d88727478b0d1b4da)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:19.694078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:19.795839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7088cccc6a63496d88727478b0d1b4da', 'request_id': 'req-59d50378-fa14-4cad-8331-fd18b40da343'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:19.807951 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7088cccc6a63496d88727478b0d1b4da', 'request_id': 'req-59d50378-fa14-4cad-8331-fd18b40da343'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:19.816907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7088cccc6a63496d88727478b0d1b4da', 'request_id': 'req-59d50378-fa14-4cad-8331-fd18b40da343'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:19.843412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] The token cache is being invalidate because project 7088cccc6a63496d88727478b0d1b4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:19.843716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:19.844413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:19.846573 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3981/7985] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:19 2022] DELETE /identity/v3/projects/7088cccc6a63496d88727478b0d1b4da => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:19.851080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:19.863621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e345b-c9e8-4444-a67f-d7f4e8dc38fa service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:19.973746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:19.974506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:19.974795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:19.975068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] PATH_INFO: `/v3/users/a3ce69a2067a41828efa15c691bbfd4c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:19.976243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ce69a2067a41828efa15c691bbfd4c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:19.978749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:20.112920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ce69a2067a41828efa15c691bbfd4c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.136540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ce69a2067a41828efa15c691bbfd4c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.166762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ce69a2067a41828efa15c691bbfd4c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.169960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ce69a2067a41828efa15c691bbfd4c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.170909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea6c80aa-5378-4e09-b319-ca51e5a98ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ce69a2067a41828efa15c691bbfd4c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.205503 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4005/7986] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:19 2022] DELETE /identity/v3/users/a3ce69a2067a41828efa15c691bbfd4c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:20.647543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:20.649280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:20.689137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50378-fa14-4cad-8331-fd18b40da343 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:20.723725 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:20.766938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:20.768035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:20.768803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:20.769275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] PATH_INFO: `/v3/projects/126690244ca946239e7a2b76374128ee` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:20.770659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=126690244ca946239e7a2b76374128ee)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:20.773591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:20.836956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126690244ca946239e7a2b76374128ee', 'request_id': 'req-4e426e7a-5c47-4c35-aca2-9f6660520f4d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.844990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126690244ca946239e7a2b76374128ee', 'request_id': 'req-4e426e7a-5c47-4c35-aca2-9f6660520f4d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.852419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126690244ca946239e7a2b76374128ee', 'request_id': 'req-4e426e7a-5c47-4c35-aca2-9f6660520f4d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.881593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] The token cache is being invalidate because project 126690244ca946239e7a2b76374128ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:20.881888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.882534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4e426e7a-5c47-4c35-aca2-9f6660520f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:20.884598 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3982/7987] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:20 2022] DELETE /identity/v3/projects/126690244ca946239e7a2b76374128ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:20.889306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:20.889818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:20.890009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:20.914889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:20.916104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:20.949141 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:20.995922 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4006/7988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:21.100321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.100601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.100877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.131183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:21.132568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:21.144700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3983/7989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:21.149211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.172662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add923cb-7f04-4253-868a-bb3ed868fa6b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.182321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.183320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.183842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.185371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.186134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:38:21.186442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.188144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.209395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4007/7990] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:38:21.210876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.224704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93662-a9fa-47fe-8a95-dfacbd2801d0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.230507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.231122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.231398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.231668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.232297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.235782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.287135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.287502 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3984/7991] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:21.305224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d17b-fd53-42d2-9a1a-56154c97319d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.434775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.435596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.436014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.436391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.437152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.440429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.482152 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4008/7992] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:38:21.488252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.510008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b644d4-0ac6-4066-9542-7df07178bfd1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.523912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.524554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.524902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.525105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.525802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.527410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.554280 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3985/7993] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:21.555119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.567090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab343c-4cf3-4de9-a6a7-024f56d85818 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.573884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.574789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.575133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.575473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.576192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.577936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba550e-8e51-4eeb-9176-499fffd0d3b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.594533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.604513 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4009/7994] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:38:21.605594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4132f9-2059-4c46-b94b-87147b5e8940 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.616316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.617089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.617459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.618057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] PATH_INFO: `/v3/projects/c79f4a04af0943b99e8181e098025813/users/85b93d8f66414011aeda3a2add5b51b9/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.636484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79f4a04af0943b99e8181e098025813, user_id=85b93d8f66414011aeda3a2add5b51b9, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.639702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.657780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3986/7995] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:21 2022] PUT /identity/v3/projects/c79f4a04af0943b99e8181e098025813/users/85b93d8f66414011aeda3a2add5b51b9/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:21.668957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.669329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.669700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.703766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] MFA Rules not processed for user `85b93d8f66414011aeda3a2add5b51b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:21.705865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:21.819350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.830950 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4010/7996] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:21.907739 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:21.922988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b922af-85a1-4a71-830f-fdbeefa3b7ef admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:21.929884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:21.930685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:21.931042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:21.931385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:21.932091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:21.934152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:21.964606 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3987/7997] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:21.968377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:21.980819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf205e-4abd-406d-8de9-0994c3079211 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.011912 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:22.050804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.051429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.051742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.051982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.054477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:22.054865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:22.086987 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4011/7998] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:21 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:22.090618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:22.107431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd66d1-378c-4f66-9758-390c7e9f086c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.121218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.123003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.123455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.123880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.124692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:22.127242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:22.153132 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3988/7999] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:22.154317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:22.168924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92aa2-bbca-4d54-ab50-eed72f3391ad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.177568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.177878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.178446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.178446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] PATH_INFO: `/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18/users/f80c2d9ac852424a9c6adb4ab8d1e839/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.196879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4da0bfbd5d3421fa365f6ab82fd2e18, user_id=f80c2d9ac852424a9c6adb4ab8d1e839, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:22.199839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:22.221528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4012/8000] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:22 2022] PUT /identity/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18/users/f80c2d9ac852424a9c6adb4ab8d1e839/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:38:22.224095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:22.238315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862414c6-31ea-4565-b44f-36aa9efafe4f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.379091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.379941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.380323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.380697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.381622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:22.383341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cae3b-ba44-4c34-888a-4b444466193d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:22.414644 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3989/8001] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:22.416110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:22.430484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cbbf-4832-4461-8abc-1a1b10e29b09 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.445367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.446019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.446415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.446783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] PATH_INFO: `/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18/users/f80c2d9ac852424a9c6adb4ab8d1e839/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.449131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4da0bfbd5d3421fa365f6ab82fd2e18, user_id=f80c2d9ac852424a9c6adb4ab8d1e839, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:22.452597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:22.479656 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4013/8002] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:22 2022] PUT /identity/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18/users/f80c2d9ac852424a9c6adb4ab8d1e839/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:22.491762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.491762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.491762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.591507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] MFA Rules not processed for user `f80c2d9ac852424a9c6adb4ab8d1e839`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:22.592795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:22.765467 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3990/8003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:22.778415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:22.780592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:22.887483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9660-69e2-4c08-83da-869e7d61e66f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:22.891679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:22.893055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:22.893538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:22.894165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:22.997344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:23.000222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:23.026452 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4014/8004] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:23.337748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:23.339344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:23.480050 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:23.512264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4779f-6997-48b8-a63a-3ff8d71f6154 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:23.518442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:23.519069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:23.519779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:23.520530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:23.522384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:23.592270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:23.593928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:23.604248 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3991/8005] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:38:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:38:25.680939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:25.693074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3798-1adb-4db5-bc23-3326c960bd1a service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:25.697068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:25.697709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:25.698028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:25.698388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:25.708595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:25.711147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaedd1-d93d-473a-be9c-713d8cc33528 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:25.733202 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4015/8006] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:28.356219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:28.357803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:28.524172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0325-068c-4f8b-9e65-f3f2d0430e32 service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:28.530190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:28.531011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:28.531466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:28.531887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] PATH_INFO: `/v3/users/5d6feba7a168449ba584115b112bc8b3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:28.533992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6feba7a168449ba584115b112bc8b3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:28.536273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:28.665340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6feba7a168449ba584115b112bc8b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:28.666566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6feba7a168449ba584115b112bc8b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:28.690497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6feba7a168449ba584115b112bc8b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:28.712845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6feba7a168449ba584115b112bc8b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:28.714326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6feba7a168449ba584115b112bc8b3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:28.740826 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3992/8007] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:28 2022] DELETE /identity/v3/users/5d6feba7a168449ba584115b112bc8b3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:28.747473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:28.748138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:28.748138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:28.770793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:28.773892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:28.801111 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:28.863390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4016/8008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:38:28.876244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:28.878764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:28.902188 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:29.007624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99092-f1d7-4300-927d-c1530831ca68 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:29.016301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:29.036275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:29.037288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:29.038312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:29.072805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:29.074403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a267a26-eb61-4d9f-a543-f65933e34c57 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:29.097195 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3993/8009] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:29.481741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:29.486617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:29.516906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e32f0-a59d-452d-abf4-026ecaeb83fc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:29.555604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:29.556508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:29.556947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:29.557367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] PATH_INFO: `/v3/projects/f51e96acfcc54b72a21f8e3a37e94334` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:29.558755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51e96acfcc54b72a21f8e3a37e94334)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:29.560996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:29.636394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51e96acfcc54b72a21f8e3a37e94334', 'request_id': 'req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:29.653650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51e96acfcc54b72a21f8e3a37e94334', 'request_id': 'req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:29.663143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51e96acfcc54b72a21f8e3a37e94334', 'request_id': 'req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:29.705542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] The token cache is being invalidate because project f51e96acfcc54b72a21f8e3a37e94334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:29.717828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:29.719078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc06d5c3-51ec-4f5c-ba80-004b1ff201a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:29.724648 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4017/8010] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:29 2022] DELETE /identity/v3/projects/f51e96acfcc54b72a21f8e3a37e94334 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:29.727341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:29.727827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:29.727926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:29.756237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:29.759476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:29.873448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3994/8011] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:29.973824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:29.974256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:29.974380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.001375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:30.003444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:30.025929 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4018/8012] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:30.030308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.042852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3a2e-06c8-487c-8c85-206c693f580b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.050691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.051421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.051765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.052111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.052838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:38:30.053210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.055419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.080374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3995/8013] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:38:30.084315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.094194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af97d3f-fa9d-4013-aaaa-621d9ccf7667 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.107610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.108297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.109010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.109704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.110344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.123258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.156623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4019/8014] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:30 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:38:30.161512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.177779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209175-bb54-4890-ac3c-d952251f6e5a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.263812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.264464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.264746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.265014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.265831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.268926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.295646 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3996/8015] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:30 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:38:30.300748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.314631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1570-bff5-45c4-a76e-3bbb56aeba97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.320103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.320803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.321292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.321853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.322579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.324393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.341509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4020/8016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:30.345549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.356019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b64978-7cdc-4f6a-b422-15c0ad53d094 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.360940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.361751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.362053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.362478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.363132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.364783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591639a-3eed-49e7-b7ed-ddf75db1f10b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.376939 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3997/8017] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:38:30.381719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.398769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb030d5-ceab-4ef2-b773-41452b589faa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.415088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.416347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.416818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.417277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] PATH_INFO: `/v3/projects/3fa6725b7c63416393357e71e073b582/users/27ce23a385624f7c9bda573978f691d0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.437772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6725b7c63416393357e71e073b582, user_id=27ce23a385624f7c9bda573978f691d0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.441631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.458941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4021/8018] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:30 2022] PUT /identity/v3/projects/3fa6725b7c63416393357e71e073b582/users/27ce23a385624f7c9bda573978f691d0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:30.469015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.469305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.469618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.504345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] MFA Rules not processed for user `27ce23a385624f7c9bda573978f691d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:30.505917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:30.523268 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:30.613108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3998/8019] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:30.624161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.627357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:30.685084 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:30.704916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcf655-02ce-40a3-85aa-19dea2313229 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.709141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.710327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.710662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.710942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.721672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.723548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234dfa-eb12-45b5-96b7-934832e65f5e service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.736917 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4022/8020] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:38:30.767707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:30.770598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:30.853618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f6608-b20e-4fe9-bdb1-e899cce73d0d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:30.858690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:30.859464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:30.859849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:30.860201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] PATH_INFO: `/v3/users/f0e4ebf6cc004650b6bb6699dd634e8b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:30.862603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e4ebf6cc004650b6bb6699dd634e8b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:30.865694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:30.946369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e4ebf6cc004650b6bb6699dd634e8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:30.947116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e4ebf6cc004650b6bb6699dd634e8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:30.955231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e4ebf6cc004650b6bb6699dd634e8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:30.972605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e4ebf6cc004650b6bb6699dd634e8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:30.973350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e4ebf6cc004650b6bb6699dd634e8b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:30.996828 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 3999/8021] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:30 2022] DELETE /identity/v3/users/f0e4ebf6cc004650b6bb6699dd634e8b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:31.001681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:31.003028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:31.003520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:31.029537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:31.030750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:31.106863 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4023/8022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:31.117225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:31.119080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:31.214349 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:31.271407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea79-e8e0-4d16-970f-6ffed9c44912 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:31.276940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:31.278063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:31.278560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:31.279299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:31.308168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:31.309863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba33a-2ff7-4e1d-84a2-1ad3367c7e73 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:31.336376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4000/8023] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:31.961676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:31.963676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:32.022733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4285a4-ad85-4014-a77f-fb1d2ad2ec0d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.043334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.044001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.044484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.044761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] PATH_INFO: `/v3/projects/7a3f4687e42d4abbb68fec7c476f9dd8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.047496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3f4687e42d4abbb68fec7c476f9dd8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.051548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.127403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3f4687e42d4abbb68fec7c476f9dd8', 'request_id': 'req-39177ae0-9f23-4f80-b33d-40af4b411466'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:32.140284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3f4687e42d4abbb68fec7c476f9dd8', 'request_id': 'req-39177ae0-9f23-4f80-b33d-40af4b411466'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:32.150999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3f4687e42d4abbb68fec7c476f9dd8', 'request_id': 'req-39177ae0-9f23-4f80-b33d-40af4b411466'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:32.178684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] The token cache is being invalidate because project 7a3f4687e42d4abbb68fec7c476f9dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:32.178981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:32.181941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-39177ae0-9f23-4f80-b33d-40af4b411466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:32.184367 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4024/8024] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:31 2022] DELETE /identity/v3/projects/7a3f4687e42d4abbb68fec7c476f9dd8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:32.190423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.190978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.191320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.224641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:32.227323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:32.390267 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4001/8025] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:32.398155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.398789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.399147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.432075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:32.433317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:32.454951 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4025/8026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:32.459268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.471844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d59c55-27df-4ca9-8bd6-64e31b7f1d33 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.482385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.483025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.488521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.489045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.492997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:38:32.494872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.496991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.519921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4002/8027] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:38:32.521446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.534113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248ae21-a9e7-4cc2-947a-ca5ae76322c6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.549794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.550496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.550786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.551063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.551708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.553703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.644930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4026/8028] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:32.646671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.659551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ebec-671c-4f86-8c6e-f7d5f5e0ef0a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.759115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.759920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.760207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.760606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.761283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.763869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.801722 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4003/8029] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:32 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:32.802395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.818932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce0eb-ee52-492c-b8bd-aaf6c094f8c0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.824018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.824641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.824923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.825196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.825886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.827501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.842681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4027/8030] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:38:32.844633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.859354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686a4c-658f-4bad-9c10-b4da44178e7b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.866171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.867489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.867956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.868616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.869492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.871886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882c86c-b0c9-4c5e-926a-06f38937533f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.891296 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4004/8031] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:32.892125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:32.910690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083734ff-c0af-429d-bfe1-373ff2912eba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:32.916096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:32.917632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.918364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.919091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] PATH_INFO: `/v3/projects/8eeb0489ee8f4e9dbbcb33ed3263c0bb/users/cd2b15ca74604287bbc113c051f0ebde/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:32.940712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb0489ee8f4e9dbbcb33ed3263c0bb, user_id=cd2b15ca74604287bbc113c051f0ebde, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:32.944597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:32.977628 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4028/8032] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:32 2022] PUT /identity/v3/projects/8eeb0489ee8f4e9dbbcb33ed3263c0bb/users/cd2b15ca74604287bbc113c051f0ebde/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:38:32.980602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:32.980895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:32.981199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:33.008748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:33.010006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:33.076878 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:33.123413 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4005/8033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:33.134631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:33.136479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:33.144669 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:33.230289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835e6c7-c1c8-448f-aa6e-e3d6fef41bf8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:33.234750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:33.235396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:33.235666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:33.236503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:33.248574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:33.250214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26184d-a77e-436c-8079-5a24e5cff29f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:33.262781 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4029/8034] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:34.761681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:34.763187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:34.798638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58740-ad22-4dea-8c3c-53d69fd8cff1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:34.810052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:34.816609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:34.816898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:34.817249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] PATH_INFO: `/v3/users/85b93d8f66414011aeda3a2add5b51b9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:34.822650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b93d8f66414011aeda3a2add5b51b9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:34.826824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:34.993520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b93d8f66414011aeda3a2add5b51b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:34.994201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b93d8f66414011aeda3a2add5b51b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:35.030257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b93d8f66414011aeda3a2add5b51b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:35.064527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b93d8f66414011aeda3a2add5b51b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:35.065767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b93d8f66414011aeda3a2add5b51b9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:35.096266 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4006/8035] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:34 2022] DELETE /identity/v3/users/85b93d8f66414011aeda3a2add5b51b9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:35.097759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:35.098747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:35.098747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:35.138959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:35.140529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:35.370675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4030/8036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:35.382213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:35.383708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:35.535835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e41f-9521-4993-9265-ff9bce9bb046 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:35.549073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:35.549758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:35.550044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:35.550324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:35.575858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:35.577363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:35.605829 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4007/8037] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:36.199455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:36.202180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:36.226700 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2dab4-5d2b-46cf-80e7-2fc15ad0573f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:36.239174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:36.239851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:36.240143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:36.240417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] PATH_INFO: `/v3/projects/c79f4a04af0943b99e8181e098025813` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:36.241819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79f4a04af0943b99e8181e098025813)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:36.245429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:36.399617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79f4a04af0943b99e8181e098025813', 'request_id': 'req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.421147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79f4a04af0943b99e8181e098025813', 'request_id': 'req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.445943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79f4a04af0943b99e8181e098025813', 'request_id': 'req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.494414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] The token cache is being invalidate because project c79f4a04af0943b99e8181e098025813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:36.495105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.496319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.502065 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4031/8038] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:36 2022] DELETE /identity/v3/projects/c79f4a04af0943b99e8181e098025813 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:36.502777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:36.519528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500a7b-8f60-4b5f-8a10-3bb967c4720a service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:36.673950 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:36.697374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:36.698075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:36.700857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:36.701168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] PATH_INFO: `/v3/users/f80c2d9ac852424a9c6adb4ab8d1e839` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:36.703236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80c2d9ac852424a9c6adb4ab8d1e839)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:36.705982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:36.820497 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80c2d9ac852424a9c6adb4ab8d1e839'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.828150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80c2d9ac852424a9c6adb4ab8d1e839'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.839287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80c2d9ac852424a9c6adb4ab8d1e839'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.877471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80c2d9ac852424a9c6adb4ab8d1e839'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.878468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c986377f-38f6-41a9-a638-d85f725cc6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80c2d9ac852424a9c6adb4ab8d1e839'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:36.967492 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4008/8039] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:38:36 2022] DELETE /identity/v3/users/f80c2d9ac852424a9c6adb4ab8d1e839 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:37.622719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:37.625057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:37.665483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e62e-26bb-4a9a-9ff6-7aad686a5b62 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:37.763852 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:37.859481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:37.861396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:37.863609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:37.864736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] PATH_INFO: `/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:37.867233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4da0bfbd5d3421fa365f6ab82fd2e18)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:37.870949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.014816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4da0bfbd5d3421fa365f6ab82fd2e18', 'request_id': 'req-e0228b12-48e9-4bef-847d-4e1cc2e5152d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:38.037362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4da0bfbd5d3421fa365f6ab82fd2e18', 'request_id': 'req-e0228b12-48e9-4bef-847d-4e1cc2e5152d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:38.050661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4da0bfbd5d3421fa365f6ab82fd2e18', 'request_id': 'req-e0228b12-48e9-4bef-847d-4e1cc2e5152d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:38.073709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] The token cache is being invalidate because project d4da0bfbd5d3421fa365f6ab82fd2e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:38:38.074635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:38.075470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e0228b12-48e9-4bef-847d-4e1cc2e5152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:38:38.077758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4032/8040] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:38:37 2022] DELETE /identity/v3/projects/d4da0bfbd5d3421fa365f6ab82fd2e18 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:38.084277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.084792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.084896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.114149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:38.117266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:38.336192 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4009/8041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:38.344805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.345851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.349204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.395183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:38.396430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:38.424960 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4033/8042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:38.425385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.438345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c732cb7-c8c9-42c0-a6b5-6e64377fcefa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.454935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.457165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.458430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.459487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.461950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:38:38.461950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:38.465076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.501125 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4010/8043] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:38:38.502569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.513920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1c8f-bc2b-40a5-803e-472965d87bcc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.520139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.520350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.520499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.520807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.521448 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:38.523389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.574755 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4034/8044] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:38 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:38:38.578936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.589881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b978f-18c7-46ca-8c42-a6fb9c1db758 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.701304 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:38.733340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.738257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.739251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.740262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.742374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:38.746944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.804121 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4011/8045] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:38 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:38.807278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.822441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b631-269a-46aa-a322-5c5b2a30e7c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.834683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.835330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.835620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.835888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.836745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:38.842783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.872096 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4035/8046] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:38:38.876401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.891405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53051e9-8868-4cf8-a435-ae6d412a2302 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.911162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.911805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.912092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.912958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:38.915492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:38.921885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98deb-3d19-4cd7-a959-5fbc333022b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:38.942485 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4012/8047] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:38.946204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:38.966298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318fae-2dbd-4576-943c-88bb69c2ba98 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:38.972254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:38.973203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:38.973718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:38.974181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] PATH_INFO: `/v3/projects/a01bd93d7ca24ae39ea8a94730ffa2cc/users/4e396b6c77264a30ab00cf9879a93fe4/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:39.002371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01bd93d7ca24ae39ea8a94730ffa2cc, user_id=4e396b6c77264a30ab00cf9879a93fe4, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:39.006647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:39.051981 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4036/8048] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:38 2022] PUT /identity/v3/projects/a01bd93d7ca24ae39ea8a94730ffa2cc/users/4e396b6c77264a30ab00cf9879a93fe4/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:39.057237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d96dc-1d8b-480b-bde1-11d61e27319f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:39.059036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d96dc-1d8b-480b-bde1-11d61e27319f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:39.059399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d96dc-1d8b-480b-bde1-11d61e27319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:39.113317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-590d96dc-1d8b-480b-bde1-11d61e27319f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:39.115087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-590d96dc-1d8b-480b-bde1-11d61e27319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:39.253812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4013/8049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:39.270010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:39.272828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:39.439529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef13-6922-4617-a3b0-ce86cabab305 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:39.444585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:39.445228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:39.445533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:39.445810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:39.462808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:39.464216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:39.477246 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:39.490146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4037/8050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:40.361215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.361215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.361215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.432128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] MFA Rules not processed for user `cd2b15ca74604287bbc113c051f0ebde`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:40.433368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:40.571810 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4014/8051] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:40.576349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:40.577866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:40.598954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e72ba-b750-4c9d-b695-068e856ef7b1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:40.619143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:40.620854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.621141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.621436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.622243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:40.628653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:40.676597 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4038/8052] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:40 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:40.680558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:40.702424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea3c7-25f4-4da5-a479-29c33748e59d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:40.820632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:40.821356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.821774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.822056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.822728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:40.824679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033d41f-2d2e-4611-8265-a829298f58da admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:40.846575 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:40.866271 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4015/8053] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:40 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:38:40.870060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:40.884030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125106d-c56d-4e27-bce6-1c1f25357808 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:40.890549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.890927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.891310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.892346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:40.893203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.894399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.894995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.895941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:40.902144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:40.936312 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4039/8054] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:38:40.941653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:40.948833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] MFA Rules not processed for user `4e396b6c77264a30ab00cf9879a93fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:40.950231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:40.954904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae88-f628-49d4-abb1-4fe0657f6b93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:40.961315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:40.962291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:40.962976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:40.963544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] PATH_INFO: `/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f/users/d3c7bb9c166c451cb86437dcef383778/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:40.987347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e049640768d940b28f3ceaa1c7ec0a0f, user_id=d3c7bb9c166c451cb86437dcef383778, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:40.990662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.010740 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4040/8055] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:40 2022] PUT /identity/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f/users/d3c7bb9c166c451cb86437dcef383778/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:41.016385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.132712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4016/8056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:41.137828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.171366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee329-42f1-48a6-8705-2e7fd2e9141c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.181350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f5f77-cd04-445f-9c4f-88dcee918ff5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.186984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.187746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.188030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.188968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.192159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.195089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.197030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.197237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.200120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.200500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.201262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.203748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.233574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4041/8057] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:41.234926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.253208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cc304-68bd-4368-8fce-0be5d52c24b1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.260079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.260613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.263738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.263738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] PATH_INFO: `/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f/users/d3c7bb9c166c451cb86437dcef383778/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.264185 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4017/8058] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:38:41 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:41.264286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e049640768d940b28f3ceaa1c7ec0a0f, user_id=d3c7bb9c166c451cb86437dcef383778, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.265223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.267997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.289455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4042/8059] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:41 2022] PUT /identity/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f/users/d3c7bb9c166c451cb86437dcef383778/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:41.378397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760caa8-6111-45f4-bf4b-dead867e55d9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.484609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.485650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.485943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.486236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.486908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.489183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.522272 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:41.537007 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4018/8060] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:38:41 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:38:41.538375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.556378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d4d1-bcca-4c73-bf54-fa1098e7d852 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.589064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.589840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.593327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.594675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.597560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.600409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.644179 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4043/8061] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:41.648539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.676811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427ce2e-fe90-45f6-8aea-657317b9c5a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.686317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.687012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.687294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.687567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] PATH_INFO: `/v3/projects/2bbebf63655642bd8a2f931bd8ab6218/users/6353aaf469e64d79b676877136bd9678/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.710359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbebf63655642bd8a2f931bd8ab6218, user_id=6353aaf469e64d79b676877136bd9678, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.713894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.730226 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4019/8062] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:41 2022] PUT /identity/v3/projects/2bbebf63655642bd8a2f931bd8ab6218/users/6353aaf469e64d79b676877136bd9678/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:41.734231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.747786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a9d8-bd1e-49aa-8367-bb5c6540f65d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.869156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.870461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.870897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.871980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.875091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.878693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039ebea-6616-4902-9eb3-eab1eb3b341b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.908695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:41.909161 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4044/8063] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:38:41.924994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050e1-9c63-4da9-9d29-f46b99225791 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:41.936342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:41.937037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:41.937320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:41.939390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] PATH_INFO: `/v3/projects/2bbebf63655642bd8a2f931bd8ab6218/users/6353aaf469e64d79b676877136bd9678/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:41.943102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbebf63655642bd8a2f931bd8ab6218, user_id=6353aaf469e64d79b676877136bd9678, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:41.957030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8f828-eb1e-42a7-8b66-512ba82a4eaf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:41.987917 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4020/8064] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:38:41 2022] PUT /identity/v3/projects/2bbebf63655642bd8a2f931bd8ab6218/users/6353aaf469e64d79b676877136bd9678/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:38:43.645214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:43.645769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:43.645769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:43.685977 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:43.736874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] MFA Rules not processed for user `6353aaf469e64d79b676877136bd9678`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:43.738140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:43.996489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15014e-82e4-4f7e-b535-edd61bd662ac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:43.997124 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4045/8065] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:43.997568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15014e-82e4-4f7e-b535-edd61bd662ac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:43.998039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15014e-82e4-4f7e-b535-edd61bd662ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:44.043454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7c15014e-82e4-4f7e-b535-edd61bd662ac None None] MFA Rules not processed for user `4e396b6c77264a30ab00cf9879a93fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:44.046656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c15014e-82e4-4f7e-b535-edd61bd662ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:44.199260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4021/8066] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:44.211060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:44.213794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:44.533014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13afab-2c6f-433c-a739-cd748b1ea35f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:44.552763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:44.553759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:44.553759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:44.553978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:44.564222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:44.566136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:44.587142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4046/8067] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:48.544003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:48.544867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:48.545323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:48.577318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] MFA Rules not processed for user `d3c7bb9c166c451cb86437dcef383778`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:38:48.578790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:48.662388 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4022/8068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:38:48.674955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:38:48.676967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:38:48.794198 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:48.834163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed23ca7-8bef-4b82-88d2-73c2e9e5655e service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:38:48.839249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:38:48.840195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:38:48.840895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:38:48.841341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:38:48.957960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:38:48.960049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:38:48.973003 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4047/8069] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:38:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:38:58.659059 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:58.967970 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=33 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:03.980698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:03.982468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:04.062268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be7343-323b-43b9-bc8d-b84443fbf098 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:04.068474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:04.069328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:04.070196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:04.070639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:04.084448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:04.086352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c4be-6c5c-44c4-8345-437b58940a12 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:04.097675 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4023/8070] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:04.606801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:04.608745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:04.764063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36116-e4a0-4d00-a4c1-084fe58df950 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:04.770662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:04.771793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:04.772135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:04.772411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] PATH_INFO: `/v3/users/4ec1161d97a84fb2ab8d27491008c744` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:04.773745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec1161d97a84fb2ab8d27491008c744)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:04.776430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:04.879823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec1161d97a84fb2ab8d27491008c744'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:04.900060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec1161d97a84fb2ab8d27491008c744'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:04.922169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec1161d97a84fb2ab8d27491008c744'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:04.923749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec1161d97a84fb2ab8d27491008c744'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:04.924468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec1161d97a84fb2ab8d27491008c744'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:04.944635 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4048/8071] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:04 2022] DELETE /identity/v3/users/4ec1161d97a84fb2ab8d27491008c744 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:04.946625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:04.946916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:04.947188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:04.972251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:04.975251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:05.247173 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4024/8072] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:05.252681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:05.254611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:05.360678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b31f1-dcd9-4791-925d-780becb20df2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:05.364856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:05.365665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:05.366071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:05.366424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:05.379140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:05.380930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4349f-3b47-4728-8c95-6dca4f063e14 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:05.394465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4049/8073] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:05.666833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:05.668435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:05.701179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906e77-d873-4ab0-a607-029435d96cb0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:05.710063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:05.710714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:05.711004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:05.711271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] PATH_INFO: `/v3/projects/b788028d56a246d49f6586d6255e5f39` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:05.713507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b788028d56a246d49f6586d6255e5f39)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:05.715475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:05.793200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b788028d56a246d49f6586d6255e5f39', 'request_id': 'req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:05.805529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b788028d56a246d49f6586d6255e5f39', 'request_id': 'req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:05.816301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b788028d56a246d49f6586d6255e5f39', 'request_id': 'req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:05.836101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] The token cache is being invalidate because project b788028d56a246d49f6586d6255e5f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:05.836389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:05.837468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7d86a245-dfe8-4a6a-945b-dc773ca3fa72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:05.844450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4025/8074] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:05 2022] DELETE /identity/v3/projects/b788028d56a246d49f6586d6255e5f39 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:05.845463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:05.846264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:05.846264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:05.879733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:05.880891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:05.890823 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:05.958995 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4050/8075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:05.967594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:05.968096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:05.968596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:05.994851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:05.996953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:06.007730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4026/8076] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:06.011737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.024511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612a2de-ac5d-4391-a382-5600c8e4cbc8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.031685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.032496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.032795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.033057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.033762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:06.034063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.035819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.066541 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4051/8077] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:39:06.067694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.082733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af09c6a-15ec-4385-b721-e0074d79a84a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.088976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.089940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.090551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.091364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.092591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.101963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.137524 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:06.153993 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4027/8078] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:06 2022] POST /identity/v3/projects => generated 391 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:39:06.163954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.182799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9068d-9359-4b95-afea-6d824f3eb225 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.258200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.259393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.259969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.260556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.265757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.271380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.353884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.361520 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4052/8079] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:06 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:06.370512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253176-466d-47cf-9f64-63d38defc7fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.378102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.379652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.380164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.380417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.381092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.383098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.408168 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4028/8080] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:06.414087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.427104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef22fed-9ec0-409e-bad5-299350303c26 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.432236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.433574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.433861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.434135 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.434787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.436430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56e969-5536-46f5-ac88-6c3c43b2d5a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.449279 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4053/8081] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:39:06.455767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.468210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015b1c-832a-4c21-bc1e-5e9e94fc0eaf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.474486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.475160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.475450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.475726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] PATH_INFO: `/v3/projects/730e8636dd904fb792d8d85375d6ae43/users/434d3b799e2440c3bc42f9147927008b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.499381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=730e8636dd904fb792d8d85375d6ae43, user_id=434d3b799e2440c3bc42f9147927008b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.503348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.525117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4029/8082] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:06 2022] PUT /identity/v3/projects/730e8636dd904fb792d8d85375d6ae43/users/434d3b799e2440c3bc42f9147927008b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:39:06.537065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.537387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.537657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.571510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] MFA Rules not processed for user `434d3b799e2440c3bc42f9147927008b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:06.573632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:06.669544 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4054/8083] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:06.681324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:06.683346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:06.803514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d15eb-0950-4e38-83db-ab663669d7db admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:06.808201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:06.809159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:06.809669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:06.810175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:06.837003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:06.838834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451066c-3729-40a3-ad41-2f6a3387911c service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:06.900342 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4030/8084] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:16.654044 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:16.895870 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:19.738537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:19.739999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:19.838832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c717202-1e2e-4ffd-93d9-175e38b933f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:19.848253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:19.849175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:19.849503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:19.849906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] PATH_INFO: `/v3/users/27ce23a385624f7c9bda573978f691d0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:19.851575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce23a385624f7c9bda573978f691d0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:19.855951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:19.975340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce23a385624f7c9bda573978f691d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:20.005736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce23a385624f7c9bda573978f691d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:20.039251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce23a385624f7c9bda573978f691d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:20.040741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce23a385624f7c9bda573978f691d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:20.044197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce23a385624f7c9bda573978f691d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:20.095240 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4055/8085] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:19 2022] DELETE /identity/v3/users/27ce23a385624f7c9bda573978f691d0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:20.096530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:20.097390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:20.097896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:20.134436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:20.136045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:20.321115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4031/8086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:20.331485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:20.333143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:20.561143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029b4f9-1da0-4811-8a9c-0a629897af83 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:20.582478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:20.583269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:20.583655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:20.584032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:20.626917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:20.629878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd16b6-8dbe-4bda-a23a-09f9c4307f62 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:20.668916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4056/8087] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:21.251512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:21.254770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:21.269299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95086ec5-a23c-4ccc-abad-af02b1c6d8d3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:21.274548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:21.275483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:21.275978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:21.276461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] PATH_INFO: `/v3/projects/3fa6725b7c63416393357e71e073b582` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:21.280342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa6725b7c63416393357e71e073b582)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:21.288116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:21.398640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa6725b7c63416393357e71e073b582', 'request_id': 'req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:21.417233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa6725b7c63416393357e71e073b582', 'request_id': 'req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:21.437742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa6725b7c63416393357e71e073b582', 'request_id': 'req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:21.487021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] The token cache is being invalidate because project 3fa6725b7c63416393357e71e073b582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:21.487578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:21.489183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ee6cd4ff-ed68-4a67-af28-fecf68b6e16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:21.493896 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4032/8088] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:21 2022] DELETE /identity/v3/projects/3fa6725b7c63416393357e71e073b582 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:21.495631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111496c-af84-4739-82b3-de022d056d40 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:21.496138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111496c-af84-4739-82b3-de022d056d40 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:21.496242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111496c-af84-4739-82b3-de022d056d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:21.549946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c111496c-af84-4739-82b3-de022d056d40 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:21.551320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c111496c-af84-4739-82b3-de022d056d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:21.606869 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:21.727436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4057/8089] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:21.737116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:21.737494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:21.737729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:21.796280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:21.798380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:21.845705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4033/8090] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:21.847493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111496c-af84-4739-82b3-de022d056d40 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:21.865798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111496c-af84-4739-82b3-de022d056d40 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:21.883792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:21.884441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:21.884715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:21.884993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:21.886911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:21.886911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:21.888816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:21.932769 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4058/8091] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:21.935248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:21.945384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b3d9-3e75-4e77-847c-3fd042bcbb69 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:21.962828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:21.963547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:21.964220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:21.964603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:21.965486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:21.973990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.070532 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4034/8092] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:21 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:22.074810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:22.091942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafa55-1101-4a8e-8d1c-2b053fc09695 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:22.263964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:22.263964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.263964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.263964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.266401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:22.268238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.350889 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4059/8093] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:22 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:22.352517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:22.388900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf37214-0bba-4cd6-88a3-6f35946e49ac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:22.400532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:22.401170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.401472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.405240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.411054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:22.420805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.443780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4035/8094] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:22.447487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:22.460729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe63337-a877-490a-b55c-b10651caa8e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:22.469729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:22.470648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.473240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.473778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.474627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:22.478768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e408c6-3854-40ef-b023-1c65f08c8273 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.505246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:22.512103 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4060/8095] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:22.518571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc59e8-22bc-4f96-8d56-011f47137707 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:22.531466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:22.532626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.533142 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.533689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] PATH_INFO: `/v3/projects/2d100b5817204d27a204b4656b320112/users/bcdc1aebd9ed467ea3315a675b6c425a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.554691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d100b5817204d27a204b4656b320112, user_id=bcdc1aebd9ed467ea3315a675b6c425a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:22.559916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.598525 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4036/8096] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:22 2022] PUT /identity/v3/projects/2d100b5817204d27a204b4656b320112/users/bcdc1aebd9ed467ea3315a675b6c425a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:22.599790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.600080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.600426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.637229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] MFA Rules not processed for user `bcdc1aebd9ed467ea3315a675b6c425a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:22.646497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:22.759309 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4061/8097] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:22.773639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:22.775878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:22.813570 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:22.885387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25e28-9531-4cf7-9e3a-f52cde7a4eb9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:22.890368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:22.892781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:22.893348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:22.893936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:22.903950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:22.905737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:22.928705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4037/8098] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:27.566405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:27.567917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:27.598342 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:27.678061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36256197-946f-40e5-9ad2-e52696403dc5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:27.683607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:27.684419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:27.684799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:27.685170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:27.687203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:27.759420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:27.761209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716dba0-00c7-4e85-b679-aa99fc0ee5bb service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:27.772031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4062/8099] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:39:29.471322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:29.473308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:29.679670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d075cd-4e5b-49ea-9619-b79a4a77637d service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:29.701144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:29.701974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:29.702359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:29.704687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] PATH_INFO: `/v3/users/434d3b799e2440c3bc42f9147927008b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:29.706763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434d3b799e2440c3bc42f9147927008b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:29.714007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:29.800764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434d3b799e2440c3bc42f9147927008b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:29.801885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434d3b799e2440c3bc42f9147927008b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:29.810438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434d3b799e2440c3bc42f9147927008b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:29.829237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434d3b799e2440c3bc42f9147927008b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:29.830448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434d3b799e2440c3bc42f9147927008b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:29.872530 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4038/8100] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:29 2022] DELETE /identity/v3/users/434d3b799e2440c3bc42f9147927008b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:29.874033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:29.874485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:29.874601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:29.913576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:29.917119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:30.099557 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4063/8101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:30.108351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:30.117984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:30.214546 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:30.243477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9a77-0ff4-46d5-b48c-b9fe7df83235 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:30.253008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:30.253826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:30.254217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:30.254603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:30.281706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:30.284452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555818-536a-4ced-87fa-3d3be8c1bb43 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:30.306437 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4039/8102] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:30.902140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:30.903834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:30.943234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636773f7-3ca8-44e0-b505-c3be14fcce28 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:30.958341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:30.959010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:30.959290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:30.959566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] PATH_INFO: `/v3/projects/730e8636dd904fb792d8d85375d6ae43` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:30.964873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=730e8636dd904fb792d8d85375d6ae43)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:30.972682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.076500 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:31.084967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730e8636dd904fb792d8d85375d6ae43', 'request_id': 'req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:31.099414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730e8636dd904fb792d8d85375d6ae43', 'request_id': 'req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:31.108562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730e8636dd904fb792d8d85375d6ae43', 'request_id': 'req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:31.127414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] The token cache is being invalidate because project 730e8636dd904fb792d8d85375d6ae43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:31.127863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:31.128755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acd6e3bd-2808-4bc6-9d36-1b86d34247ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:31.133456 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4064/8103] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:30 2022] DELETE /identity/v3/projects/730e8636dd904fb792d8d85375d6ae43 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:31.136675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.138053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.138539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.191101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:31.200462 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:31.401934 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4040/8104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:31.410317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.410613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.410893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.460902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:31.462369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:31.489679 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4065/8105] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:31.491487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:31.509678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e04399-8a41-4350-9c5f-e3d57ab19ccc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:31.520400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:31.521034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.521315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.521614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.522273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:31.522575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:31.527865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.550391 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4041/8106] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:31.554650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:31.568381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2f74-c0f6-4772-b298-8fd0b90de2f4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:31.575109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:31.576191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.576629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.577298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.579643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:31.583483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.627865 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4066/8107] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:31 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:31.630797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:31.651507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d1cf-87f9-474f-99ee-30c0f6c2e1c1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:31.759565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:31.760315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.760669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.761012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.761794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:31.763874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.809568 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4042/8108] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:31 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:31.815140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:31.834816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ad37-30fd-4253-8168-0924d241bb34 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:31.842112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:31.844409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.844634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.844960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.846040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:31.864994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.930941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4067/8109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:31.932398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:31.953789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e4b2-eeef-46c5-ac90-9706ac588792 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:31.962720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:31.963526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:31.964805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:31.965211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:31.967265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:31.972201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552475-b2b9-4281-a143-b5e82209bc47 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:31.997795 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4043/8110] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:32.001618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:32.030854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf1e-60be-408a-b5c5-c5063fd20d3c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:32.043664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:32.046054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:32.046350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:32.046961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] PATH_INFO: `/v3/projects/8fedb1eb11a4417faab1907468b5f4bd/users/ad002cc3bb5e407685f6cd8a34f5d478/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:32.073943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fedb1eb11a4417faab1907468b5f4bd, user_id=ad002cc3bb5e407685f6cd8a34f5d478, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:32.080273 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:32.136224 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4068/8111] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:32 2022] PUT /identity/v3/projects/8fedb1eb11a4417faab1907468b5f4bd/users/ad002cc3bb5e407685f6cd8a34f5d478/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:32.138105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:32.138565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:32.138684 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:32.177815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:32.183471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:32.310710 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:32.346952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4044/8112] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:32.361019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:32.365204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:32.506184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a0836-4bfa-40ac-a946-4fd370d6b668 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:32.510720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:32.511876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:32.512240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:32.512588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:32.539562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:32.546428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:32.577148 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4069/8113] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:32.726929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:32.742533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a7cd-137e-49bf-9688-81d950e14649 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:32.746808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:32.747725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:32.748021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:32.748295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:32.751037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:32.767268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:32.768850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c88e7-0b49-478f-98a4-c1c82d6a35de service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:32.797523 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4045/8114] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:37.931515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:37.933515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:37.986142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5caca-856d-4f09-a10d-0e503ca087d2 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:38.003934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:38.004598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:38.004888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:38.005155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] PATH_INFO: `/v3/users/bcdc1aebd9ed467ea3315a675b6c425a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:38.011587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdc1aebd9ed467ea3315a675b6c425a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:38.014236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:38.219681 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdc1aebd9ed467ea3315a675b6c425a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:38.260523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdc1aebd9ed467ea3315a675b6c425a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:38.312708 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:38.342342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdc1aebd9ed467ea3315a675b6c425a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:38.346016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdc1aebd9ed467ea3315a675b6c425a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:38.347885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdc1aebd9ed467ea3315a675b6c425a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:38.395230 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4070/8115] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:37 2022] DELETE /identity/v3/users/bcdc1aebd9ed467ea3315a675b6c425a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:38.399758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:38.400263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:38.400380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:38.450514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:38.454997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:38.608207 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4046/8116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:38.618722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:38.620977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:38.733295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937175cd-5384-4ae8-a5bf-b82c0459a419 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:38.742412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:38.746145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:38.746436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:38.747735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:38.774275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:38.775972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637cfd-408e-4dab-b9a5-3e7b536e87d9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:38.835427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4071/8117] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:39.982847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:39.985392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:40.102244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17909e50-d622-43db-a11f-ffca163fbaca None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:40.136439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:40.149563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:40.149964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:40.150162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] PATH_INFO: `/v3/projects/2d100b5817204d27a204b4656b320112` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:40.154327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d100b5817204d27a204b4656b320112)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:40.157368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:40.310506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d100b5817204d27a204b4656b320112', 'request_id': 'req-1b9da48c-fcad-4334-90fd-fd0180d5baa5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:40.326839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d100b5817204d27a204b4656b320112', 'request_id': 'req-1b9da48c-fcad-4334-90fd-fd0180d5baa5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:40.352052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d100b5817204d27a204b4656b320112', 'request_id': 'req-1b9da48c-fcad-4334-90fd-fd0180d5baa5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:40.401276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] The token cache is being invalidate because project 2d100b5817204d27a204b4656b320112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:40.401945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:40.403227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1b9da48c-fcad-4334-90fd-fd0180d5baa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:40.408032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4047/8118] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:39 2022] DELETE /identity/v3/projects/2d100b5817204d27a204b4656b320112 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:40.414881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:40.416299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:40.417347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:40.448990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:40.451716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:40.587731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4072/8119] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:40.597681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:40.597986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:40.598311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:40.657346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:40.658890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:40.669291 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4048/8120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:40.673505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:40.688507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb31df1-3b0b-4c15-845a-a9f215839c97 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:40.703323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:40.706303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:40.707002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:40.708207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:40.709133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:40.710959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:40.714529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:40.751465 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4073/8121] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:40.752667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:40.769818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6580631-1069-4575-bc50-a68f7962a185 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:40.782464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:40.783397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:40.783686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:40.783960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:40.784667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:40.790843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:40.873804 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4049/8122] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:40 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:40.878650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:40.897962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2782ac-19be-4db7-85aa-9eef92c9bc03 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:41.068453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:41.069095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.069907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.069907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.070344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:41.072407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:41.133860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4074/8123] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:40 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:41.136776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:41.159540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb129e45-17e1-472b-a74e-fddef7fc4157 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:41.190858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:41.190858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.190858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.190858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.191360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:41.191360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:41.224714 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4050/8124] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:41.229261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:41.236654 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:41.244506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376c15-b614-4b88-b0d4-e9c66f0f161c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:41.254678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:41.255656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.256376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.256832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.257754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:41.278140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd35800-28d1-4d9e-ac64-826a648b2600 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:41.291524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4075/8125] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:41.295995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:41.324211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0406-ed44-4d4c-bd11-5d5ff881db16 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:41.335086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:41.335789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.336070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.336345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] PATH_INFO: `/v3/projects/c469ad30140e4606b4b96d90748eca32/users/9c98e31cf8a6457089e0a2922df33a7d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.382368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c469ad30140e4606b4b96d90748eca32, user_id=9c98e31cf8a6457089e0a2922df33a7d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:41.390464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:41.419578 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:41.428705 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4051/8126] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:41 2022] PUT /identity/v3/projects/c469ad30140e4606b4b96d90748eca32/users/9c98e31cf8a6457089e0a2922df33a7d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:41.443028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.443557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.443557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.499727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] MFA Rules not processed for user `9c98e31cf8a6457089e0a2922df33a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:41.500969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:41.671481 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4076/8127] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:41.676112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:41.798634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262cce8-ef7a-45c1-a7e6-8b1b6a8e3f7e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:41.805992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:41.806845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:41.807542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:41.809053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:41.809909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:41.815489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:41.871260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4052/8128] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:41 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:41.876958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:41.894990 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070863c-d81f-49b9-b388-b232879a4241 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.067863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.068507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.071802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.072259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.099847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.120838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.123123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.137847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.175901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa397-ecbd-4a3e-b3a2-60cb53c814ae admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.185746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.188691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.193313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.193824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] PATH_INFO: `/v3/users/0f8c7f57af21464684837dcce49d4d0b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.206749 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4077/8129] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:41 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:39:42.210383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.210877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8c7f57af21464684837dcce49d4d0b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.213011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.240456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12282-7b2e-4a70-9b3c-77f36fc7e4c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.252112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.252829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.253300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.253675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.254397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.262705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.281786 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4078/8130] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:42.283009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.310874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150b2c1-7df3-45d2-8c1a-afe833ba44b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.319539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.321006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.321006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.321006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] PATH_INFO: `/v3/projects/ea3d6ff6125e411ebc7c028bab67717a/users/757fa3e407824ce8afc24c2c5620cda5/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.343324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8c7f57af21464684837dcce49d4d0b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:42.345238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8c7f57af21464684837dcce49d4d0b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:42.356451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8c7f57af21464684837dcce49d4d0b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:42.366106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3d6ff6125e411ebc7c028bab67717a, user_id=757fa3e407824ce8afc24c2c5620cda5, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.369786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f7fd-97d7-43ea-8cf3-b03d4a69c9cf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.392883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8c7f57af21464684837dcce49d4d0b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:42.394055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-302d0ef7-a57e-4a45-ad22-10c754815a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8c7f57af21464684837dcce49d4d0b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:42.411605 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4079/8131] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:42 2022] PUT /identity/v3/projects/ea3d6ff6125e411ebc7c028bab67717a/users/757fa3e407824ce8afc24c2c5620cda5/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:42.422165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.422932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.423602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.427086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4053/8132] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:42 2022] DELETE /identity/v3/users/0f8c7f57af21464684837dcce49d4d0b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:39:42.470764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.472461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.473092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.496260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] MFA Rules not processed for user `757fa3e407824ce8afc24c2c5620cda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:42.496260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.556544 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:42.592711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] MFA Rules not processed for user `ad002cc3bb5e407685f6cd8a34f5d478`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:42.594834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.667443 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4080/8133] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:42.696656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.698186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.737081 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:42.768107 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4054/8134] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:42.769331 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.771517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.873114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69a16-3728-4658-b98e-b6406b31efc0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.893892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.894759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.895176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.895459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.897267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f42d-2d80-43d3-adf5-7b7a78878c4b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:42.910034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:42.910677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:42.912888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.914528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.916769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:42.917055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:42.917753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:42.919852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:42.951539 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4081/8135] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:39:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:39:42.953808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:42.957542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:42.995267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01486e-b531-494e-9d60-9221ba037a19 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.001071 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4055/8136] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:42 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:43.004413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.125944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0899-ec02-47f0-a835-90a003a9d538 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.131692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.132480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.132770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.133046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.133721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.137338 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.198196 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4056/8137] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:43 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:43.199968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.223528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b499-0092-4152-a673-c2e7db59082e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.236324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.237004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.237295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.240230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] PATH_INFO: `/v3/projects/1c215ba6bfd84b8fb7e6b170b813b517` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.242338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c215ba6bfd84b8fb7e6b170b813b517)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.244300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.275251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.276625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.277111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.277848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.278717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.282636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.324434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4057/8138] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:43.325382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.348631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94db43b-4efd-4161-ae0b-bebf8e25dea9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.362692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.362692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.362692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.362692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] PATH_INFO: `/v3/projects/ed8349d478f84521b6ed9053eac1b663/users/f587a25aace441009e0a7c49fa89b7ef/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.392819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c215ba6bfd84b8fb7e6b170b813b517', 'request_id': 'req-7242789f-8526-485f-b73f-4d1946a9a038'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:43.408859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c215ba6bfd84b8fb7e6b170b813b517', 'request_id': 'req-7242789f-8526-485f-b73f-4d1946a9a038'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:43.409635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8349d478f84521b6ed9053eac1b663, user_id=f587a25aace441009e0a7c49fa89b7ef, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.413857 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:43.427637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c215ba6bfd84b8fb7e6b170b813b517', 'request_id': 'req-7242789f-8526-485f-b73f-4d1946a9a038'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:43.434565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.458348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] The token cache is being invalidate because project 1c215ba6bfd84b8fb7e6b170b813b517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:43.458688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:43.460313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7242789f-8526-485f-b73f-4d1946a9a038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:43.462250 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4082/8139] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:42 2022] DELETE /identity/v3/projects/1c215ba6bfd84b8fb7e6b170b813b517 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:43.467260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd52dd8-35be-41b5-aaee-1350c38546e5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.467553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd52dd8-35be-41b5-aaee-1350c38546e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.467837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd52dd8-35be-41b5-aaee-1350c38546e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.482329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4058/8140] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:43 2022] PUT /identity/v3/projects/ed8349d478f84521b6ed9053eac1b663/users/f587a25aace441009e0a7c49fa89b7ef/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:43.487201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.490286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:43.495257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ccd52dd8-35be-41b5-aaee-1350c38546e5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:43.496550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ccd52dd8-35be-41b5-aaee-1350c38546e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:43.572938 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:43.579086 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4083/8141] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:43.588141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.588443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.589185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.631790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:43.633032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:43.648574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4084/8142] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:43.653085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.663291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db721f14-ca17-449e-9c5e-f53fa4d54e11 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.671781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.672875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.674947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.675927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.676813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.679797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.692848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4059/8143] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:39:43.693442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2367-4c6a-417c-bb35-6352c94b7f4d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.696873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.710774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.713719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.714391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.715841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.718510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:43.718977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.720092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b7ae0-f56f-4000-8b2e-7a4276a89d38 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.723689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.732567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.746541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.747778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.748688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] PATH_INFO: `/v3/projects/ed8349d478f84521b6ed9053eac1b663/users/f587a25aace441009e0a7c49fa89b7ef/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.748958 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4085/8144] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:43.753702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.756464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8349d478f84521b6ed9053eac1b663, user_id=f587a25aace441009e0a7c49fa89b7ef, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.762255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.776552 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4060/8145] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:43 2022] PUT /identity/v3/projects/ed8349d478f84521b6ed9053eac1b663/users/f587a25aace441009e0a7c49fa89b7ef/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:39:43.811714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f0df-855d-46c4-899e-0f764d46c17c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:43.916722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:43.917395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:43.917705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:43.917977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:43.918660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:43.920974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:43.963262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4086/8146] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:43 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:43.967187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.974051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:43.975769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:43.985526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d887-d1d9-43a9-a172-9e3c0614f2d4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.092011 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:44.116033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2925-f6ce-4440-94c7-bee159657150 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.123371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.124111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.124549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.125138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] PATH_INFO: `/v3/users/9c98e31cf8a6457089e0a2922df33a7d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.126786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c98e31cf8a6457089e0a2922df33a7d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.143102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.177219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.177871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.178153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.178430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.179430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.181559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.242678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4061/8147] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:43 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:44.255733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:44.260017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c98e31cf8a6457089e0a2922df33a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:44.274009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f56849-bf3c-46bd-822a-ae68fa458684 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.281963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c98e31cf8a6457089e0a2922df33a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:44.288938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.289765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.290044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.290315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.290967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.295863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.308045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c98e31cf8a6457089e0a2922df33a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:44.309538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c98e31cf8a6457089e0a2922df33a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:44.312894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7ae65ef7-81e0-4c03-81c4-f7400bb8b939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c98e31cf8a6457089e0a2922df33a7d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:44.340706 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4087/8148] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:43 2022] DELETE /identity/v3/users/9c98e31cf8a6457089e0a2922df33a7d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:44.351045 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4062/8149] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:39:44.354896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:44.355306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.355602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.355991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.356958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:44.390629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb6c9b-8231-43ba-aadd-49b6e112bd67 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.393004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:44.394293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:44.507385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.508421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.509098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.509467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.510273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.512292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.534564 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4063/8150] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:44.538745 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4088/8151] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:44.539254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:44.548814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:44.550299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:44.567787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759363c-1150-4d0e-a9b6-8879dcde1992 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.580711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.582646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.583439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.583724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] PATH_INFO: `/v3/projects/3682c1ffb86e44b990db78f7d82ff21c/users/843656b1ab4b43cbb3df67b116c754a1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.625598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3682c1ffb86e44b990db78f7d82ff21c, user_id=843656b1ab4b43cbb3df67b116c754a1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.633361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157d3ad-386e-4cb1-930d-0d06882d2d07 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.650771 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:44.663285 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4064/8152] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:44 2022] PUT /identity/v3/projects/3682c1ffb86e44b990db78f7d82ff21c/users/843656b1ab4b43cbb3df67b116c754a1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:44.671028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.672389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.672766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.704471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748b3f2-0cf6-4a28-ad32-78ce0a7ae6e3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.720513 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:44.722171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:44.723428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:44.776453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.777912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.778340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.778692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.883590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.885701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.899479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4065/8153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:44.909792 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4089/8154] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:44.910393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:44.912190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:44.934673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc728-47ee-4ee9-b805-88ac83dfb9d5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:44.939316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:44.940187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:44.940480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:44.940760 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:44.964370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:44.966710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:44.986671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4066/8155] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:45.718795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:45.720779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:45.760139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516d00-b717-48a6-beff-b1dff9083da0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:45.775637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:45.776369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:45.776657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:45.776937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] PATH_INFO: `/v3/projects/c469ad30140e4606b4b96d90748eca32` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:45.778860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c469ad30140e4606b4b96d90748eca32)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:45.783149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:45.850831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c469ad30140e4606b4b96d90748eca32', 'request_id': 'req-c8e05745-78c7-492f-8234-7e35227e5091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:45.859512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c469ad30140e4606b4b96d90748eca32', 'request_id': 'req-c8e05745-78c7-492f-8234-7e35227e5091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:45.866785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c469ad30140e4606b4b96d90748eca32', 'request_id': 'req-c8e05745-78c7-492f-8234-7e35227e5091'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:45.889021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] The token cache is being invalidate because project c469ad30140e4606b4b96d90748eca32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:45.889385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:45.890186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:45.893048 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4090/8156] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:45 2022] DELETE /identity/v3/projects/c469ad30140e4606b4b96d90748eca32 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:45.898751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:45.913632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8538ab-4e71-49f5-9b8b-20048c873f4c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:46.018039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:46.018813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:46.020203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:46.020658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] PATH_INFO: `/v3/users/757fa3e407824ce8afc24c2c5620cda5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:46.023084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=757fa3e407824ce8afc24c2c5620cda5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:46.031978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:46.147702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757fa3e407824ce8afc24c2c5620cda5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:46.150901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757fa3e407824ce8afc24c2c5620cda5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:46.174222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757fa3e407824ce8afc24c2c5620cda5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:46.224467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757fa3e407824ce8afc24c2c5620cda5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:46.225165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f8f642ac-6020-4024-93d5-722ceeef18ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757fa3e407824ce8afc24c2c5620cda5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:46.254928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4067/8157] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:45 2022] DELETE /identity/v3/users/757fa3e407824ce8afc24c2c5620cda5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:47.772408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:47.774064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:47.795264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e05745-78c7-492f-8234-7e35227e5091 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:47.909568 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:47.954467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:47.955142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:47.955428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:47.955705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] PATH_INFO: `/v3/projects/ea3d6ff6125e411ebc7c028bab67717a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:47.957744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3d6ff6125e411ebc7c028bab67717a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:47.963619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:48.087673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3d6ff6125e411ebc7c028bab67717a', 'request_id': 'req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:48.100238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3d6ff6125e411ebc7c028bab67717a', 'request_id': 'req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:48.115739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3d6ff6125e411ebc7c028bab67717a', 'request_id': 'req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:48.138611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] The token cache is being invalidate because project ea3d6ff6125e411ebc7c028bab67717a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:48.139056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:48.140076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8b9fb10b-6c6a-4748-b4b6-6d7e864ed0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:48.143769 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4091/8158] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:47 2022] DELETE /identity/v3/projects/ea3d6ff6125e411ebc7c028bab67717a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:48.148682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.149187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.149303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.166162 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:48.194782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:48.198714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:48.446042 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4068/8159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:48.447359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.447718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.448068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.485421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:48.493480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:48.526973 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4092/8160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:39:48.531126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:48.550603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f10a7-0fd6-449a-9824-3c5668a3eef0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:48.569521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:48.570426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.570786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.572704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.573445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:48.573828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:48.575617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:48.605063 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4069/8161] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:48.609219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:48.622737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8977-13db-44a8-9669-afb5d9beeea9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:48.633375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:48.634067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.634351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.634628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.635276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:48.637379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:48.699997 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4093/8162] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:48 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:48.704841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:48.716085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12a982-3795-473d-9893-a14f2d6a0ffd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:48.823205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:48.823833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.824113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.826827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.828044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:48.830053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:48.881253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4070/8163] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:48 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:48.885427 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:48.903446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce425b1-4269-46da-8d1f-7cc7b84ff55b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:48.913370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:48.914458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:48.914741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:48.916878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:48.917593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:48.924541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:48.947895 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4094/8164] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:48.951332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:48.983524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0f799-e6a1-46db-b0f9-f695550f4bd0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:49.001830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:49.002614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:49.006367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:49.007506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:49.010365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:49.016740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e368d-de58-4ea3-b2c3-7d58f06604e2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:49.066426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4071/8165] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:49.068133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:49.084450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee178-2297-437d-ac5f-9677c4a98e6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:49.122364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:49.123067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:49.123350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:49.126590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] PATH_INFO: `/v3/projects/a4e85d53250b4a2199d2f4752befd0ce/users/53d8474a3c044fce8df935171472d514/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:49.182345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e85d53250b4a2199d2f4752befd0ce, user_id=53d8474a3c044fce8df935171472d514, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:49.188313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:49.215876 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4095/8166] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:49 2022] PUT /identity/v3/projects/a4e85d53250b4a2199d2f4752befd0ce/users/53d8474a3c044fce8df935171472d514/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:49.221553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:49.222022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:49.222111 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:49.251264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:49.252855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:49.409639 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4072/8167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:49.446818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:49.449150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:49.663442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f05a-9b24-48c4-a13d-edddab4f3a2a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:49.672303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:49.673003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:49.673369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:49.673869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:49.685570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:49.694605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:49.731712 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4096/8168] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:54.201980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:54.203488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:54.231446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b45b6-3e90-42de-b7b5-25d7c9108b07 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:54.246297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:54.249809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:54.251552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:54.251552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] PATH_INFO: `/v3/users/4e396b6c77264a30ab00cf9879a93fe4` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:54.255899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e396b6c77264a30ab00cf9879a93fe4)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:54.261068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:54.288296 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:54.450154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e396b6c77264a30ab00cf9879a93fe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:54.453370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e396b6c77264a30ab00cf9879a93fe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:54.490305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e396b6c77264a30ab00cf9879a93fe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:54.516650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e396b6c77264a30ab00cf9879a93fe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:54.517429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e396b6c77264a30ab00cf9879a93fe4'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:54.562009 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4073/8169] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:54 2022] DELETE /identity/v3/users/4e396b6c77264a30ab00cf9879a93fe4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:55.421711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:55.438406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3961c3-e112-4bc8-b11f-09e96a6398c1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:55.469261 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:55.630238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:55.630917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:55.636327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:55.636663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] PATH_INFO: `/v3/projects/a01bd93d7ca24ae39ea8a94730ffa2cc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:55.639377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01bd93d7ca24ae39ea8a94730ffa2cc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:55.662228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:55.850859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'request_id': 'req-378eac2a-4633-49df-aff5-40e0792b41e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:55.871583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'request_id': 'req-378eac2a-4633-49df-aff5-40e0792b41e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:55.914845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'request_id': 'req-378eac2a-4633-49df-aff5-40e0792b41e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:55.944364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] The token cache is being invalidate because project a01bd93d7ca24ae39ea8a94730ffa2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:55.945087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:55.946192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:55.951436 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4097/8170] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:55 2022] DELETE /identity/v3/projects/a01bd93d7ca24ae39ea8a94730ffa2cc => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:55.956195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:55.957698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:55.995428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd67ce-4494-4d54-a696-ed8a59a29fc7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:56.209289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:56.210174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:56.210659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:56.211110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] PATH_INFO: `/v3/users/6353aaf469e64d79b676877136bd9678` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:56.212678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6353aaf469e64d79b676877136bd9678)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:56.214867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:56.315964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6353aaf469e64d79b676877136bd9678'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:56.317914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6353aaf469e64d79b676877136bd9678'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:56.339794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6353aaf469e64d79b676877136bd9678'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:56.365931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6353aaf469e64d79b676877136bd9678'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:56.369719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-4bc76c56-30a6-43ae-a7b3-5207399d38f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6353aaf469e64d79b676877136bd9678'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:56.406119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4074/8171] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:39:55 2022] DELETE /identity/v3/users/6353aaf469e64d79b676877136bd9678 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:56.994762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:56.996325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:57.024900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eac2a-4633-49df-aff5-40e0792b41e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:57.262413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:57.268769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:57.269278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:57.269764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] PATH_INFO: `/v3/projects/2bbebf63655642bd8a2f931bd8ab6218` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:57.273669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbebf63655642bd8a2f931bd8ab6218)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:57.275661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:57.414730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbebf63655642bd8a2f931bd8ab6218', 'request_id': 'req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:57.419099 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:57.438589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbebf63655642bd8a2f931bd8ab6218', 'request_id': 'req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:57.472406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbebf63655642bd8a2f931bd8ab6218', 'request_id': 'req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:57.552721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] The token cache is being invalidate because project 2bbebf63655642bd8a2f931bd8ab6218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:39:57.553030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:57.554056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c86f34d7-b49a-4d75-9ac6-7687af6d4a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:39:57.557795 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4098/8172] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:39:56 2022] DELETE /identity/v3/projects/2bbebf63655642bd8a2f931bd8ab6218 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:39:57.563061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:57.563565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:57.563681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:57.571209 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:57.689066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:57.690353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:57.785667 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4075/8173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:57.793073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:57.793716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:57.794213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:57.826846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:57.828745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:57.838271 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4099/8174] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:57.842509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:57.854554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d5c5b-ddfc-4ee3-a9e1-b5d642c2ebbc None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:57.860230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:57.861612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:57.862007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:57.862395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:57.863186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:39:57.863604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:57.865921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:57.915795 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4076/8175] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:39:57.922118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:57.940112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9d86-d2a7-4d45-b323-ba1024c21650 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:57.965456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:57.966108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:57.966393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:57.966667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:57.967320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:57.989608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:58.071815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4100/8176] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:57 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:58.074483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:58.095891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42759-064a-4bed-a36a-bf4b461eb1a7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:58.260106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:58.260738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.261021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.261290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:58.262921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:58.265081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:58.317935 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4077/8177] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:58 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:58.318800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:58.339098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b308-abe2-436a-8fd3-e5e84604bdb1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:58.353725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:58.354383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.354665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.355141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:58.355631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:58.362008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:58.392586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:58.393771 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4101/8178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:39:58.405240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275151-64d9-4bd8-94ed-ca9898e09b0c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:58.422134 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:58.422913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.423199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.423798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:58.424709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:58.431346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efea99-77ac-4360-ac4e-a92d74914f90 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:58.478838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:58.489804 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4078/8179] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:58.495294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592290e5-1db1-438e-9214-6b5660e2c1d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:58.538088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:58.539087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.541538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.542178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] PATH_INFO: `/v3/projects/dab3451dbc8a4cf4946198af223294e2/users/c3fd1cc730c3474da38c6926d0bc1b97/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:58.603993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab3451dbc8a4cf4946198af223294e2, user_id=c3fd1cc730c3474da38c6926d0bc1b97, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:58.611049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a678a8-bef9-40dc-ab6d-62af105a53a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:58.699673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4102/8180] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:39:58 2022] PUT /identity/v3/projects/dab3451dbc8a4cf4946198af223294e2/users/c3fd1cc730c3474da38c6926d0bc1b97/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:39:58.711103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.711588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.711851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:58.810930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] MFA Rules not processed for user `c3fd1cc730c3474da38c6926d0bc1b97`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:58.839571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:58.909590 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:58.938388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7996-8a09-4284-a5c2-e294e144435e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:58.939004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7996-8a09-4284-a5c2-e294e144435e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:58.939668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7996-8a09-4284-a5c2-e294e144435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.012572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b4ae7996-8a09-4284-a5c2-e294e144435e None None] MFA Rules not processed for user `53d8474a3c044fce8df935171472d514`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:59.014137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4ae7996-8a09-4284-a5c2-e294e144435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:59.075910 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4079/8181] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:59.081415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.240036 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4103/8182] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:59.241539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.241830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.242100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.295343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781ff7c-e37f-40de-b674-9ba116ff4841 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.314801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.315441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.315723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.315996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.316645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.325608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.341558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] MFA Rules not processed for user `843656b1ab4b43cbb3df67b116c754a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:59.347024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:59.398780 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4080/8183] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/projects => generated 375 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:59.399886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.401976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:59.475774 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:59.523363 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4104/8184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:39:59.524247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.525000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a232-c050-47be-8d57-cc03a3b9e0c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.536259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea522a8-76f8-4f1e-b6eb-3fd3babf5303 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.538553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.539282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.539688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.540061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.540841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.545237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.545961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.546263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.546575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.547235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.549279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.551732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.593210 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4081/8185] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:59.594370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.596414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:59.596743 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4105/8186] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/users => generated 288 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:59.597962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.609768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835cda2-7b36-4539-8a4e-d6f93a3e1632 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.682324 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:59.745449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.746239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.746525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.746793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.747428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.749773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.756504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393617d-e26b-4783-b4c9-ad14618f596a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.762861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.763647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.764038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.764438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.803372 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4106/8187] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:39:59.804368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.823351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f9f5-1cb1-40b0-a766-bc37e1bcaa4c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.830715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.831414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.831737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.831958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.832620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.836090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2c01f-b0fc-4dcc-a4fe-3fae01730404 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.861082 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4107/8188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:59.861082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.861082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.861082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.878033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.880037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.912369 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4082/8189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:39:59.913346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:39:59.919757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] MFA Rules not processed for user `f587a25aace441009e0a7c49fa89b7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:39:59.922223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:39:59.937375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c20850-4bed-49c0-b14f-147cea88e34d service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:39:59.947275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:39:59.950621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:39:59.951062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:39:59.951457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:39:59.952285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:39:59.955966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:39:59.985029 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4083/8190] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:39:59.987953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.009781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031020-1d77-4054-93f9-234a309053c0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.023557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.024463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.025013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.036273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.037008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.038701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.041346 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4108/8191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:00.049429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.064653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697601-016d-4267-98ce-4fba71b04e83 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.076099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.076840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.077709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.078190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] PATH_INFO: `/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0/users/4693e5435d484d519b806ccddf83e1b9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.083374 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4084/8192] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:40:00.084453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.091227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:00.125996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e7627ce0114c99bc81f9e2c8c5e1c0, user_id=4693e5435d484d519b806ccddf83e1b9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.126923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4e26-ea39-417c-a650-0b4424ed6040 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.134145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.134769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.135107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.135357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.144260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.150811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.154745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.176751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4085/8193] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:00.177809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.189628 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4109/8194] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:00 2022] PUT /identity/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0/users/4693e5435d484d519b806ccddf83e1b9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:00.193099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d041-7b31-4f68-ad02-1dd970357743 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.193252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.211090 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:00.318256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.319210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.319904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.320357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] PATH_INFO: `/v3/projects/c258055a58804ea29636b5e5355bec55/users/fe5abab25afb4235b595ba6d22ba76d1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.341033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c258055a58804ea29636b5e5355bec55, user_id=fe5abab25afb4235b595ba6d22ba76d1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.346228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254b8d-5d0c-4b4f-abe9-a1297eabcd62 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.364158 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4086/8195] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:00 2022] PUT /identity/v3/projects/c258055a58804ea29636b5e5355bec55/users/fe5abab25afb4235b595ba6d22ba76d1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:00.386925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.387266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.387480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.401671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afd44-a216-4e7f-b435-ed85fbf4e884 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.509569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] MFA Rules not processed for user `fe5abab25afb4235b595ba6d22ba76d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:00.523385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:00.530727 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:00.575013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.575453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.575811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.576094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.576757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.584742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.617371 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4110/8196] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:40:00.622537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.647378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf626626-108c-4462-bd43-3523ccccba05 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.660110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.660902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.661189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.662423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] PATH_INFO: `/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0/users/4693e5435d484d519b806ccddf83e1b9/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.664465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e7627ce0114c99bc81f9e2c8c5e1c0, user_id=4693e5435d484d519b806ccddf83e1b9, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.668401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.690956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4087/8197] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:40:00.695601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.717358 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4111/8198] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:00 2022] PUT /identity/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0/users/4693e5435d484d519b806ccddf83e1b9/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:00.723941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d808d4-75a1-413d-8623-db234591d7cd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:00.740922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:00.747805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:00.825052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:00.825795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:00.826050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:00.826287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:00.828401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:00.830936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:00.879786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4088/8199] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:40:00 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:40:00.883692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.003866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28a6be-3dba-4667-b6a0-97a692c93ff0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.010101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7340-3419-4df6-a3d4-daae0d8d693a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.011953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.013195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.013438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.013997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.015283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.017883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.060508 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:01.064915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4089/8200] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:40:00 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:40:01.069628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.088285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf763d9-e3c0-4e10-94c5-6262df9f8e40 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.113228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.113882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.114165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.114438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.115090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.117596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.133032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.133923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.134629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.135036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.137951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:01.144677 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4090/8201] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:40:01.145893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.159694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.162096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.180531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844403-0428-4ff6-868e-d7d5e5a4325d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.196675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4112/8202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:40:01.210251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.210251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.210251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.210251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] PATH_INFO: `/v3/projects/ef12058acdff4b2099906810fa122564/users/d8866f7d1b104151a74c2f3c9008a98b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.220493 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:01.254034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef12058acdff4b2099906810fa122564, user_id=d8866f7d1b104151a74c2f3c9008a98b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.259098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.294964 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4091/8203] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:01 2022] PUT /identity/v3/projects/ef12058acdff4b2099906810fa122564/users/d8866f7d1b104151a74c2f3c9008a98b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:01.300996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.403012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e5028-f2c8-4a57-b2ec-be7e7a043fec service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.599015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.599808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.600205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.601989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.602811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.604579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.643727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.659125 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4113/8204] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:40:01.659583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b0ae-bec7-4dae-b573-e943057fc60d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.676143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:01.677941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.678224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.678495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] PATH_INFO: `/v3/projects/ef12058acdff4b2099906810fa122564/users/d8866f7d1b104151a74c2f3c9008a98b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.686550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef12058acdff4b2099906810fa122564, user_id=d8866f7d1b104151a74c2f3c9008a98b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:01.699046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fae89-f26f-49a1-ac23-42cf4ba7ffa3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:01.722954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.725330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:01.745956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4092/8205] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:01 2022] PUT /identity/v3/projects/ef12058acdff4b2099906810fa122564/users/d8866f7d1b104151a74c2f3c9008a98b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:01.747577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:01.747871 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:01.748146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:01.807367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] MFA Rules not processed for user `d8866f7d1b104151a74c2f3c9008a98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:01.808655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:01.940026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbbeb-5144-472d-8dff-93bcd6c61a9f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:01.956165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4093/8206] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:40:01.969195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:01.970676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:02.050650 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:02.072829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:02.075279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:02.075571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:02.075850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:02.080089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:02.096162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1b81f-0ea8-4a28-9e0b-5a33fc0a7395 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:02.100070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:02.100572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:02.100693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:02.100942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:02.101213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:02.102348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21c0a9-18c7-4c9d-93fa-9c4ae831db86 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:02.122434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4114/8207] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:40:02.250745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:02.252606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:02.267549 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4094/8208] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:40:04.101481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:04.102493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:04.102925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:04.144603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] MFA Rules not processed for user `843656b1ab4b43cbb3df67b116c754a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:04.146143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:04.224373 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4115/8209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:04.860973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:04.863045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:04.887941 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:04.996490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961712b4-82b8-4076-b410-354bf5aad7ae service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:05.010861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:05.012251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:05.012727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:05.013149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:05.015846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:05.041128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:05.043841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:05.073932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4095/8210] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:06.788409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:06.835282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bdecd-c381-45b0-9af8-59c094827f1a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:06.850954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:06.851968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:06.852570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:06.853076 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:06.889214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:06.911754 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f79a7a-3079-43ab-9698-27fd05a83c46 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:06.927783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:06.928978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:06.929461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:06.929912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:06.932057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:06.994232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:06.995890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:07.022010 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4096/8211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:07.098886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:07.100674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:07.165079 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4116/8212] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:08.435329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:08.458336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449760d1-7e60-499d-b214-e0ff6889de94 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:08.477046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:08.478165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:08.478455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:08.478733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:08.521893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:08.523712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:08.573600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4097/8213] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:12.399196 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:12.428335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e776-7b03-45e3-b582-62ae11b404ba service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:12.438150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:12.439081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:12.439531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:12.439940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:12.443056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:12.501643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:12.503978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f31d9-9e30-464d-bbce-c38df7e7ece1 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:12.515137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:12.520556 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4117/8214] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:12.543044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ba129-1f70-452a-80cb-d8d2dc79d44f service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:12.553206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:12.554100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:12.554498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:12.554884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:12.560223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:12.607367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:12.616281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:12.668813 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4098/8215] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:14.557931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907c6a-4939-41e0-8e05-acc3c217c0e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:14.558523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907c6a-4939-41e0-8e05-acc3c217c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:14.558523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907c6a-4939-41e0-8e05-acc3c217c0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:14.644695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-be907c6a-4939-41e0-8e05-acc3c217c0e1 None None] MFA Rules not processed for user `4693e5435d484d519b806ccddf83e1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:14.646907 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be907c6a-4939-41e0-8e05-acc3c217c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:14.835577 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:14.847273 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4118/8216] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:14.864214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:15.110384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8da8c5-7d09-4bf6-b8ba-a901a200f1c8 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:15.152071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:15.152989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:15.153438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:15.153876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:15.172960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:15.174776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:15.207468 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4099/8217] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:15.365629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:15.365920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:15.366357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:15.378410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:15.425881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b0fcd-c7db-4ab7-97a4-9f4ac4075299 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:15.429045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] MFA Rules not processed for user `53d8474a3c044fce8df935171472d514`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:15.434292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:15.446802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:15.447435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:15.447717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:15.447991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:15.454013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:15.550635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:15.552286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:15.608425 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4100/8218] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:15.697837 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4119/8219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:21.141263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:21.143631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:21.234881 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:21.267612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd716b-a4d7-46a6-a2af-1898f41a69ef service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:21.272883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:21.273795 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:21.274270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:21.275098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] PATH_INFO: `/v3/users/ad002cc3bb5e407685f6cd8a34f5d478` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:21.276479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad002cc3bb5e407685f6cd8a34f5d478)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:21.298417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:21.399213 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad002cc3bb5e407685f6cd8a34f5d478'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:21.399910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad002cc3bb5e407685f6cd8a34f5d478'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:21.413695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad002cc3bb5e407685f6cd8a34f5d478'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:21.474264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad002cc3bb5e407685f6cd8a34f5d478'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:21.475079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad002cc3bb5e407685f6cd8a34f5d478'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:21.514906 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4101/8220] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:40:21 2022] DELETE /identity/v3/users/ad002cc3bb5e407685f6cd8a34f5d478 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:21.985386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:22.004318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac22f93-f76f-4e98-9457-ea00f06d3bb0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:22.144104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:22.145057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:22.145529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:22.145985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] PATH_INFO: `/v3/projects/8fedb1eb11a4417faab1907468b5f4bd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:22.147335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fedb1eb11a4417faab1907468b5f4bd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:22.149453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:22.241754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fedb1eb11a4417faab1907468b5f4bd', 'request_id': 'req-4cf0f90c-26dd-4b84-9551-13c398cbf629'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.252597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fedb1eb11a4417faab1907468b5f4bd', 'request_id': 'req-4cf0f90c-26dd-4b84-9551-13c398cbf629'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.260669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fedb1eb11a4417faab1907468b5f4bd', 'request_id': 'req-4cf0f90c-26dd-4b84-9551-13c398cbf629'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.288602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] The token cache is being invalidate because project 8fedb1eb11a4417faab1907468b5f4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:40:22.289028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.292420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.301667 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:22.303361 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4120/8221] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:40:21 2022] DELETE /identity/v3/projects/8fedb1eb11a4417faab1907468b5f4bd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:40:22.304007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:22.326148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7d3d5-c497-402d-8161-c088c4e0526f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:22.590601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:22.591266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:22.591551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:22.591832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] PATH_INFO: `/v3/users/f587a25aace441009e0a7c49fa89b7ef` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:22.596901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f587a25aace441009e0a7c49fa89b7ef)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:22.599547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:22.612165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:22.613712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:22.633903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0f90c-26dd-4b84-9551-13c398cbf629 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:22.647164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:22.648141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:22.648616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:22.649078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] PATH_INFO: `/v3/users/c3fd1cc730c3474da38c6926d0bc1b97` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:22.650492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fd1cc730c3474da38c6926d0bc1b97)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:22.652639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:22.697378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f587a25aace441009e0a7c49fa89b7ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.698417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f587a25aace441009e0a7c49fa89b7ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.711287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f587a25aace441009e0a7c49fa89b7ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.713021 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:22.719746 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:22.736759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f587a25aace441009e0a7c49fa89b7ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.737693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-60dc472a-44f7-44a1-91c5-9178a68e6ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f587a25aace441009e0a7c49fa89b7ef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.761752 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4102/8222] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:40:22 2022] DELETE /identity/v3/users/f587a25aace441009e0a7c49fa89b7ef => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:22.765255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fd1cc730c3474da38c6926d0bc1b97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.779437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fd1cc730c3474da38c6926d0bc1b97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.805520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fd1cc730c3474da38c6926d0bc1b97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.807561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fd1cc730c3474da38c6926d0bc1b97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.808213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fd1cc730c3474da38c6926d0bc1b97'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:22.839414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4121/8223] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:40:22 2022] DELETE /identity/v3/users/c3fd1cc730c3474da38c6926d0bc1b97 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:40:22.841087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:22.841378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:22.841873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:22.867088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:22.868329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:23.043928 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4103/8224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:23.059048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:23.061903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:23.134306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:23.135797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:23.164431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4797-8b01-4158-b7eb-1d3a394a6a34 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:23.186089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:23.187244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:23.187701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:23.188126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] PATH_INFO: `/v3/projects/ed8349d478f84521b6ed9053eac1b663` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:23.190495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8349d478f84521b6ed9053eac1b663)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:23.193762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:23.243310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46e22-4b54-4282-a065-ba46dd118ea7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:23.250464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:23.251348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:23.251789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:23.252342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:23.273758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:23.276131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:23.302246 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4122/8225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:23.399846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8349d478f84521b6ed9053eac1b663', 'request_id': 'req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:23.437257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8349d478f84521b6ed9053eac1b663', 'request_id': 'req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:23.465615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8349d478f84521b6ed9053eac1b663', 'request_id': 'req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:23.494800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] The token cache is being invalidate because project ed8349d478f84521b6ed9053eac1b663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:40:23.496804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:23.500719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:23.516923 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4104/8226] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:40:23 2022] DELETE /identity/v3/projects/ed8349d478f84521b6ed9053eac1b663 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:40:24.194033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:24.196957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:24.226606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb8a4-efe8-416e-9e46-b6447cec623b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:24.319652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:24.320372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:24.320783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:24.321722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] PATH_INFO: `/v3/projects/dab3451dbc8a4cf4946198af223294e2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:24.322479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab3451dbc8a4cf4946198af223294e2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:24.324600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:24.423041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab3451dbc8a4cf4946198af223294e2', 'request_id': 'req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.428443 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:24.435646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab3451dbc8a4cf4946198af223294e2', 'request_id': 'req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.444962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab3451dbc8a4cf4946198af223294e2', 'request_id': 'req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.462194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] The token cache is being invalidate because project dab3451dbc8a4cf4946198af223294e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:40:24.462640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.464561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.467430 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4123/8227] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:40:24 2022] DELETE /identity/v3/projects/dab3451dbc8a4cf4946198af223294e2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:24.471722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:24.474016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:24.493232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb20c4c-44b3-4614-b3fe-a81e02ceb63a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:24.578716 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:24.586218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:24.586933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:24.587465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:24.587991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] PATH_INFO: `/v3/users/fe5abab25afb4235b595ba6d22ba76d1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:24.589694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5abab25afb4235b595ba6d22ba76d1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:24.591868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:24.650463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5abab25afb4235b595ba6d22ba76d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.651145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5abab25afb4235b595ba6d22ba76d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.658981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5abab25afb4235b595ba6d22ba76d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.674399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5abab25afb4235b595ba6d22ba76d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.675250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5abab25afb4235b595ba6d22ba76d1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:24.691451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4105/8228] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:40:24 2022] DELETE /identity/v3/users/fe5abab25afb4235b595ba6d22ba76d1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:25.081665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:25.083210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:25.109388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bdb7d-c15b-4f4d-bdd2-b68cdc3a5af5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:25.235533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:25.237753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:25.238256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:25.238925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] PATH_INFO: `/v3/projects/c258055a58804ea29636b5e5355bec55` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:25.240924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c258055a58804ea29636b5e5355bec55)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:25.244081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:25.317077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c258055a58804ea29636b5e5355bec55', 'request_id': 'req-4cee2424-7204-4f5d-a218-1849a3baad78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.325155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c258055a58804ea29636b5e5355bec55', 'request_id': 'req-4cee2424-7204-4f5d-a218-1849a3baad78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.335248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c258055a58804ea29636b5e5355bec55', 'request_id': 'req-4cee2424-7204-4f5d-a218-1849a3baad78'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.364882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] The token cache is being invalidate because project c258055a58804ea29636b5e5355bec55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:40:25.365249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.366017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.367805 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4124/8229] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:40:25 2022] DELETE /identity/v3/projects/c258055a58804ea29636b5e5355bec55 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:40:25.371861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:25.373315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:25.393518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2a9e-3f82-4147-8fda-776927b68d9a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:25.477624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:25.478285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:25.478460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:25.479031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] PATH_INFO: `/v3/users/d8866f7d1b104151a74c2f3c9008a98b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:25.480720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8866f7d1b104151a74c2f3c9008a98b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:25.482753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:25.547067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8866f7d1b104151a74c2f3c9008a98b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.547876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8866f7d1b104151a74c2f3c9008a98b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.555555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8866f7d1b104151a74c2f3c9008a98b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.570739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8866f7d1b104151a74c2f3c9008a98b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.572098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c9c586d1-971e-452b-a3ec-9c3861ebc00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8866f7d1b104151a74c2f3c9008a98b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:25.576876 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:25.589262 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4106/8230] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:40:25 2022] DELETE /identity/v3/users/d8866f7d1b104151a74c2f3c9008a98b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:25.914946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:25.916525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:25.972569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2424-7204-4f5d-a218-1849a3baad78 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.043986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.044869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.045251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.045619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] PATH_INFO: `/v3/projects/ef12058acdff4b2099906810fa122564` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.046832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef12058acdff4b2099906810fa122564)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.048808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.063093 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:26.261479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef12058acdff4b2099906810fa122564', 'request_id': 'req-62d6eb52-649e-4f24-be3b-ed5d878a9bed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:26.269290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef12058acdff4b2099906810fa122564', 'request_id': 'req-62d6eb52-649e-4f24-be3b-ed5d878a9bed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:26.275526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef12058acdff4b2099906810fa122564', 'request_id': 'req-62d6eb52-649e-4f24-be3b-ed5d878a9bed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:26.292255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] The token cache is being invalidate because project ef12058acdff4b2099906810fa122564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:40:26.292646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:26.293354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-62d6eb52-649e-4f24-be3b-ed5d878a9bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:40:26.298785 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4125/8231] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:40:25 2022] DELETE /identity/v3/projects/ef12058acdff4b2099906810fa122564 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:40:26.300534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.300824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.301104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.321498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:26.322711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:26.393313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4107/8232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:26.401121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.401350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.401653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.424233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:26.425867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:26.436848 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4126/8233] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:26.441133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.452511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc4664-b789-409e-873e-3c7bd3a3560c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.457986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.459065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.459065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.459446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.460186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:40:26.460550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.462273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.477579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4108/8234] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:40:26.479881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.490512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc319083-2f80-42d7-8b04-f534de0a66ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.495618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.496226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.496501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.496768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.497394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.500257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.529450 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4127/8235] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:40:26 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:40:26.533747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.544723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c8e2-4272-4ff9-b0e1-de78034231ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.622012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.622661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.622941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.623749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.624614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.626575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.653508 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4109/8236] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:40:26 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:40:26.654893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.667208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f2ec-6d2e-4fa3-bbd5-2679b225e898 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.672287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.674659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.674659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.674659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.674956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.676418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.691961 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4128/8237] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:40:26.696964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.709088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef1b6-f7f8-47bf-aa08-3421aa3e24a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.717657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.720110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.720401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.720712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.721456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.723573 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09b43b-fb62-4588-9068-4f033117f76a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.741258 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4110/8238] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:40:26.742232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.756182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05187d-50f9-4ae4-81e2-70b31c812402 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.763051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:26.764254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.764643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.764925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] PATH_INFO: `/v3/projects/01604e09ffe9466cafa6cfe2a5867aae/users/27f69f72a9044ea490c8fd4c4db6bf31/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.783332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01604e09ffe9466cafa6cfe2a5867aae, user_id=27f69f72a9044ea490c8fd4c4db6bf31, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:26.786843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:26.824099 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4129/8239] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:40:26 2022] PUT /identity/v3/projects/01604e09ffe9466cafa6cfe2a5867aae/users/27f69f72a9044ea490c8fd4c4db6bf31/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:40:26.830247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328823e4-053a-4c0c-931e-f5f13bc65141 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:26.830592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328823e4-053a-4c0c-931e-f5f13bc65141 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:26.830681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328823e4-053a-4c0c-931e-f5f13bc65141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:26.850986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-328823e4-053a-4c0c-931e-f5f13bc65141 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:26.852411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-328823e4-053a-4c0c-931e-f5f13bc65141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:26.919717 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4111/8240] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:26.929559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:26.931322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:26.995905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04564cf8-d7c6-4bf0-9913-f6a49eb6fcdb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:26.999767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:27.000450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:27.000822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:27.001277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:27.012963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:27.016548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:27.027699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4130/8241] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:27.922291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfa0d-6c9c-4189-b9d2-7a9d3eedab86 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:27.923126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfa0d-6c9c-4189-b9d2-7a9d3eedab86 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:27.923622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfa0d-6c9c-4189-b9d2-7a9d3eedab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:27.931623 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:27.965757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-63ddfa0d-6c9c-4189-b9d2-7a9d3eedab86 None None] MFA Rules not processed for user `27f69f72a9044ea490c8fd4c4db6bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:27.967053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-63ddfa0d-6c9c-4189-b9d2-7a9d3eedab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:28.091555 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4112/8242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:40:28.103460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:28.106952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:28.175492 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:28.210406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fbf6f-1209-48ab-b64e-b21bc57e3aba service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:28.215651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:28.216424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:28.216760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:28.218595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:28.227911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:28.229594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2f3e0-b1e5-4239-9730-b80b022c1226 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:28.257585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4131/8243] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:30.817336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:30.817889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:30.817989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:30.837328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] MFA Rules not processed for user `27f69f72a9044ea490c8fd4c4db6bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:30.838583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:30.846286 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4113/8244] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:31.805317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344cec-22ed-4117-9792-a6cc1cd583ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:31.805899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344cec-22ed-4117-9792-a6cc1cd583ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:31.806280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344cec-22ed-4117-9792-a6cc1cd583ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:31.831674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d344cec-22ed-4117-9792-a6cc1cd583ab None None] MFA Rules not processed for user `53d8474a3c044fce8df935171472d514`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:31.832097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d344cec-22ed-4117-9792-a6cc1cd583ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:31.895504 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4132/8245] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:40.831911 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=34 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:41.884326 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=38 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:44.539491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:44.552023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a431a-b08c-422c-b300-3dd53db0def1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:44.556116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:44.556821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:44.557151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:44.557382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:44.559201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:44.636595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:44.638211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:44.652191 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4114/8246] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:40:51.384708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:51.392084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:51.392481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:51.417839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] MFA Rules not processed for user `27f69f72a9044ea490c8fd4c4db6bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:40:51.417839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:51.429134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4133/8247] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:40:53.920913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:40:53.932522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4990a9-d2b2-4b31-b07a-35bce6a625cf service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:40:53.937193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:40:53.938161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:40:53.938161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:40:53.938387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:40:53.940137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:40:53.959065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:40:53.960859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:40:53.976678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4115/8248] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:01.408453 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:03.970456 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=40 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:04.149440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:04.149933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:04.169972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247cc18-9c9f-4420-8151-d7751cfc3842 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:04.179685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:04.180780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:04.181214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:04.181663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] PATH_INFO: `/v3/users/53d8474a3c044fce8df935171472d514` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:04.184932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d8474a3c044fce8df935171472d514)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:04.188079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:04.251058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d8474a3c044fce8df935171472d514'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.258484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d8474a3c044fce8df935171472d514'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.272400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d8474a3c044fce8df935171472d514'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.273453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d8474a3c044fce8df935171472d514'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.274191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d8474a3c044fce8df935171472d514'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.296632 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4134/8249] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:41:04 2022] DELETE /identity/v3/users/53d8474a3c044fce8df935171472d514 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:04.506097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:04.525064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ff2c0-9957-4e0f-9e8b-54d532f5fa5f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:04.589132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:04.589804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:04.590109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:04.590380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] PATH_INFO: `/v3/projects/a4e85d53250b4a2199d2f4752befd0ce` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:04.591528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e85d53250b4a2199d2f4752befd0ce)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:04.594336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:04.650381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e85d53250b4a2199d2f4752befd0ce', 'request_id': 'req-7025c2b9-07c2-4817-bbde-9a13355c25bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.658914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e85d53250b4a2199d2f4752befd0ce', 'request_id': 'req-7025c2b9-07c2-4817-bbde-9a13355c25bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.665256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e85d53250b4a2199d2f4752befd0ce', 'request_id': 'req-7025c2b9-07c2-4817-bbde-9a13355c25bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.683736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] The token cache is being invalidate because project a4e85d53250b4a2199d2f4752befd0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:41:04.684029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.684763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.686351 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4116/8250] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:41:04 2022] DELETE /identity/v3/projects/a4e85d53250b4a2199d2f4752befd0ce => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:04.690348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:04.691753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:04.706480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9108f8-66af-4483-988a-7ea7083fbc01 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:04.765967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:04.766560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:04.766841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:04.767112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] PATH_INFO: `/v3/users/4693e5435d484d519b806ccddf83e1b9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:04.768414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4693e5435d484d519b806ccddf83e1b9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:04.770423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:04.818901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4693e5435d484d519b806ccddf83e1b9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.826776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4693e5435d484d519b806ccddf83e1b9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.839576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4693e5435d484d519b806ccddf83e1b9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.840392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4693e5435d484d519b806ccddf83e1b9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.841380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f669c4a-518e-4c09-b3d0-3cb20bc09455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4693e5435d484d519b806ccddf83e1b9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:04.843876 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:04.858073 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4135/8251] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:41:04 2022] DELETE /identity/v3/users/4693e5435d484d519b806ccddf83e1b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:05.035427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:05.036967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:05.052499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c2b9-07c2-4817-bbde-9a13355c25bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:05.113924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:05.114569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:05.114852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:05.115120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] PATH_INFO: `/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:05.116275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e7627ce0114c99bc81f9e2c8c5e1c0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:05.118310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:05.154187 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:05.168587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e7627ce0114c99bc81f9e2c8c5e1c0', 'request_id': 'req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:05.175191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e7627ce0114c99bc81f9e2c8c5e1c0', 'request_id': 'req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:05.181634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e7627ce0114c99bc81f9e2c8c5e1c0', 'request_id': 'req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:05.195687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] The token cache is being invalidate because project 26e7627ce0114c99bc81f9e2c8c5e1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:41:05.195985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:05.196665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:05.198240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4117/8252] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:41:05 2022] DELETE /identity/v3/projects/26e7627ce0114c99bc81f9e2c8c5e1c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:09.422702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c086fb-4953-4652-ad15-13c28399bd7d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:09.423209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c086fb-4953-4652-ad15-13c28399bd7d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:09.423301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c086fb-4953-4652-ad15-13c28399bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:09.517098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e0c086fb-4953-4652-ad15-13c28399bd7d None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:09.518900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0c086fb-4953-4652-ad15-13c28399bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:09.594039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4136/8253] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:09.654851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:09.656742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:09.732021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae13a-0378-4151-a8c6-ee0e5db1e4ab admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:09.740550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:09.741344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:09.741770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:09.742145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:09.752619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:09.754617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:09.769298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4118/8254] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:41:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:41:19.584368 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=38 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:19.762723 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:28.565040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:28.565591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:28.565689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:28.585504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:28.586705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:28.594947 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4137/8255] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:28.608697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:28.621956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae93b-3cc2-4224-8598-2d1f0a82422f service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:28.627467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:28.628084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:28.628364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:28.628646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:28.637230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:28.639743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:28.651745 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4119/8256] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:41:31.861860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:31.863416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:31.935951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e8674-f1f3-49eb-bb9b-c2ecfb48bab6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:31.940548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:31.941181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:31.941501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:31.941777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] PATH_INFO: `/v3/users/27f69f72a9044ea490c8fd4c4db6bf31` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:31.942922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f69f72a9044ea490c8fd4c4db6bf31)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:31.944847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:31.993908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f69f72a9044ea490c8fd4c4db6bf31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.001291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f69f72a9044ea490c8fd4c4db6bf31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.013030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f69f72a9044ea490c8fd4c4db6bf31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.014252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f69f72a9044ea490c8fd4c4db6bf31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.014860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a1097f8c-a385-40df-a62e-b6e54d5c0e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f69f72a9044ea490c8fd4c4db6bf31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.027836 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4138/8257] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:41:31 2022] DELETE /identity/v3/users/27f69f72a9044ea490c8fd4c4db6bf31 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:32.211589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.222901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230cc95-0fda-4b92-8440-a0324a83bf5b service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.283197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.283856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.284144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.284421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] PATH_INFO: `/v3/projects/01604e09ffe9466cafa6cfe2a5867aae` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.285701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01604e09ffe9466cafa6cfe2a5867aae)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.287687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.355051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01604e09ffe9466cafa6cfe2a5867aae', 'request_id': 'req-86bfce5c-7fa7-4661-9f10-2356de208964'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.363080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01604e09ffe9466cafa6cfe2a5867aae', 'request_id': 'req-86bfce5c-7fa7-4661-9f10-2356de208964'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.376998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01604e09ffe9466cafa6cfe2a5867aae', 'request_id': 'req-86bfce5c-7fa7-4661-9f10-2356de208964'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.395862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] The token cache is being invalidate because project 01604e09ffe9466cafa6cfe2a5867aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:41:32.396212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.396877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-86bfce5c-7fa7-4661-9f10-2356de208964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:32.398499 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4120/8258] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:41:32 2022] DELETE /identity/v3/projects/01604e09ffe9466cafa6cfe2a5867aae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:32.403417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.403815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.404314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.428270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:32.429625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:32.510880 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4139/8259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:41:32.518463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.518750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.519027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.560602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:32.562673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:32.572923 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4121/8260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:32.577154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.588658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce316d-7b7f-44e1-bc1d-98672287dc91 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.593513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.594073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.594353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.594628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.595280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:41:32.595587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.599282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.609732 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:32.613989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4140/8261] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:41:32.618209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.628350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86da26-71e3-4cac-b8ac-e5d0dc44c49a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.633526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.634147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.634432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.634712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.635379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.637311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.679157 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4122/8262] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:41:32 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:41:32.680568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.691648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c7b4-0e4d-4a0f-96bd-ace718cb6d6e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.752173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.752831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.753229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.753392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.760405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.763013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.790890 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4141/8263] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:41:32 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:41:32.792227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.804117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80b6a-ea5c-4f0b-bb71-a6c929a73d75 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.808826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.809454 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.809739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.810197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.810933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.812580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.822982 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4123/8264] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:41:32.827036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.837092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab305a9-8a66-4046-8f5c-9431d3493fa0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.842726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.843310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.843610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.843894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.844540 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.846428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47275d00-235c-4876-bd10-f5a357c5de08 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.857888 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4142/8265] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:41:32.868720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:32.879495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9344a2-bca8-4374-8047-9b0f85908c50 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:32.884671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:32.885413 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.885914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.886223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] PATH_INFO: `/v3/projects/66b4d78b89fe435597420e38d29959fb/users/ce9206446dcd47b88ad59cb9b52eddef/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.902321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b4d78b89fe435597420e38d29959fb, user_id=ce9206446dcd47b88ad59cb9b52eddef, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:32.906094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:32.920813 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4124/8266] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:41:32 2022] PUT /identity/v3/projects/66b4d78b89fe435597420e38d29959fb/users/ce9206446dcd47b88ad59cb9b52eddef/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:32.931749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf85ee-dfcf-44cf-a81a-e4a805b48a00 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:32.932428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf85ee-dfcf-44cf-a81a-e4a805b48a00 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:32.932428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf85ee-dfcf-44cf-a81a-e4a805b48a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:32.965237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-84cf85ee-dfcf-44cf-a81a-e4a805b48a00 None None] MFA Rules not processed for user `ce9206446dcd47b88ad59cb9b52eddef`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:32.967831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84cf85ee-dfcf-44cf-a81a-e4a805b48a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:33.054055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4143/8267] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:33.062033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:33.064791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:33.074544 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:33.146904 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40bdd-1c03-454a-b387-4535c68cf641 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:33.151587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:33.152240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:33.152521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:33.152793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:33.164046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:33.165752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:33.177025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4125/8268] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:33.630553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:33.630844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:33.631312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:33.651732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] MFA Rules not processed for user `cd2b15ca74604287bbc113c051f0ebde`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:33.652873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:33.713172 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4144/8269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:37.729387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:37.733149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:37.868861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb689a-b183-4cef-ae61-dd81df676ab5 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:37.876039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:37.876661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:37.876933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:37.877207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:37.878952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:37.894660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:37.896296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec0fb-21c4-4361-8be1-507eb838ac76 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:37.910773 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4126/8270] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:43.706481 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:46.781968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:46.880157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eeaa69-9489-4d4d-be6f-62a14b4a6f3d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:46.884794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:46.885468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:46.885752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:46.886023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] PATH_INFO: `/v3/users/ce9206446dcd47b88ad59cb9b52eddef` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:46.887156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9206446dcd47b88ad59cb9b52eddef)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:46.889252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:46.941637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9206446dcd47b88ad59cb9b52eddef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:46.948893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9206446dcd47b88ad59cb9b52eddef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:46.964055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9206446dcd47b88ad59cb9b52eddef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:46.964725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9206446dcd47b88ad59cb9b52eddef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:46.965395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9206446dcd47b88ad59cb9b52eddef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:46.980535 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4145/8271] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:41:46 2022] DELETE /identity/v3/users/ce9206446dcd47b88ad59cb9b52eddef => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:46.987056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:46.987531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:46.987650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.008755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:47.010176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:47.070399 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4127/8272] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:47.080344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.081789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:47.141710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb057d-c0f7-4b74-bb6c-29e559e0165a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.145608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.146238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.146516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.146785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.158529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.160016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab3620-b12c-4e1d-b261-df4aad2acf1c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.172244 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4146/8273] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:47.461768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.463336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:47.476692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae8add-7e9e-4904-ba41-de3eb00f70aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.481809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.482673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.482977 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.483261 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] PATH_INFO: `/v3/projects/66b4d78b89fe435597420e38d29959fb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.484416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b4d78b89fe435597420e38d29959fb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.486428 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.524909 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:47.547220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b4d78b89fe435597420e38d29959fb', 'request_id': 'req-d35141bd-971c-4019-97f5-d0f68e8476f9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:47.555136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b4d78b89fe435597420e38d29959fb', 'request_id': 'req-d35141bd-971c-4019-97f5-d0f68e8476f9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:47.562118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b4d78b89fe435597420e38d29959fb', 'request_id': 'req-d35141bd-971c-4019-97f5-d0f68e8476f9'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:47.583019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] The token cache is being invalidate because project 66b4d78b89fe435597420e38d29959fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:41:47.583835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:47.584776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d35141bd-971c-4019-97f5-d0f68e8476f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:41:47.587171 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4128/8274] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:41:47 2022] DELETE /identity/v3/projects/66b4d78b89fe435597420e38d29959fb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:47.594098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.594500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.594844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.616110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:47.618137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:47.638481 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:47.692176 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4147/8275] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:41:47.700895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.701193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.701647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.722266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:47.723461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:47.731463 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4129/8276] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:41:47.735763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.745569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298052cf-fa19-4d30-bf81-8657c4ca88b8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.751106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.751740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.752025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.752296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.752956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:41:47.753258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.754954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.772021 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4148/8277] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:41:47.773123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.783600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd36d-243f-4713-8d99-7cabca7b0322 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.788306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.788929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.789211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.789590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.790234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.792169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.824496 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4130/8278] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:41:47.829537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.840119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a48-2129-43ce-b59f-57bf8b86bdef admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.897503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.898115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.898400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.898704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.899392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.901323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.922517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4149/8279] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:41:47 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:41:47.926652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.937750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f118-771a-4f16-abec-4df811d91ff2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.942418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.943021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.943305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.943582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.944227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.945868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.956835 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4131/8280] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:41:47.960888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:47.970930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fafed-3e8c-4393-957b-4eb5a0b31be4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:47.975706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:47.976332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:47.976615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:47.976892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:47.977569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:47.979158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690a641-43ba-47ec-993f-d5d5730ea358 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:47.990198 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4150/8281] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:41:47.994200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.004927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660c1ce-f07a-4bba-89e6-5624562205cd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.009691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.010379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.010670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.010955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] PATH_INFO: `/v3/projects/fdcd1c5a13e24165971100bc619e7be2/users/7fa3cce1ff3445eb896fb8bad352ef1f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.027604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdcd1c5a13e24165971100bc619e7be2, user_id=7fa3cce1ff3445eb896fb8bad352ef1f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.031208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.046281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4132/8282] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:41:47 2022] PUT /identity/v3/projects/fdcd1c5a13e24165971100bc619e7be2/users/7fa3cce1ff3445eb896fb8bad352ef1f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:48.058642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.059042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.059453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.087843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] MFA Rules not processed for user `7fa3cce1ff3445eb896fb8bad352ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:48.089181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:48.159509 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4151/8283] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:48.164128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.367387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3d37-ec89-4310-b890-1f4ad0e6efe2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.372043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.372644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.372920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.373191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.373850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.375735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.402204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4133/8284] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:41:48 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:41:48.407425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.418392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35329e8-9e9c-4f10-b8c0-2b56a08e1717 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.431019 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:48.477358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.478003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.478286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.478556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.479189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.481096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.501011 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4152/8285] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:41:48 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:41:48.505130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.516280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43dc23-e52a-4b29-b208-b5f015727052 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.520983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.521620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.521902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.522175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.522814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.524409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.534992 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4134/8286] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:41:48.539172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.549116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522a72-dbbd-4448-925c-ccb69863276b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.553703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.554346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.554624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.554896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] PATH_INFO: `/v3/projects/e611090010d2423a8cc49fb24800e541/users/f123fbda3ee24d9faa10d29db4da3c17/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.570417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e611090010d2423a8cc49fb24800e541, user_id=f123fbda3ee24d9faa10d29db4da3c17, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.573085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.586542 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4153/8287] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:41:48 2022] PUT /identity/v3/projects/e611090010d2423a8cc49fb24800e541/users/f123fbda3ee24d9faa10d29db4da3c17/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:41:48.591551 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.601352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe525-0b73-4970-93c9-42c9a56192bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.625269 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:48.661342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.661962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.662240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.662510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.663140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.664725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9de647-ce3d-4fe7-bf15-4a11f7ce542a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.674594 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4135/8288] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:41:48.678764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.689701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828b92-4626-439c-9d6a-35736362f76c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.694784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.695445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.695725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.695999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] PATH_INFO: `/v3/projects/e611090010d2423a8cc49fb24800e541/users/f123fbda3ee24d9faa10d29db4da3c17/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.697958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e611090010d2423a8cc49fb24800e541, user_id=f123fbda3ee24d9faa10d29db4da3c17, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.700853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.711662 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4154/8289] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:41:48 2022] PUT /identity/v3/projects/e611090010d2423a8cc49fb24800e541/users/f123fbda3ee24d9faa10d29db4da3c17/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:41:48.721949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.722236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.722513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.750072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] MFA Rules not processed for user `f123fbda3ee24d9faa10d29db4da3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:48.751272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:48.821294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4136/8290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:41:48.832754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:48.834464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:48.893498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3e44-df50-42c9-a3bf-3ff1a4110d14 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:48.897064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:48.897699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:48.897973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:48.898241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:48.953385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:48.954865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:48.963803 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4155/8291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:50.731028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:50.743643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041f712-fd95-4363-9fcb-1dea37acacee None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:50.747808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:50.748404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:50.748682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:50.748950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:50.758485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:50.760016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d766a75-cf88-4ca0-bb06-19154510f1a9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:50.770259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4137/8292] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:54.471110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:41:54.484241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc309f-f834-451b-a196-82d1bbfbcac4 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:41:54.488388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:41:54.489322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:54.489815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:54.490246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:54.492949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:54.522903 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:54.565337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:41:54.566916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:41:54.578788 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4156/8293] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:41:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:41:56.015402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:41:56.016902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:41:56.017440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:41:56.043210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] MFA Rules not processed for user `7fa3cce1ff3445eb896fb8bad352ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:41:56.044755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:41:56.054476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4138/8294] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:42:04.572772 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=19 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:06.036627 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=60 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:22.951111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:22.963737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bec47-01c8-448f-8823-62d78322a735 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:22.967802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:22.968473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:22.968786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:22.969064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:22.971020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:22.984817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:22.986323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11abc4-715c-4759-a8cd-8284e12f0c28 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:22.997553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4157/8295] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:42:32.994792 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:45.640725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:45.642662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:45.765783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bba1a-a42c-4d97-b1f4-f41e274318a3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:45.771560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:45.772183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:45.772464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:45.772734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:45.775249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:45.790109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:45.791712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:45.804612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4139/8296] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:42:48.353892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:48.354961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:48.355587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:48.401318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] MFA Rules not processed for user `7fa3cce1ff3445eb896fb8bad352ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:42:48.402602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:48.415414 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4158/8297] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:42:49.784622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:49.786167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:49.879505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a366e-f987-48af-a4ee-89e79479e46d service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:49.886182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:49.886822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:49.887097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:49.887366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] PATH_INFO: `/v3/users/cd2b15ca74604287bbc113c051f0ebde` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:49.893127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2b15ca74604287bbc113c051f0ebde)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:49.895353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:49.972887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2b15ca74604287bbc113c051f0ebde'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:49.973742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2b15ca74604287bbc113c051f0ebde'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:49.981933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2b15ca74604287bbc113c051f0ebde'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:49.998587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2b15ca74604287bbc113c051f0ebde'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:49.999711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2b15ca74604287bbc113c051f0ebde'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.019096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4140/8298] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:42:49 2022] DELETE /identity/v3/users/cd2b15ca74604287bbc113c051f0ebde => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:42:50.217902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:50.230610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e6673-6040-4551-89aa-f66302a1ee7a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:50.294765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:50.295327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:50.295605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:50.295878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] PATH_INFO: `/v3/projects/8eeb0489ee8f4e9dbbcb33ed3263c0bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:50.296982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeb0489ee8f4e9dbbcb33ed3263c0bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:50.298910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:50.349005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'request_id': 'req-73094559-25e4-4356-bee4-019f3b0fd113'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.356485 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'request_id': 'req-73094559-25e4-4356-bee4-019f3b0fd113'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.362092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'request_id': 'req-73094559-25e4-4356-bee4-019f3b0fd113'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.379289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] The token cache is being invalidate because project 8eeb0489ee8f4e9dbbcb33ed3263c0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:42:50.379584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.380285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.382045 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4159/8299] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:42:50 2022] DELETE /identity/v3/projects/8eeb0489ee8f4e9dbbcb33ed3263c0bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:42:50.386509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:50.387992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:50.404451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5491-4923-4d7c-9f3f-c2c4e2e283c2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:50.410601 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:50.499526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:50.500193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:50.500502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:50.500784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] PATH_INFO: `/v3/users/d3c7bb9c166c451cb86437dcef383778` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:50.502047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c7bb9c166c451cb86437dcef383778)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:50.504062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:50.584012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c7bb9c166c451cb86437dcef383778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.584700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c7bb9c166c451cb86437dcef383778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.602028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c7bb9c166c451cb86437dcef383778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.619037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c7bb9c166c451cb86437dcef383778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.620241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6f4b2d03-b18e-420f-ba95-27e34e61b1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c7bb9c166c451cb86437dcef383778'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.638144 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4141/8300] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:42:50 2022] DELETE /identity/v3/users/d3c7bb9c166c451cb86437dcef383778 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:42:50.835426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:50.837370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:50.852267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094559-25e4-4356-bee4-019f3b0fd113 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:50.915352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:50.915984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:50.916268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:50.916541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] PATH_INFO: `/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:50.917702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e049640768d940b28f3ceaa1c7ec0a0f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:50.919621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:50.952378 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:50.970738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e049640768d940b28f3ceaa1c7ec0a0f', 'request_id': 'req-d844dc8b-d363-4717-9b7d-b07d54c29308'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.977590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e049640768d940b28f3ceaa1c7ec0a0f', 'request_id': 'req-d844dc8b-d363-4717-9b7d-b07d54c29308'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.983362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e049640768d940b28f3ceaa1c7ec0a0f', 'request_id': 'req-d844dc8b-d363-4717-9b7d-b07d54c29308'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.996765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] The token cache is being invalidate because project e049640768d940b28f3ceaa1c7ec0a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:42:50.997052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.997859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d844dc8b-d363-4717-9b7d-b07d54c29308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:42:50.999343 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4160/8301] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:42:50 2022] DELETE /identity/v3/projects/e049640768d940b28f3ceaa1c7ec0a0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:42:51.004415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.004895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.004995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.025588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:42:51.026809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:51.087918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4142/8302] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:42:51.097253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.097620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.097921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.119290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:42:51.120501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:51.128763 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4161/8303] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:42:51.133638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.143419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd9767-65b1-458a-ba73-fbc2eec63e60 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.148162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.149429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.149726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.149999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.150778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:42:51.151098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.152683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.168395 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4143/8304] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:42:51.169511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.179337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9cc49-78d6-4f0c-923e-07ce5d770315 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.184687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.185297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.185619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.185896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.186535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.188470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.218023 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4162/8305] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:42:51 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:42:51.222181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.232492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160bf4-c29b-49ae-abfd-16caab6ce1a3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.246763 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:51.300773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.301580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.301673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.302179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.302705 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.305466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.334985 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4144/8306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:42:51 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:42:51.337340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.348936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1817eb-5d24-4063-b23d-8d3fb6c6b769 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.354332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.354947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.355230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.355501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.356149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.357782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.372147 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4163/8307] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:42:51.373322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.384000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb16-d700-4c18-88a6-b1d4c7c38153 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.395959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.397361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.397876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.398740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.399629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.401272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222114-05db-442d-8442-ce667e9c41bf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.421035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4145/8308] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:42:51.424664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.439527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c131f-02de-4ea1-b76a-850a81f7e3f7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.447216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.448526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.449114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.449635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] PATH_INFO: `/v3/projects/3132ad168f614e279ea7695322517136/users/3e4dec25611148a99a5103582540a52e/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.470326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3132ad168f614e279ea7695322517136, user_id=3e4dec25611148a99a5103582540a52e, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.474112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.509910 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4164/8309] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:42:51 2022] PUT /identity/v3/projects/3132ad168f614e279ea7695322517136/users/3e4dec25611148a99a5103582540a52e/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:42:51.512043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.512263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.512540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.534803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:42:51.536441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:51.620149 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4146/8310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:42:51.632252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:51.635471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:51.719244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218715c3-94db-47e5-9543-72857f761528 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:51.724370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:51.724986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:51.725267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:51.725571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:51.736828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:51.738353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fdc26-e8e6-4c5a-afca-6749252e83aa service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:51.749631 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4165/8311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:42:52.631386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:52.634490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:52.652785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7653-9002-428b-a83d-c106108af2ed None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:52.657054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:52.657796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:52.658132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:52.658469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:52.660487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:52.675867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:52.677484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:52.690789 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4147/8312] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:42:56.282150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.282668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.282668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.330500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:42:56.331811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:42:56.391427 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:56.428377 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4166/8313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:42:56.433437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.445771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01c1-13e5-40e0-99ca-a11e688223f5 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.450753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.451460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.451804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.452141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.453017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.455211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.495416 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4148/8314] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:42:56 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:42:56.499473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.510323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c8e98-2c09-4f5c-ae06-2e2583dd6f76 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.575648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.576267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.576552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.576829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.577516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.579449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.602326 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4167/8315] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:42:56 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:42:56.606522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.617317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377371e-1808-4c65-a49a-2e1d23ecba1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.622276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.622972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.623326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.623673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.624463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.626223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.637358 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4149/8316] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:42:56.641451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.653623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d9d22-fc6c-47fc-acd6-7c517792f6c1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.658886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.659628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.659913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.660189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] PATH_INFO: `/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d/users/332790afce72483ba1ff666940b4256a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.677274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39d121ee1c04e1ca6254fdc8c898c1d, user_id=332790afce72483ba1ff666940b4256a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.680041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.694646 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4168/8317] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:42:56 2022] PUT /identity/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d/users/332790afce72483ba1ff666940b4256a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:42:56.698696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.709150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a4bf-48aa-4eeb-b913-edd62f1891bb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.760313 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:56.774114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.774991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.775342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.775679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.776424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.778123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.790181 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4150/8318] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:42:56.794531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:42:56.805281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72442d8-1d25-4f19-aae6-993e3a6c524e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:42:56.810260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:42:56.811001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:42:56.811354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:42:56.811736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] PATH_INFO: `/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d/users/332790afce72483ba1ff666940b4256a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:42:56.813936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39d121ee1c04e1ca6254fdc8c898c1d, user_id=332790afce72483ba1ff666940b4256a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:42:56.816703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8c49-4f65-40cd-9b00-826fa26e0fe9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:42:56.828724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4169/8319] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:42:56 2022] PUT /identity/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d/users/332790afce72483ba1ff666940b4256a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:43:01.117751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:43:01.122758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:01.307045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa7e48-95b8-4386-b51a-4f3709a17bc4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:43:01.515149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:43:01.518780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:01.519065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:01.519341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:01.527070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:01.560729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:43:01.564426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:43:01.607600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4151/8320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:43:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:43:02.626802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:02.628934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:02.629832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:02.671590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] MFA Rules not processed for user `332790afce72483ba1ff666940b4256a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:43:02.672966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:02.765699 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4170/8321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:43:02.777123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:43:02.778916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:02.872732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ea1c-52d1-4b1b-848a-587807a666f6 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:43:02.877516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:43:02.878561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:02.879054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:02.879563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:02.897218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:43:02.900027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f160e3-518f-450c-8a8a-c555921debba service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:43:02.929730 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4152/8322] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:43:03.070396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:43:03.084275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ae4e1-cbe3-4321-8127-693061da98f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:43:03.088510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:43:03.089510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:03.089741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:03.090025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:03.135265 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:03.191395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:43:03.193451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ebee-533e-4df6-8c69-6df9dcf287e8 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:43:03.206933 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4171/8323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:43:05.718499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:05.718988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:05.719227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:05.749581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] MFA Rules not processed for user `843656b1ab4b43cbb3df67b116c754a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:43:05.750838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:05.756210 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:05.823473 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4153/8324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:43:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:43:06.062346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:06.064191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:06.065343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:06.089929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:43:06.091242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:06.099416 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4172/8325] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:43:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:43:06.518188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:43:06.586728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389639e-ddfd-4ed2-8421-ec38689cbb76 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:43:06.590362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:43:06.591083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:06.591350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:06.591612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:06.598416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:06.612185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:43:06.613804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a088ee-5494-49bd-990e-f272600c97ae service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:43:06.626476 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4154/8326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:43:06.693969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:43:06.695486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:06.787269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945fd3f-4dfc-4ef0-a382-0ba900009cc5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:43:06.793210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:43:06.793884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:06.794167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:06.794439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:06.797199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:06.813074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:43:06.814760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24489b64-35b8-487c-ae16-3c81c19f6191 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:43:06.837150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4173/8327] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:43:16.619127 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=46 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:16.828786 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=54 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:42.189152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29becb6-ade2-4cbf-adbe-e9000aae53a9 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:43:42.189713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29becb6-ade2-4cbf-adbe-e9000aae53a9 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:43:42.189713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29becb6-ade2-4cbf-adbe-e9000aae53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:43:42.212081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f29becb6-ade2-4cbf-adbe-e9000aae53a9 None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:43:42.213200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f29becb6-ade2-4cbf-adbe-e9000aae53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:43:42.220035 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4155/8328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:43:52.206373 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:02.273714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:44:02.274571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:44:02.275052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:44:02.295790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] MFA Rules not processed for user `7fa3cce1ff3445eb896fb8bad352ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:44:02.296985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:44:02.366653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4174/8329] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:44:12.359192 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=25 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:37.614107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:44:37.614723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:44:37.614937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:44:37.640588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:44:37.641840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:44:37.649326 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4156/8330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:44:47.635874 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:56.065733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:44:56.088935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91404b73-db71-433e-9c8e-9af96298e87e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:44:56.092802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:44:56.093430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:44:56.093728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:44:56.093993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:44:56.095727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:44:56.165107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:44:56.166628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:44:56.187412 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4175/8331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:01.435436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:01.437058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:01.461044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9630b-80c9-46c5-87e2-bf48e2e328dd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:01.466641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:01.467367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:01.467869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:01.468307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] PATH_INFO: `/v3/users/7fa3cce1ff3445eb896fb8bad352ef1f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:01.469585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa3cce1ff3445eb896fb8bad352ef1f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:01.472119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:01.537825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa3cce1ff3445eb896fb8bad352ef1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.538584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa3cce1ff3445eb896fb8bad352ef1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.549665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa3cce1ff3445eb896fb8bad352ef1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.564628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa3cce1ff3445eb896fb8bad352ef1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.564887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:01.565555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-b61e5379-da2a-4e59-95d0-321a62622e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa3cce1ff3445eb896fb8bad352ef1f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.566934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:01.580170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153caae6-f24b-4699-8ef4-884333339402 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:01.581825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4157/8332] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:01 2022] DELETE /identity/v3/users/7fa3cce1ff3445eb896fb8bad352ef1f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:01.586570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:01.586860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:01.587390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:01.606926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:01.608212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:01.642984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:01.643625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:01.643922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:01.644316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] PATH_INFO: `/v3/users/843656b1ab4b43cbb3df67b116c754a1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:01.645497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843656b1ab4b43cbb3df67b116c754a1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:01.647474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:01.674471 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4158/8333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:01.687669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:01.689307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:01.698759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843656b1ab4b43cbb3df67b116c754a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.706920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843656b1ab4b43cbb3df67b116c754a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.720550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843656b1ab4b43cbb3df67b116c754a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.721379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843656b1ab4b43cbb3df67b116c754a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.722786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843656b1ab4b43cbb3df67b116c754a1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:01.727687 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:01.738434 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4176/8334] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:01 2022] DELETE /identity/v3/users/843656b1ab4b43cbb3df67b116c754a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:01.761442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbc126-1118-42db-81e2-2eb9c12d5c8a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:01.787855 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:01.820008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:01.820628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:01.820915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:01.821189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:01.823005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:01.939910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:01.942067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:01.953561 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4159/8335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:02.057593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.059270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.078430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090735f-759f-4cd3-ab23-d3ae90d14e72 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.086136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.086860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.087051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.087551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] PATH_INFO: `/v3/projects/3682c1ffb86e44b990db78f7d82ff21c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.088696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3682c1ffb86e44b990db78f7d82ff21c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.090694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.145888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3682c1ffb86e44b990db78f7d82ff21c', 'request_id': 'req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.153210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3682c1ffb86e44b990db78f7d82ff21c', 'request_id': 'req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.160105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3682c1ffb86e44b990db78f7d82ff21c', 'request_id': 'req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.171138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.172738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.173725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] The token cache is being invalidate because project 3682c1ffb86e44b990db78f7d82ff21c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:02.174087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.174811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2ec0646b-1ac2-46ec-b2bc-3d372dbd5125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.177446 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4177/8336] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:02 2022] DELETE /identity/v3/projects/3682c1ffb86e44b990db78f7d82ff21c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:02.186007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bc854-e49b-45f2-82fc-f4ee8d0711bb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.187055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35838e8-a634-4e65-8711-3a554fc712bc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.187747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35838e8-a634-4e65-8711-3a554fc712bc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.188169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35838e8-a634-4e65-8711-3a554fc712bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.209015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c35838e8-a634-4e65-8711-3a554fc712bc None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:02.210269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c35838e8-a634-4e65-8711-3a554fc712bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.247484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.248296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.248637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.248974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] PATH_INFO: `/v3/projects/fdcd1c5a13e24165971100bc619e7be2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.250196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdcd1c5a13e24165971100bc619e7be2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.252202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.272756 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4178/8337] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:02.281019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.281302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.281601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.301646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:02.302764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.302973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdcd1c5a13e24165971100bc619e7be2', 'request_id': 'req-e716d974-16f1-44df-ae48-32d7d7d061e7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.309177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdcd1c5a13e24165971100bc619e7be2', 'request_id': 'req-e716d974-16f1-44df-ae48-32d7d7d061e7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.314961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdcd1c5a13e24165971100bc619e7be2', 'request_id': 'req-e716d974-16f1-44df-ae48-32d7d7d061e7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.328397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] The token cache is being invalidate because project fdcd1c5a13e24165971100bc619e7be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:02.328776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.329627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.332769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4160/8338] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:02 2022] DELETE /identity/v3/projects/fdcd1c5a13e24165971100bc619e7be2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:02.337313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.338744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.349660 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:02.367002 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4179/8339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:02.371232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.380085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993bb33-8324-4451-bac0-1e4f2b4f84fb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.390172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.391520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.391520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.391743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.392682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:02.392818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.395004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.410337 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4180/8340] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:45:02.411564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.414939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716d974-16f1-44df-ae48-32d7d7d061e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.420123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.421013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.421290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.421597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] PATH_INFO: `/v3/users/f123fbda3ee24d9faa10d29db4da3c17` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.422299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f52f-7cd7-4c48-936b-fc54e7cf0371 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.422743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f123fbda3ee24d9faa10d29db4da3c17)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.424683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.428201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.428807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.429091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.429365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.430120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.431916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.436534 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:02.467505 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4181/8341] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:02.471672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.477870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f123fbda3ee24d9faa10d29db4da3c17'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.478793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f123fbda3ee24d9faa10d29db4da3c17'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.486045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f123fbda3ee24d9faa10d29db4da3c17'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.499451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f123fbda3ee24d9faa10d29db4da3c17'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.500153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f123fbda3ee24d9faa10d29db4da3c17'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.513060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4161/8342] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:02 2022] DELETE /identity/v3/users/f123fbda3ee24d9faa10d29db4da3c17 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:02.537805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b41c9-9237-4302-8fc7-58b36032ea2c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.599644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.600357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.600538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.600810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.601475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.603474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.625532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4182/8343] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:02.630393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.631787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.645622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea306f-6833-4739-8965-526c7fa0f14e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.650269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.650874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.651149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.651415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.652053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.654298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.665164 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4162/8344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:02.669372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.679960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff513ed-bde3-46a7-8b67-9fdea8bbc1fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.689183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.689849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.690133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.690404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.691621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.693233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b039a-7287-42f2-bd28-70045b3ec569 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.703724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4183/8345] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:02.708809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.719092 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbe8c-8053-4a6a-a366-a10b4a456ba1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.724117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.724848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.725202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.725582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] PATH_INFO: `/v3/projects/b7aa5601fe674ad99ddf95389d108eb7/users/171e8a8afc9d48b78b669ac252e40c3f/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.741335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa5601fe674ad99ddf95389d108eb7, user_id=171e8a8afc9d48b78b669ac252e40c3f, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.744052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.758479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4163/8346] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:02 2022] PUT /identity/v3/projects/b7aa5601fe674ad99ddf95389d108eb7/users/171e8a8afc9d48b78b669ac252e40c3f/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:02.770220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.771205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.772053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.803508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] MFA Rules not processed for user `171e8a8afc9d48b78b669ac252e40c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:02.804783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.815472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.818184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:02.873899 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:02.877084 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:02.885515 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4184/8347] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:02.886567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.890185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197ee4-c0e2-42e8-977d-1f8cd9f76fe0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.895558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.896188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.896467 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.896746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] PATH_INFO: `/v3/projects/e611090010d2423a8cc49fb24800e541` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.897608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4da21-e40f-4ec1-9c2d-0553f17bbf6b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:02.897906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e611090010d2423a8cc49fb24800e541)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.899927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.902479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:02.902898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.903168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.903472 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:02.904126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:02.906331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:02.938150 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4185/8348] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:02.939227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:02.950785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e611090010d2423a8cc49fb24800e541', 'request_id': 'req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.958513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e611090010d2423a8cc49fb24800e541', 'request_id': 'req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.966016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e611090010d2423a8cc49fb24800e541', 'request_id': 'req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.983178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] The token cache is being invalidate because project e611090010d2423a8cc49fb24800e541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:02.983726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.984764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-83c52fa9-22ba-4cc3-85a9-eac4faaf1b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:02.986959 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4164/8349] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:02 2022] DELETE /identity/v3/projects/e611090010d2423a8cc49fb24800e541 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:02.992395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ddff-2c4e-485c-ab59-5633f1390e88 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:02.992964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ddff-2c4e-485c-ab59-5633f1390e88 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:02.993242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ddff-2c4e-485c-ab59-5633f1390e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.011653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93a1ac-4f85-44cb-a78a-4a8b3a06cfeb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.015665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4ac8ddff-2c4e-485c-ab59-5633f1390e88 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:03.016960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4ac8ddff-2c4e-485c-ab59-5633f1390e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.078765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.079682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.079976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.080228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.080885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.082432 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4165/8350] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:03.083168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.090546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.091063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.091770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.109583 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4186/8351] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:02 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:03.114581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.116386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.117267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:03.118488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.127288 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4166/8352] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:03.131453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db633e-7f3f-4446-b331-24a56d283b67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.134492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.136657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.137271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.137596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.137871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.138519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.140121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.143943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb0610-2b78-4bbf-960e-09a37f54a3a5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.148779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.149456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.149801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.150137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.150260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4187/8353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:03.150881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:03.151287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.152970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.154462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.164931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1deed-5243-4317-a8ab-5c2cf3fbf63d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.168566 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4167/8354] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:45:03.169473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.169865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.170516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.170796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.171071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] PATH_INFO: `/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5/users/49c9dca0c80347a8b499a479765d4431/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.180598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da951a72-331e-4365-88dc-453912377ef2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.185578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.186291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.186575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.186880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.187054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=69050c6dd73e4d4cb105a06d00f9dce5, user_id=49c9dca0c80347a8b499a479765d4431, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.187502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.189425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.189754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.204533 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4188/8355] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:03 2022] PUT /identity/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5/users/49c9dca0c80347a8b499a479765d4431/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:03.208911 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.225382 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4168/8356] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:03.226494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.252511 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:03.272038 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:03.272922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a278f5-3a44-49dd-b084-84871ebc6beb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.291718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200c33b-cfeb-4a31-b6ea-e8f155a0f0f9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.296463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.297070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.297356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.297671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.298292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.300293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.322774 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4169/8357] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:03.327005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.334693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.335372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.335658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.335936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.336613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.337051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1cf1-1e10-4dc7-ade2-6f9eabc380c6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.338304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.341773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.342362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.342645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.342927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.343915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.345139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.349213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4189/8358] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:45:03.353395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.357716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4170/8359] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:45:03.361307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.363545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601459-a062-4f6b-b35a-5d44c17aff00 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.368318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.368974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.369257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.369565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] PATH_INFO: `/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5/users/49c9dca0c80347a8b499a479765d4431/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.371536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69050c6dd73e4d4cb105a06d00f9dce5, user_id=49c9dca0c80347a8b499a479765d4431, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.371767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c65271-8d2f-4a2f-b3b4-5bdb5dc4aef1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.374238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbd8fd-9e3d-4e3f-873d-ba35893b5417 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.376537 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.377448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.377740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.378016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.379183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.380801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.389192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4190/8360] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:03 2022] PUT /identity/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5/users/49c9dca0c80347a8b499a479765d4431/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:03.397044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.397333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.397689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.399646 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4171/8361] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:45:03.403576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.418882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324df0-ee92-440b-a3b0-d5eee2603ede admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.428270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] MFA Rules not processed for user `49c9dca0c80347a8b499a479765d4431`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:03.429604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.478447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.479104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.479379 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.479644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] PATH_INFO: `/v3/projects/b9cacbcf9a194a09b0df90cdd54dc482/users/63d2512caf0f4a00a8962db23bd4803d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.494484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cacbcf9a194a09b0df90cdd54dc482, user_id=63d2512caf0f4a00a8962db23bd4803d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.497165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde22a-250a-4b7f-a021-4737fda01f96 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.505428 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4191/8362] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:03.509850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.511356 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4172/8363] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:03 2022] PUT /identity/v3/projects/b9cacbcf9a194a09b0df90cdd54dc482/users/63d2512caf0f4a00a8962db23bd4803d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:03.516065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.516420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.516725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.520044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9db6b-47e3-4e0f-92ac-bf1d73b8a183 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.537759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:03.538962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.571905 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:03.579965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.580732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.581018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.581301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.582169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.583784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.603113 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4192/8364] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/services => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:03.604098 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4173/8365] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:03.604723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.610084 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.611511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:03.624766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3993-b742-4656-b0b8-c6bf63e71d36 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.630399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.631007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.631279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.631559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.632218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.633859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.647154 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:03.650318 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1891806531. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:03.650318 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:03.650318 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:03.673476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2833728-2126-4ecb-b743-674d5e768f9b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.683800 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4193/8366] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/endpoints => generated 360 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:03.684824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.693293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.693949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.694234 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.694505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.703789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.705228 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.707603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160d646-0337-45b6-a4b3-6119aeecc853 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.712297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.712919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.713205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.713508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-1891806531` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.714090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1891806531)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.715146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.716939 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4194/8367] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/regions/tempest-region-1891806531 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:45:03.720863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.731257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3fb2-0a65-453f-9816-2e59b8b707d0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.735685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.736268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.736551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.736830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.737493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.738298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4174/8368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/auth/tokens => generated 3554 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:45:03.739215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.754260 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4195/8369] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/services => generated 288 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:03.758531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.781946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6c60-fd56-488e-9d2e-d66559534ea2 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.797017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.797659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.797944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.798215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.798879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.801016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.818246 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-832618918. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:03.818246 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:03.818246 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:03.848880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4175/8370] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/endpoints => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:03.853004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.865362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab18f-fd98-4621-8696-aff57e27ae3c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.882877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.883527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.883835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.884134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-832618918` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.885104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-832618918)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.886234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.891802 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4196/8371] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/regions/tempest-region-832618918 => generated 178 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:03.893085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.904807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223265-0579-425f-97f8-43f51f802c04 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.911042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.912282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.912571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.912846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.913627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.915791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.935409 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2125534250. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:03.935409 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:03.935409 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:03.960893 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4176/8372] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:45:03 2022] POST /identity/v3/endpoints => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:03.964860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:03.975686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db941f-042d-44a1-9412-41b029eb1a42 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:03.991928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:03.992559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:03.992945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:03.993217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-2125534250` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:03.993726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2125534250)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:03.994805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:03.999744 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4197/8373] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/regions/tempest-region-2125534250 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.000883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.013426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b1636-ab99-42ce-b143-c576a0c791ec tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.018402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.019034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.019317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.019594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.020218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.021240 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:45:04.021240 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:45:04.021240 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:04.022177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.043693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4177/8374] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:45:03 2022] GET /identity/v3/endpoints => generated 4396 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:45:04.047016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.058865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bb25-9c23-40cc-ace1-5a2ee1cb1f2f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.071374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.072025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.072307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.072580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.079050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=ac675c88eaf941c69fb0af921d8aa867)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.080367 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:45:04.080367 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:45:04.080367 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:04.081322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.085440 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4198/8375] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867 => generated 361 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.087345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.098646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c6f9-f747-4986-bb21-0e278eb6db64 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.103531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.104254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.104542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.104814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.106147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ac675c88eaf941c69fb0af921d8aa867)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.107171 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:45:04.107171 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(msg) Sep 25 01:45:04.107171 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:04.108091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.127420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ac675c88eaf941c69fb0af921d8aa867', 'request_id': 'req-edac3646-70a3-46ae-9729-825ec8916665'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:04.140786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4178/8376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:04.146321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.160157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3b6c-3e97-46c4-b0f9-b40bd1c14006 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.182330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.182330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.182330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(msg) Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:04.182757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.196736 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4199/8377] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints => generated 4048 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:04.198397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.209357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac3646-70a3-46ae-9729-825ec8916665 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.214271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.214985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.215337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.215718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.220861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Could not find endpoint: ac675c88eaf941c69fb0af921d8aa867.: keystone.exception.EndpointNotFound: Could not find endpoint: ac675c88eaf941c69fb0af921d8aa867. Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._iter().one() Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._only_one_row( Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:45:04.227593 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ac675c88eaf941c69fb0af921d8aa867. Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:45:04.228810 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:45:04.230052 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application with Lock( Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ac675c88eaf941c69fb0af921d8aa867. Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: ERROR keystone.server.flask.application Sep 25 01:45:04.231086 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4179/8378] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/endpoints/ac675c88eaf941c69fb0af921d8aa867 => generated 114 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 25 01:45:04.233047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.243784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cad0-64d5-4cb0-8b41-533a09b65b7e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.248534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.249159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.249475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.249757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-2125534250` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.250345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2125534250)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.251942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.264399 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2125534250. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:04.264399 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:04.264399 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:04.272191 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4200/8379] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/regions/tempest-region-2125534250 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:04.277257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.288122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e35e7-bd4b-4ee0-a090-e2c9b1a5d03e tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.306076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.306777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.307165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.307634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.308355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.310100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.322107 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4180/8380] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints => generated 4048 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:04.323275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.337541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715b86-5eb6-44b8-b1ca-7c3a6675e182 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.343322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.343735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.344020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.344296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.345443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Adding query filter params (service_id=f55274d8d298452fa822ac927763ca0c) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:04.345443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.347425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.357455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4201/8381] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints?service_id=f55274d8d298452fa822ac927763ca0c => generated 502 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.360220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.373022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db406a4-c41e-4952-8ce2-280b2137d210 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.378060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.378730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.379272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.379758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.380579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Adding query filter params (service_id=f489579632184fed9b2e91a6e98513e1) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:04.380952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.382679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.407591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4181/8382] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints?service_id=f489579632184fed9b2e91a6e98513e1 => generated 503 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.408937 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.419896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1e6b7-1875-4047-b113-762edf6cc7bb tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.435915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.436544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.436828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.437104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.437800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:04.438108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.439723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.460192 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4202/8383] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:04.465758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.482398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9b090-2633-4b85-a4b8-b9b00962f3cf tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.487889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.488703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.489059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.489441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.490157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:04.490552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.492249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.502589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4182/8384] 10.222.0.16 () {58 vars in 1171 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.509345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.519646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f61a5-38ac-4f45-808a-c3125c014941 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.525557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.526344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.526692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.526994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.527747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.529717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.547135 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4203/8385] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:04 2022] POST /identity/v3/services => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:04.551600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.562372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a380f3-0478-452c-a58a-3d0edeceb583 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.578812 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:04.582680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.583335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.583895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.584416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.585898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.588536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.612132 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-869849086. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:04.612132 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:04.612132 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:04.640901 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4183/8386] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:45:04 2022] POST /identity/v3/endpoints => generated 359 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:04.645614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.658284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d86cb1-a653-4c4d-97e4-406d06346409 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.681217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.683089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.683479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.683856 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-869849086` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.684556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-869849086)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.685774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.688630 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4204/8387] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/regions/tempest-region-869849086 => generated 178 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.693310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.704813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3ded-f741-4a2c-8842-254b17ae7cf6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.713248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.713935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.714223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.714503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/acd68b635b234698824e78c62e7d1ade` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.720168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=acd68b635b234698824e78c62e7d1ade)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.721877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.747124 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2057538635. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:04.747124 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:04.747124 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:04.785479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4184/8388] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:45:04 2022] PATCH /identity/v3/endpoints/acd68b635b234698824e78c62e7d1ade => generated 364 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.787584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.798684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf54b6-27f5-4d6f-98f3-22b6e69c114c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.816260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.817193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.817569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.817908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-2057538635` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.818546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2057538635)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.819706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.821869 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4205/8389] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:45:04 2022] GET /identity/v3/regions/tempest-region-2057538635 => generated 180 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:04.826151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.840128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4d50-e4bb-4c5f-bb90-fa49dea14565 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.845627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.846686 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.847636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.847927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/acd68b635b234698824e78c62e7d1ade` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.854054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=acd68b635b234698824e78c62e7d1ade)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.855916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.865522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'acd68b635b234698824e78c62e7d1ade', 'request_id': 'req-d9e31011-e3fe-440e-80bf-a6ef75f2880f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:04.876597 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4185/8390] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/endpoints/acd68b635b234698824e78c62e7d1ade => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:04.881647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.889096 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:04.896365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de526a27-8042-4646-9397-59a8525724e7 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.914557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.915541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.916067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.916559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-2057538635` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.917440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2057538635)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.919281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:04.935248 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2057538635. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:04.935248 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:04.935248 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:04.944039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4206/8391] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/regions/tempest-region-2057538635 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:04.948121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:04.960384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31011-e3fe-440e-80bf-a6ef75f2880f tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:04.980688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:04.981356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:04.981670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:04.981946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-869849086` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:04.983389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-869849086)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:04.984200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.009060 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4186/8392] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:45:04 2022] DELETE /identity/v3/regions/tempest-region-869849086 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.012915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.026784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc661-b7b8-454e-b442-953e789c0bc0 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.044610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.045304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.046672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.046672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services/d6c9628927d944588b03b0c7383baf7f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.046672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d6c9628927d944588b03b0c7383baf7f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.048942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.079962 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4207/8393] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/services/d6c9628927d944588b03b0c7383baf7f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.082985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.094946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ad1e2-fd0f-4006-b40e-a327e7a11fe6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.114074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.114704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.115201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.115466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/6260f9dc362b4aa2970169a8253262df` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.122144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6260f9dc362b4aa2970169a8253262df)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.124197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.133745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6260f9dc362b4aa2970169a8253262df', 'request_id': 'req-6303fd77-7645-4d05-bf94-06f53f769bae'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.150426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4187/8394] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/endpoints/6260f9dc362b4aa2970169a8253262df => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.152452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.170392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db719-891c-4d86-820c-1f5cf3972b87 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.195193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.196471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.196471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.196747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-832618918` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.197481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-832618918)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.199189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.214955 n-d-master-1 devstack@keystone.service[81863]: WARNING py.warnings [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-832618918. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:05.214955 n-d-master-1 devstack@keystone.service[81863]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:05.214955 n-d-master-1 devstack@keystone.service[81863]: Sep 25 01:45:05.223567 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4208/8395] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/regions/tempest-region-832618918 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.229057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.242264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fd77-7645-4d05-bf94-06f53f769bae tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.259591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.260285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.260572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.260844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services/f489579632184fed9b2e91a6e98513e1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.261457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f489579632184fed9b2e91a6e98513e1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.263069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.296649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.298129 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4188/8396] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/services/f489579632184fed9b2e91a6e98513e1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.308516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8252b3-0d5f-4168-b4f2-f66ced910183 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.324562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.325238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.325610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.326310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/endpoints/451141a9e124458983068481a42d3719` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.332817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=451141a9e124458983068481a42d3719)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.334589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.344957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '451141a9e124458983068481a42d3719', 'request_id': 'req-4e8f9c03-82ab-4403-8373-9ab2aa32664c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.357106 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4209/8397] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/endpoints/451141a9e124458983068481a42d3719 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.361056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.373212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81a547-555e-4a5b-9751-3d2dc0fc33d8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.403892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.404544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.404827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.405566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/regions/tempest-region-1891806531` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.406167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1891806531)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.408402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.420549 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:05.424792 n-d-master-1 devstack@keystone.service[81862]: WARNING py.warnings [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1891806531. To ensure interoperability, identifiers should be a valid uuid. Sep 25 01:45:05.424792 n-d-master-1 devstack@keystone.service[81862]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 25 01:45:05.424792 n-d-master-1 devstack@keystone.service[81862]: Sep 25 01:45:05.437821 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4189/8398] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/regions/tempest-region-1891806531 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.442914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.461158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9c03-82ab-4403-8373-9ab2aa32664c tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.493641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c9dca0c80347a8b499a479765d4431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69050c6dd73e4d4cb105a06d00f9dce5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.494441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.494820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.495210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] PATH_INFO: `/v3/services/f55274d8d298452fa822ac927763ca0c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.495906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f55274d8d298452fa822ac927763ca0c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.498297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66210d2c-5cdf-4dff-bbf0-ce0061697db8 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.533397 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4210/8399] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/services/f55274d8d298452fa822ac927763ca0c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.535552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.570861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a369-570d-4cd8-beac-6be4604ca0d6 tempest-EndPointsTestJSON-1643703115 tempest-EndPointsTestJSON-1643703115-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.596161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.597309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.597723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.598037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] PATH_INFO: `/v3/users/171e8a8afc9d48b78b669ac252e40c3f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.599217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171e8a8afc9d48b78b669ac252e40c3f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.601427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:05.708190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171e8a8afc9d48b78b669ac252e40c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.709050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171e8a8afc9d48b78b669ac252e40c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.717598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171e8a8afc9d48b78b669ac252e40c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.730376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171e8a8afc9d48b78b669ac252e40c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.731125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171e8a8afc9d48b78b669ac252e40c3f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:05.745313 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4190/8400] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:05 2022] DELETE /identity/v3/users/171e8a8afc9d48b78b669ac252e40c3f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:05.749992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.750798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.751225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.776008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:05.777238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:05.875741 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4211/8401] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:05.889746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:05.891759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:05.976329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc9cc-1761-45ad-a0a0-07382ace1294 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:05.980070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:05.980691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:05.980987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:05.981252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:05.991906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:05.993465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:06.004406 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4191/8402] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:06.508525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:06.510921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:06.529147 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:06.544006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494dcf4-0165-4452-8832-70b6904b893c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:06.556617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:06.557285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:06.558005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:06.558005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] PATH_INFO: `/v3/projects/b7aa5601fe674ad99ddf95389d108eb7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:06.562608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7aa5601fe674ad99ddf95389d108eb7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:06.564905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:06.638770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7aa5601fe674ad99ddf95389d108eb7', 'request_id': 'req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.653202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7aa5601fe674ad99ddf95389d108eb7', 'request_id': 'req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.674651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7aa5601fe674ad99ddf95389d108eb7', 'request_id': 'req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.704795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] The token cache is being invalidate because project b7aa5601fe674ad99ddf95389d108eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:06.705132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.705854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.713740 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4212/8403] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:06 2022] DELETE /identity/v3/projects/b7aa5601fe674ad99ddf95389d108eb7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:06.715045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:06.730097 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3877fa-c28d-4c5e-971d-3d3dfbd719cb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:06.808577 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:06.847207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:06.847858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:06.848143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:06.848417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] PATH_INFO: `/v3/users/49c9dca0c80347a8b499a479765d4431` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:06.850668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c9dca0c80347a8b499a479765d4431)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:06.853185 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:06.918362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c9dca0c80347a8b499a479765d4431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.919061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c9dca0c80347a8b499a479765d4431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.934613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c9dca0c80347a8b499a479765d4431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.959051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c9dca0c80347a8b499a479765d4431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.960281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9941dc39-c911-4e7e-b4b7-65e523a2457c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c9dca0c80347a8b499a479765d4431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:06.995076 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4192/8404] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:06 2022] DELETE /identity/v3/users/49c9dca0c80347a8b499a479765d4431 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:07.415523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:07.417260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:07.445993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8762a-68b2-4ddc-85ca-ddb913a6ee55 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:07.526064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:07.526816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:07.527265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:07.527560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] PATH_INFO: `/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:07.528868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69050c6dd73e4d4cb105a06d00f9dce5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:07.531470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:07.594492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69050c6dd73e4d4cb105a06d00f9dce5', 'request_id': 'req-985a69a2-f07d-43a7-9372-e503320b07f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:07.601845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69050c6dd73e4d4cb105a06d00f9dce5', 'request_id': 'req-985a69a2-f07d-43a7-9372-e503320b07f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:07.607766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69050c6dd73e4d4cb105a06d00f9dce5', 'request_id': 'req-985a69a2-f07d-43a7-9372-e503320b07f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:07.622383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] The token cache is being invalidate because project 69050c6dd73e4d4cb105a06d00f9dce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:07.622677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:07.623456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-985a69a2-f07d-43a7-9372-e503320b07f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:07.630744 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4213/8405] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:07 2022] DELETE /identity/v3/projects/69050c6dd73e4d4cb105a06d00f9dce5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:07.632269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:07.632560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:07.632840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:07.660930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:07.662363 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:07.750534 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4193/8406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:07.758882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:07.759523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:07.759523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:07.782971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:07.784216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:07.802463 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4214/8407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:07.807543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:07.825715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0b79-deea-4c24-83bf-10712ddfccf6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:07.830695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:07.831610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:07.832255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:07.832636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:07.833369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:07.833807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:07.835600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:07.850062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4194/8408] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:07.854428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:07.869161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd0bd2-4fe7-4390-b788-763a5f9c0159 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:07.883810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:07.884726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:07.885205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:07.885966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:07.887102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:07.890133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:07.897704 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:07.934973 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4215/8409] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:07 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:07.939231 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:07.950488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be548a57-136e-4785-bd08-b8ff5a4a37b7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.010908 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:08.029340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.030470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.030840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.031211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.031844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.033958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.060176 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4195/8410] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:07 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:08.064240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.075364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21b98-e9ce-4af0-8366-d83400421fa3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.081706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.082397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.082689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.082968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.083626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.085344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.100463 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4216/8411] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:08.101856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.114740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b377-7cfa-484d-a71e-6fb5627b9636 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.120374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.121157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.121657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.122005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.122859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.125878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b6ef-8c29-4ac3-a926-02c475a516cc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.145276 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4196/8412] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:08.149745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.168041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0358-2e13-4ae1-a070-41a032ab6615 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.184998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.185698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.185983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.186265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] PATH_INFO: `/v3/projects/0a95da307ca64781a27e43720253b637/users/f186fc6181c1449a9fe08c9c0e37c8bb/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.225868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a95da307ca64781a27e43720253b637, user_id=f186fc6181c1449a9fe08c9c0e37c8bb, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.228720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.243237 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4217/8413] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:08 2022] PUT /identity/v3/projects/0a95da307ca64781a27e43720253b637/users/f186fc6181c1449a9fe08c9c0e37c8bb/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:08.256216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.256724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.257195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.312407 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] MFA Rules not processed for user `f186fc6181c1449a9fe08c9c0e37c8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:08.313748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:08.413956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4197/8414] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:08.419175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.430850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d50d-2c2c-45d7-8420-dfcd4d69d259 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.435415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.436257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.436608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.436950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.437699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.439846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.463511 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4218/8415] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:08.467445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.477601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70f56-83a5-47cb-8987-5bc9ffe005ba None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.483224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.484701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.485191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.485514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/b85a2e2db72e42c6a0fe72f7c3fb445f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.488968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=b85a2e2db72e42c6a0fe72f7c3fb445f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.490866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.516579 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4198/8416] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 25 01:45:08 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/b85a2e2db72e42c6a0fe72f7c3fb445f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:08.522408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.538368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61fa17-ff48-4c11-a75d-99a3574909e2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.543250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.544581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.544867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.545145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.545958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.548376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.576674 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4219/8417] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:08.578230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.590884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fca2-a8cd-474a-a874-a7d9fa4d80d7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.595623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.596275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.596556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.597429 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/7cf6876e322f42179588b2fbe66f520a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.599813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=7cf6876e322f42179588b2fbe66f520a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.601425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.621491 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4199/8418] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 25 01:45:08 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/7cf6876e322f42179588b2fbe66f520a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:08.624387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.636950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2263e5c-2525-4a65-af4e-21b9a5883f12 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.641554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.642191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.642508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.642792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/7cf6876e322f42179588b2fbe66f520a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Could not find credential: e7baaacb3f16cfb887b47c0a3beb09dd157ba8af72c5326312915e07dcf7ad01.: keystone.exception.CredentialNotFound: Could not find credential: e7baaacb3f16cfb887b47c0a3beb09dd157ba8af72c5326312915e07dcf7ad01. Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Sep 25 01:45:08.669662 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 25 01:45:08.671008 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: e7baaacb3f16cfb887b47c0a3beb09dd157ba8af72c5326312915e07dcf7ad01. Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:45:08.672622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4220/8419] 10.222.0.16 () {58 vars in 1377 bytes} [Sun Sep 25 01:45:08 2022] GET /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/7cf6876e322f42179588b2fbe66f520a => generated 148 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:45:08.677492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.692564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522f29-db6a-40f8-b2d5-c24b481ee665 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.697260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.698033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.698388 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.698665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.699292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.700807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.729518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4200/8420] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:08.732922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.747842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d0c4-9ffc-4a15-9d3b-4dbb089972a2 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.752783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.754630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.754983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.755368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.756061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.757922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.782185 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4221/8421] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:08.783666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.795527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22070d6f-6afa-45e0-8625-347c264c4767 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.801477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.802243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.802626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.803003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.803674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.805415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.838905 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4201/8422] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:45:08 2022] GET /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 865 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:08.840169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.864192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70610-2805-40fc-a5e9-932da85ab17e tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.869025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.869938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.870672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.871055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/6524259a6c23491db0a04e335d9baaad` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.873327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=6524259a6c23491db0a04e335d9baaad)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.875103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.917175 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4222/8423] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 25 01:45:08 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/6524259a6c23491db0a04e335d9baaad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:08.918555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:08.934440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce6d0-01f5-4d9a-b78b-95e742214efc tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:08.952353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:08.953218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:08.953689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:08.954095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/fbaf4a17fdbf4f19b239732da6660d9f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:08.956402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=fbaf4a17fdbf4f19b239732da6660d9f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:08.958030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:08.995050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4202/8424] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 25 01:45:08 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/fbaf4a17fdbf4f19b239732da6660d9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:08.996606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.015242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d273-5f1e-412a-ac7b-146de173b97a tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.025513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.027190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.027811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.028277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.029355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.038720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.064080 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4223/8425] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 25 01:45:08 2022] POST /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2 => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:09.069349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.079866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ede6-43aa-46cd-932b-51a18ec7e454 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.085269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.085984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.086266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.086594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/55665c03b8d149e6b223fc079cb97f62` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.088586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=55665c03b8d149e6b223fc079cb97f62)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.090474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.098542 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.104973 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4203/8426] 10.222.0.16 () {58 vars in 1377 bytes} [Sun Sep 25 01:45:09 2022] GET /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/55665c03b8d149e6b223fc079cb97f62 => generated 367 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:09.109561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff1091-4d1e-4b6a-a4da-ff227b9e1163 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.115846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f186fc6181c1449a9fe08c9c0e37c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a95da307ca64781a27e43720253b637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.117206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.117206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.117600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/55665c03b8d149e6b223fc079cb97f62` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.121162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f186fc6181c1449a9fe08c9c0e37c8bb, credential_id=55665c03b8d149e6b223fc079cb97f62)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.123021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fac3be-29f6-493f-99c0-51258a9f6bf7 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.141947 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4224/8427] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 25 01:45:09 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb/credentials/OS-EC2/55665c03b8d149e6b223fc079cb97f62 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:09.147160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.168066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.168357 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.168634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.195793 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:09.199257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] MFA Rules not processed for user `63d2512caf0f4a00a8962db23bd4803d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:09.200655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:09.215270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c853e-5141-4702-b48a-9d84f8ec31e5 tempest-EC2CredentialsTest-2071653967 tempest-EC2CredentialsTest-2071653967-project] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.219956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.220588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.220874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.221147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] PATH_INFO: `/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.223275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f186fc6181c1449a9fe08c9c0e37c8bb)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.225298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.270123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4225/8428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:09.274197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f186fc6181c1449a9fe08c9c0e37c8bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:09.274528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.275050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f186fc6181c1449a9fe08c9c0e37c8bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:09.275901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:09.282660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f186fc6181c1449a9fe08c9c0e37c8bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:09.290602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3d76-dce6-45fe-959f-c28ed4d72f08 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.295189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f186fc6181c1449a9fe08c9c0e37c8bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:09.295317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.295839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.295979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7ff0a56d-0d58-47a7-809a-c1917b9f8ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f186fc6181c1449a9fe08c9c0e37c8bb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:09.296119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.296391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.297015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.298965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.305229 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:09.309723 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4204/8429] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:09 2022] DELETE /identity/v3/users/f186fc6181c1449a9fe08c9c0e37c8bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:09.314310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.314646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.314922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.329127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4226/8430] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:09.333248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.334860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:09.335044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:09.336119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:09.402911 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4205/8431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:09.407000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16775fb-0eae-4cd6-a5a5-3040cec36ad1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.413324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.414727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:09.417217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.417898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.418174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.418442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.419072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.420992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.447048 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4227/8432] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:09 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:09.448106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.457821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891eca-99af-47c7-8ef0-525976c615c2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.463719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.464584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.465115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.465256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.466565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.468473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.479345 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4228/8433] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:09.483475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.490756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4681b-fe44-4641-9a34-a04932d99eba None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.494284 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95a53-839d-45a0-9638-3503cad64a4e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.494636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.495256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.495534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.495810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.498994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.499643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.499925 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.500197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] PATH_INFO: `/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2/users/ee3a2f642fbc4f2c858bb2ca32ff4336/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.505366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.506849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.515151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff52eccdc6e45f8b57253e569be7ae2, user_id=ee3a2f642fbc4f2c858bb2ca32ff4336, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.517096 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4206/8434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:45:09.522413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.541039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4229/8435] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:09 2022] PUT /identity/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2/users/ee3a2f642fbc4f2c858bb2ca32ff4336/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:09.541939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.548021 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:09.553541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ddf6-831a-4f9b-a9b1-3b813e81e13d service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.625371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.626098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.626312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.626648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.627235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.629465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.640821 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4207/8436] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:09.645880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.658117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0d1-8976-4ad5-ac9e-6fef99c1bf1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:09.663702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:09.664626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:09.665064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:09.665469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] PATH_INFO: `/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2/users/ee3a2f642fbc4f2c858bb2ca32ff4336/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:09.667574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff52eccdc6e45f8b57253e569be7ae2, user_id=ee3a2f642fbc4f2c858bb2ca32ff4336, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:09.670336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4aef-da50-440a-9786-3342605cb207 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:09.682752 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4230/8437] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:09 2022] PUT /identity/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2/users/ee3a2f642fbc4f2c858bb2ca32ff4336/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:09.986988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:09.990122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:10.016305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916994a4-6dd9-47e2-9c9e-c7f0193f7729 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.092680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.093357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.094351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.094351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] PATH_INFO: `/v3/projects/0a95da307ca64781a27e43720253b637` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.095375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a95da307ca64781a27e43720253b637)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.098664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.207427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a95da307ca64781a27e43720253b637', 'request_id': 'req-98d82568-b9d0-480c-bc41-c5920e7fee08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:10.217617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a95da307ca64781a27e43720253b637', 'request_id': 'req-98d82568-b9d0-480c-bc41-c5920e7fee08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:10.226593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a95da307ca64781a27e43720253b637', 'request_id': 'req-98d82568-b9d0-480c-bc41-c5920e7fee08'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:10.242670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] The token cache is being invalidate because project 0a95da307ca64781a27e43720253b637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:10.242670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:10.243449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98d82568-b9d0-480c-bc41-c5920e7fee08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:10.245428 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4208/8438] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:09 2022] DELETE /identity/v3/projects/0a95da307ca64781a27e43720253b637 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:10.251374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.252071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.252403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.277150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:10.278372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:10.365334 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4231/8439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:10.373265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.373617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.373972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.421661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:10.423315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:10.455535 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4209/8440] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:10.466897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.480468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a451f6-7be8-482f-9145-200e31dda251 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.486527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.487160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.488459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.488743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.489394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:10.489861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.491727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.518318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.518682 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4232/8441] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:10.534359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366d37-f1b3-4275-8dc4-bc6c68da91a5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.541002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.542217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.542532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.542909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.543726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.546509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.585275 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4210/8442] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:10 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:10.589828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.618276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677635b7-591e-4e49-9e56-ce881739ab7a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.634901 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:10.697155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.697816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.698279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.698553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.699218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.701179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.732292 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4233/8443] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:10 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:10.736020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.742921 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:10.756273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e1de-c515-471a-bb46-000276d2c60f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.768611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.771715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.773425 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.773912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.774750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.776370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.800477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4211/8444] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:10.804745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.820961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d71d-c13e-432d-92ab-ba2f6bc189d3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.833807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.834431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.834710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.834983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.836017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.837432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c93e8f-2759-4f45-a013-02abcf2ffd9a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.872704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:10.882318 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4234/8445] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:10.891716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6025d-565f-43cd-a86d-f891ecc98fe1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:10.898410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:10.899380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.899881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.900266 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] PATH_INFO: `/v3/projects/7baf9ca059884db9a9260dcc4245ea4e/users/5c5c549bdaaf4af382413243c6fb942d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:10.952322 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baf9ca059884db9a9260dcc4245ea4e, user_id=5c5c549bdaaf4af382413243c6fb942d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:10.957895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:10.985444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4212/8446] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:10 2022] PUT /identity/v3/projects/7baf9ca059884db9a9260dcc4245ea4e/users/5c5c549bdaaf4af382413243c6fb942d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:10.991848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:10.992133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:10.992406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.027486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] MFA Rules not processed for user `5c5c549bdaaf4af382413243c6fb942d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:11.028875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:11.108775 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4235/8447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:11.110096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.200405 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5bbf6-328c-4336-9c56-464a1a732139 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.205533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.206716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.207140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.207426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.208063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.210061 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.242981 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4213/8448] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:11 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:11.248992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.262512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f71b-688e-44dc-b7f1-d39bbf510ba9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.341361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.342145 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.342495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.342891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.343596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.345778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.373600 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4236/8449] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:11 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:11.374810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.387116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276f70-4323-464a-bdb9-28a1ee9ec97a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.393690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.394342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.394624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.394900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.395644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.397283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.412584 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4214/8450] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:11.417346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.428789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf3900-8ab8-4a2a-89db-2264bc89712f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.434942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.436007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.436007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.436311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.437117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.438848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6bcd-dcb0-4dab-b5c3-b94838adbece admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.450874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4237/8451] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:11.455876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.469246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a7b6-5ea3-4ff6-b8a2-8a9395773bea admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.476637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.477323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.477658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.477939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] PATH_INFO: `/v3/projects/3d6950ddd6e0411289b3e87dd22b05a5/users/81878dcc9d384041bbb7747555294a47/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.498096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6950ddd6e0411289b3e87dd22b05a5, user_id=81878dcc9d384041bbb7747555294a47, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.506694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.523024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4215/8452] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:11 2022] PUT /identity/v3/projects/3d6950ddd6e0411289b3e87dd22b05a5/users/81878dcc9d384041bbb7747555294a47/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:11.536134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.536715 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.536836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.547167 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:11.574850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] MFA Rules not processed for user `81878dcc9d384041bbb7747555294a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:11.576673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:11.666783 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4238/8453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:11.680621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:11.685330 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:11.823574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756835-e6aa-484f-bdfc-b803f108a13c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:11.828775 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8492-1974-434a-80d0-99425685738a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:11.829554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8492-1974-434a-80d0-99425685738a service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:11.829941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8492-1974-434a-80d0-99425685738a service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:11.830401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8492-1974-434a-80d0-99425685738a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:11.845214 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:11.902995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8492-1974-434a-80d0-99425685738a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:11.904881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8492-1974-434a-80d0-99425685738a service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:11.917764 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4216/8454] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:12.059235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:12.075380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953efa0f-85c5-48d1-aada-abb79157b92d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:12.083790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:12.084984 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:12.085597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:12.085959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:12.097569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:12.099383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a68a28-f704-4625-ba6f-395aac150c46 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:12.114226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4239/8455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:12.607345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8492-1974-434a-80d0-99425685738a service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:12.760453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8492-1974-434a-80d0-99425685738a service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:12.771579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:12.771985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:12.772491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:12.772947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] PATH_INFO: `/v3/users/5c5c549bdaaf4af382413243c6fb942d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:12.775443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5c549bdaaf4af382413243c6fb942d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:12.779291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:12.854180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5c549bdaaf4af382413243c6fb942d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:12.855646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5c549bdaaf4af382413243c6fb942d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:12.866259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5c549bdaaf4af382413243c6fb942d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:12.885209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5c549bdaaf4af382413243c6fb942d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:12.886011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5c549bdaaf4af382413243c6fb942d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:12.907477 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4217/8456] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:12 2022] DELETE /identity/v3/users/5c5c549bdaaf4af382413243c6fb942d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:12.912374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:12.913175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:12.913175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:12.941813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:12.958575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:13.063057 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4240/8457] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:13.074245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:13.076813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:13.156933 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:13.212409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd49f-d335-47a3-bb79-32df0b27c505 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:13.218680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:13.219566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:13.220089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:13.220410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:13.238093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:13.240005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:13.254956 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4218/8458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:13.270113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:13.272450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:13.429646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ef16e-a332-4440-9d43-9ca2d97b1d17 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:13.436818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:13.437538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:13.437871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:13.438155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:13.442955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:13.480564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:13.495880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:13.517172 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:13.540287 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4241/8459] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:13.718574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:13.720538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:13.740324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c6475-d871-42af-88c4-0d587eb2e88c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:13.752873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:13.754080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:13.754539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:13.754817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] PATH_INFO: `/v3/projects/7baf9ca059884db9a9260dcc4245ea4e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:13.761654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baf9ca059884db9a9260dcc4245ea4e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:13.763918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:13.912550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baf9ca059884db9a9260dcc4245ea4e', 'request_id': 'req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:13.942348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baf9ca059884db9a9260dcc4245ea4e', 'request_id': 'req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:13.956125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baf9ca059884db9a9260dcc4245ea4e', 'request_id': 'req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.018412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] The token cache is being invalidate because project 7baf9ca059884db9a9260dcc4245ea4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:14.018812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.019983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.025915 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4219/8460] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:13 2022] DELETE /identity/v3/projects/7baf9ca059884db9a9260dcc4245ea4e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:14.027012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:14.040439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95afb-c91b-4b9b-9143-85752f1a9534 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:14.219509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:14.220446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:14.220827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:14.221202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] PATH_INFO: `/v3/users/81878dcc9d384041bbb7747555294a47` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:14.223924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=81878dcc9d384041bbb7747555294a47)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:14.227763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:14.318982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81878dcc9d384041bbb7747555294a47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.364073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81878dcc9d384041bbb7747555294a47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.392370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81878dcc9d384041bbb7747555294a47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.393315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81878dcc9d384041bbb7747555294a47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.394335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b107dbad-6d49-4665-b1cd-bd698d3583ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81878dcc9d384041bbb7747555294a47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:14.429883 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4242/8461] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:14 2022] DELETE /identity/v3/users/81878dcc9d384041bbb7747555294a47 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:14.965138 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:14.967323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:15.003693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80944-ac2f-4a0f-a0b1-0971699ffc43 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:15.157069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:15.160751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.161062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.161348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] PATH_INFO: `/v3/projects/3d6950ddd6e0411289b3e87dd22b05a5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.163302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6950ddd6e0411289b3e87dd22b05a5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:15.165927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:15.246348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6950ddd6e0411289b3e87dd22b05a5', 'request_id': 'req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:15.258993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6950ddd6e0411289b3e87dd22b05a5', 'request_id': 'req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:15.272705 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:15.280908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6950ddd6e0411289b3e87dd22b05a5', 'request_id': 'req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:15.304506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] The token cache is being invalidate because project 3d6950ddd6e0411289b3e87dd22b05a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:15.304886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:15.306479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:15.311043 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4220/8462] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:14 2022] DELETE /identity/v3/projects/3d6950ddd6e0411289b3e87dd22b05a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:15.317449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4ebf-3dfb-497e-af1c-d7961412a6c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.317965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4ebf-3dfb-497e-af1c-d7961412a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.318068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4ebf-3dfb-497e-af1c-d7961412a6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.371332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-038e4ebf-3dfb-497e-af1c-d7961412a6c9 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:15.372882 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-038e4ebf-3dfb-497e-af1c-d7961412a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:15.391038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:15.392620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:15.501094 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4243/8463] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:15.510090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.510617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.511088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.542112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:15.543641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:15.578574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4244/8464] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:15.589725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:15.595442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ce2b8-5399-427a-97ac-6341f82c0f9d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:15.603164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:15.604010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.604324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.604702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.605717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75c07-4edb-4637-8db4-b548da2d8060 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:15.607237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:15.634070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:15.636260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.636559 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.636843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.637567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:15.637885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:15.641383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:15.644624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:15.645121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:15.666139 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:15.673586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4245/8465] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:15.676191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:15.684797 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4221/8466] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:15.719075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eea9e-dc26-417f-93f0-e985f79ab86e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:15.727903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:15.728529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:15.728818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:15.729096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:15.729837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:15.742566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:15.812174 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4246/8467] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:15 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:15.817290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:15.841689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e820c3-f6e8-4e26-87c6-271bd29f8c3f service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:15.998034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.026026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.026262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.026500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.027200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.033832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.083882 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4222/8468] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:15 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:16.085027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.101802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e365879-bb89-46a1-97db-b1c4f9f7c954 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.110100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.110736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.113520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.113821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.114644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.116447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.140327 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4247/8469] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:16.141790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.156064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31998b92-7c1e-46bf-acf1-29195294d38f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.162427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.164313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.164313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.164313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.164665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.166625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f0744-1898-4307-ba20-64b180b16e22 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.184744 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4223/8470] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:16.186780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.203249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac25b7-1b41-45a8-b0c4-6d72aa365253 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.211355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.212212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.212819 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.213532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] PATH_INFO: `/v3/projects/11c3c0dd91794c8a94dfc4308a5429c1/users/c9ecee589711401ab1792f46e264dcb8/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.236820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c3c0dd91794c8a94dfc4308a5429c1, user_id=c9ecee589711401ab1792f46e264dcb8, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.242040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.263062 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4248/8471] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:16 2022] PUT /identity/v3/projects/11c3c0dd91794c8a94dfc4308a5429c1/users/c9ecee589711401ab1792f46e264dcb8/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:16.277326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.277714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.278143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.317540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] MFA Rules not processed for user `c9ecee589711401ab1792f46e264dcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:16.319437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:16.378469 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:16.418144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.429085 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4224/8472] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:16.512388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9157a-bd3a-42ce-91b1-8b3e3e67b378 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.518126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.521093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.521500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.521845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.522571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.524833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.578418 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4249/8473] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:16 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:16.583409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.604301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e4de6-c4e9-4a0e-93a9-c07c8aa81349 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.753418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.754738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.755196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.755956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.756814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.760687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.810653 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4225/8474] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:16 2022] POST /identity/v3/users => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:16.813150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.828914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc244c5-91bf-4055-8e5c-c323a26278a1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.839316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.839961 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.840241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.840512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.841170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.842955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.869909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4250/8475] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:16.874740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:16.887260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c5b5-e83b-4044-97da-e6055d910585 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:16.904000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:16.905588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:16.906059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:16.906515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] PATH_INFO: `/v3/projects/d2d16bd9bf3540b38f24576d659bd619/users/27d5fa2a6373479da7865474d185670b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:16.935890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d16bd9bf3540b38f24576d659bd619, user_id=27d5fa2a6373479da7865474d185670b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:16.959256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:16.986842 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4226/8476] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:16 2022] PUT /identity/v3/projects/d2d16bd9bf3540b38f24576d659bd619/users/27d5fa2a6373479da7865474d185670b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:16.988541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:17.010268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf292-a998-4206-9dc6-872c345d80fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:17.139077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:17.140066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.140420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.140759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.141524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:17.143745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4d8de-d9ea-4260-88fb-5fe1f9e3d806 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:17.164166 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4251/8477] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:17.168218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:17.186575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de5ba-7cab-49b4-8bca-4ecf258c84e7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:17.192924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:17.193776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.194159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.194532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] PATH_INFO: `/v3/projects/d2d16bd9bf3540b38f24576d659bd619/users/27d5fa2a6373479da7865474d185670b/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.196660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d16bd9bf3540b38f24576d659bd619, user_id=27d5fa2a6373479da7865474d185670b, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:17.199687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcd01-f75e-4b31-91ec-514d2795f467 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:17.214736 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4227/8478] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:17 2022] PUT /identity/v3/projects/d2d16bd9bf3540b38f24576d659bd619/users/27d5fa2a6373479da7865474d185670b/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:17.225314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.225708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.225941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.296216 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:17.305845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] MFA Rules not processed for user `27d5fa2a6373479da7865474d185670b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:17.309282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:17.343623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.344164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.344625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.465238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] MFA Rules not processed for user `ee3a2f642fbc4f2c858bb2ca32ff4336`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:17.466783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:17.487890 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4252/8479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:17.498478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:17.500000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:17.573024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401e94-9b6d-4399-b793-2d85c7d757a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:17.588320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:17.589157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.589471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.589750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.626079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4228/8480] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:17.642948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:17.644516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:17.686368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:17.687861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752e41a-9a27-4091-a926-72e7887e2f45 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:17.691671 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:17.704930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4253/8481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:17.822086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a8ccb-7dff-44f2-8486-b6d68d97c05e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:17.830561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:17.830561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:17.830561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:17.830561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:17.833570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:17.922415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:17.925782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:17.944160 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4229/8482] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:45:19.795354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:19.795804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:19.795952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:19.826571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] MFA Rules not processed for user `63d2512caf0f4a00a8962db23bd4803d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:19.829245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:19.848670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4254/8483] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:20.523318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:20.547025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c307f8-e886-492d-8153-da29954d6057 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:20.557695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:20.558581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:20.558999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:20.559570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:20.563980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:20.598204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:20.604650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:20.623215 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4230/8484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:21.229231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:21.236126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:21.271956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e1f93-e7e0-4fb7-85fc-1d17a9fac193 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:21.276308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:21.276954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:21.277228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:21.277749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:21.293439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:21.299555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:21.312732 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4255/8485] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:23.305660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:23.309576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:23.462631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f144a2-5656-4fac-bd19-91ea73081deb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:23.480064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:23.480797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:23.481217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:23.481603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:23.484136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:23.506067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:23.508005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13528-2355-4270-8436-6105d767c973 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:23.534901 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4231/8486] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:24.858625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:24.905172 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:24.949563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453dd44-9f76-426d-ad85-8c35d7663012 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:24.957252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:24.958306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:24.958846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:24.959350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] PATH_INFO: `/v3/users/c9ecee589711401ab1792f46e264dcb8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:24.960717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ecee589711401ab1792f46e264dcb8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:24.963723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:25.078059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ecee589711401ab1792f46e264dcb8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:25.094732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ecee589711401ab1792f46e264dcb8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:25.125395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ecee589711401ab1792f46e264dcb8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:25.127989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ecee589711401ab1792f46e264dcb8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:25.129811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ecee589711401ab1792f46e264dcb8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:25.162314 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4256/8487] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:24 2022] DELETE /identity/v3/users/c9ecee589711401ab1792f46e264dcb8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:25.163627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:25.164087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:25.164198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:25.201477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:25.203150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:25.239704 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:25.330682 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4232/8488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:25.340562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:25.342179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:25.454609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeebd4-1243-49e8-888b-16d10498de4d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:25.461231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:25.461922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:25.462491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:25.462869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:25.480272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:25.481804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:25.494391 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4257/8489] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:25.558659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:25.564620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:25.843443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:25.847803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:25.891736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fb86d-aacd-438e-b398-3241f6e0801f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:25.910927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e8ce8-6c51-4b92-93b8-6b69bb6690c1 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:25.911433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:25.911954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:25.913202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:25.913509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:25.918824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:25.919710 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:25.920460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:25.920848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] PATH_INFO: `/v3/projects/11c3c0dd91794c8a94dfc4308a5429c1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:25.922204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c3c0dd91794c8a94dfc4308a5429c1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:25.925781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:25.926594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:25.987553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:25.989188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:26.028590 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4233/8490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:26.033988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c3c0dd91794c8a94dfc4308a5429c1', 'request_id': 'req-87bf7ff2-b436-47fd-9b8f-50ca3755575a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.035122 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:26.044761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c3c0dd91794c8a94dfc4308a5429c1', 'request_id': 'req-87bf7ff2-b436-47fd-9b8f-50ca3755575a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.057031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c3c0dd91794c8a94dfc4308a5429c1', 'request_id': 'req-87bf7ff2-b436-47fd-9b8f-50ca3755575a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.084449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] The token cache is being invalidate because project 11c3c0dd91794c8a94dfc4308a5429c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:26.085132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.086934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.089772 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4258/8491] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:25 2022] DELETE /identity/v3/projects/11c3c0dd91794c8a94dfc4308a5429c1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:26.093662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:26.110538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef4a5-84eb-4297-b017-57b44f0bab22 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:26.319594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:26.320323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:26.320512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:26.320969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] PATH_INFO: `/v3/users/27d5fa2a6373479da7865474d185670b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:26.322364 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d5fa2a6373479da7865474d185670b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:26.324616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:26.439254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d5fa2a6373479da7865474d185670b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.440613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d5fa2a6373479da7865474d185670b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.447999 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:26.450971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d5fa2a6373479da7865474d185670b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.472928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d5fa2a6373479da7865474d185670b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.474249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d126a6d-ea24-489e-80b8-00cef3c6ba91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d5fa2a6373479da7865474d185670b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.490488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4234/8492] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:26 2022] DELETE /identity/v3/users/27d5fa2a6373479da7865474d185670b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:26.823190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:26.824705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:26.840129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7ff2-b436-47fd-9b8f-50ca3755575a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:26.902223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:26.902870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:26.903183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:26.903417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] PATH_INFO: `/v3/projects/d2d16bd9bf3540b38f24576d659bd619` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:26.904709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d16bd9bf3540b38f24576d659bd619)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:26.906987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:26.967011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d16bd9bf3540b38f24576d659bd619', 'request_id': 'req-1494f651-aa73-4564-afda-52cd2ad886d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.973963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d16bd9bf3540b38f24576d659bd619', 'request_id': 'req-1494f651-aa73-4564-afda-52cd2ad886d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.982705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d16bd9bf3540b38f24576d659bd619', 'request_id': 'req-1494f651-aa73-4564-afda-52cd2ad886d0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.997362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] The token cache is being invalidate because project d2d16bd9bf3540b38f24576d659bd619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:26.997726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.998376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1494f651-aa73-4564-afda-52cd2ad886d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:26.999861 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4259/8493] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:26 2022] DELETE /identity/v3/projects/d2d16bd9bf3540b38f24576d659bd619 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:27.005783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.006105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.006383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.027822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:27.029030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:27.096193 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4235/8494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:27.104553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.104837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.105104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.128782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:27.129960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:27.139264 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4260/8495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:27.144471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.154271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18d66-19ba-44a7-b241-8e275cdd42f5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.159491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.160115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.160399 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.160673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.161335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:27.161678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.163302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.179934 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4236/8496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:27.181171 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.191766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5b471-347a-41d4-a070-811456206eb3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.196584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.197214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.197539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.197814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.198452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.200382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.233712 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4261/8497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:27.238218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.248430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9f30c-17b9-4160-945f-88c398009e87 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.329490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.330189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.330578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.330918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.331850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.334045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.359460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4237/8498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:27.360620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.372005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a78264-e738-4597-87fb-0b7504903a27 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.382329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.383323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.383786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.389697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.389697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.389697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.399858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4262/8499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:27.404031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.430016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fe75e-e8f1-4906-ad77-00e1f49f21e1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.439024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.439697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.440865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.441265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.441985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.443670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b337ad-6e1e-435f-a2fe-71a2cedbb052 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.458157 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4238/8500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:27.462346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.477524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc87e-1b08-4d7f-89bf-e7f368acb3bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.482353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.483070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.483498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.484063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] PATH_INFO: `/v3/projects/05960093514143239ecdc851d2b4b127/users/85170b1dfe0e45b68a950d1c1c71a273/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.504352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05960093514143239ecdc851d2b4b127, user_id=85170b1dfe0e45b68a950d1c1c71a273, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.507939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.525455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4263/8501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:27 2022] PUT /identity/v3/projects/05960093514143239ecdc851d2b4b127/users/85170b1dfe0e45b68a950d1c1c71a273/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:27.536297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.536713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.537072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.568843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] MFA Rules not processed for user `85170b1dfe0e45b68a950d1c1c71a273`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:27.570244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:27.605828 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:27.654155 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4239/8502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:27.659683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.665896 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:27.744932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105186f-4bed-4275-9f44-e03f93404f0e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.749854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.750463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.750746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.751016 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.751657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.753773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.785182 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4264/8503] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:27.789465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.802119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925825ff-6ea5-4f75-9593-11af82a5af78 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.864605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.865349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.865727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.866072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.866793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.868882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.896261 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4240/8504] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:27 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:27.898104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.911971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dccfd-372e-46d1-9044-2af3d38f6a24 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.916985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.917628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.917910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.918182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.918821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.920670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.933431 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4265/8505] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:27.937436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:27.948328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900f92-78ee-42be-a228-02bfa739e9a4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:27.953203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:27.954167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:27.954516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:27.954867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] PATH_INFO: `/v3/projects/44389b4f1dbf42d38a419c69372cbdac/users/651dffeace594fbdab3db555cafac96e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:27.972947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44389b4f1dbf42d38a419c69372cbdac, user_id=651dffeace594fbdab3db555cafac96e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:27.975788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:27.990880 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4241/8506] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:27 2022] PUT /identity/v3/projects/44389b4f1dbf42d38a419c69372cbdac/users/651dffeace594fbdab3db555cafac96e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:27.995392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:28.006373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293608-d408-40ae-b8b8-ebdd2603b1bd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:28.076129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:28.076650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:28.077012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:28.077292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:28.078011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:28.079753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ddb46-0864-49e8-96ff-1b323019c057 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:28.095524 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4266/8507] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:28.098031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:28.109887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abc1c6-59de-4004-8565-758a97611a0a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:28.115666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:28.116353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:28.116631 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:28.116899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] PATH_INFO: `/v3/projects/44389b4f1dbf42d38a419c69372cbdac/users/651dffeace594fbdab3db555cafac96e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:28.118876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44389b4f1dbf42d38a419c69372cbdac, user_id=651dffeace594fbdab3db555cafac96e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:28.121558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:28.132952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4242/8508] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:28 2022] PUT /identity/v3/projects/44389b4f1dbf42d38a419c69372cbdac/users/651dffeace594fbdab3db555cafac96e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:28.143991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:28.144406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:28.144684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:28.177821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] MFA Rules not processed for user `651dffeace594fbdab3db555cafac96e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:28.178965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:28.245068 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:28.249551 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4267/8509] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:28.259432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:28.261132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:28.322561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637c9c-c6ee-407c-ba1e-a17f7399d522 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:28.326409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:28.326957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:28.327236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:28.327502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:28.337861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:28.339493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060de255-c32b-4a27-90a6-84a4801dbff0 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:28.351071 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4243/8510] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:30.703017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:30.775502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9eb62-49e1-47cc-801d-33b0a31f301f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:30.780644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:30.781283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:30.781597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:30.781875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] PATH_INFO: `/v3/users/85170b1dfe0e45b68a950d1c1c71a273` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:30.782999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85170b1dfe0e45b68a950d1c1c71a273)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:30.785509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:30.872965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85170b1dfe0e45b68a950d1c1c71a273'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:30.884518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85170b1dfe0e45b68a950d1c1c71a273'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:30.907931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85170b1dfe0e45b68a950d1c1c71a273'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:30.909219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85170b1dfe0e45b68a950d1c1c71a273'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:30.910581 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85170b1dfe0e45b68a950d1c1c71a273'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:30.934328 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4268/8511] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:30 2022] DELETE /identity/v3/users/85170b1dfe0e45b68a950d1c1c71a273 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:30.938942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:30.939486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:30.939796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:30.968349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:30.969770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:30.997138 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:31.053819 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4244/8512] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:31.064297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:31.066643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:31.149220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f646222-3170-4e7c-984a-1219b17bafd6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:31.155607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:31.156349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:31.156755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:31.157502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:31.171262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:31.173071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:31.191857 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4269/8513] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:31.537305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:31.538510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:31.567071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff41c-d30a-4f0a-81b3-7e0149124c5c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:31.572480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:31.573103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:31.573382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:31.573699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] PATH_INFO: `/v3/projects/05960093514143239ecdc851d2b4b127` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:31.574875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05960093514143239ecdc851d2b4b127)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:31.576809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:31.628514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05960093514143239ecdc851d2b4b127', 'request_id': 'req-53e13899-e4d8-4e5d-86ce-9054c640429b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.635114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05960093514143239ecdc851d2b4b127', 'request_id': 'req-53e13899-e4d8-4e5d-86ce-9054c640429b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.640959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05960093514143239ecdc851d2b4b127', 'request_id': 'req-53e13899-e4d8-4e5d-86ce-9054c640429b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.660396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] The token cache is being invalidate because project 05960093514143239ecdc851d2b4b127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:31.660696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.661440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.663072 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4245/8514] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:31 2022] DELETE /identity/v3/projects/05960093514143239ecdc851d2b4b127 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:31.667898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:31.679276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9c071-b473-48e8-bb18-65577cc062c3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:31.703232 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:31.750609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:31.751169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:31.751455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:31.751759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] PATH_INFO: `/v3/users/651dffeace594fbdab3db555cafac96e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:31.753692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=651dffeace594fbdab3db555cafac96e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:31.755755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:31.807015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651dffeace594fbdab3db555cafac96e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.817017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651dffeace594fbdab3db555cafac96e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.829132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651dffeace594fbdab3db555cafac96e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.829893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651dffeace594fbdab3db555cafac96e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.830737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-133d7a16-c841-4523-9562-13350a78ea1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651dffeace594fbdab3db555cafac96e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:31.844849 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4270/8515] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:31 2022] DELETE /identity/v3/users/651dffeace594fbdab3db555cafac96e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:32.141839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.144087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:32.159522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e13899-e4d8-4e5d-86ce-9054c640429b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.231808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.232806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.233159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.233536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] PATH_INFO: `/v3/projects/44389b4f1dbf42d38a419c69372cbdac` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.234978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=44389b4f1dbf42d38a419c69372cbdac)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.238240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.294162 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:32.295321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44389b4f1dbf42d38a419c69372cbdac', 'request_id': 'req-9d9d4889-4527-45ed-bc24-a8e945e037ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:32.304895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44389b4f1dbf42d38a419c69372cbdac', 'request_id': 'req-9d9d4889-4527-45ed-bc24-a8e945e037ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:32.312549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44389b4f1dbf42d38a419c69372cbdac', 'request_id': 'req-9d9d4889-4527-45ed-bc24-a8e945e037ec'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:32.326863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] The token cache is being invalidate because project 44389b4f1dbf42d38a419c69372cbdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:32.327156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:32.329812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9d9d4889-4527-45ed-bc24-a8e945e037ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:32.335246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4246/8516] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:32 2022] DELETE /identity/v3/projects/44389b4f1dbf42d38a419c69372cbdac => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:32.336711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.337010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.337287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.364954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:32.366288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:32.446078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4271/8517] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:32.454020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.454306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.454580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.480694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:32.482106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:32.492481 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4247/8518] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:32.497194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.508610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282b4f-430f-4357-aa4b-31707dfccbc5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.513732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.514420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.514788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.515176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.516638 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:32.516973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.519923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.534811 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4272/8519] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:32.540635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.550905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc5ba-2cce-4dbe-9149-4dea181f6297 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.557257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.558258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.558583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.558947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.559666 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.561740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.599121 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4248/8520] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:32.603570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.614778 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ffe4-3024-4623-b431-f923cbcdba11 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.641545 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:32.676043 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.676662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.676946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.677218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.677897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.680033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.703152 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4273/8521] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/users => generated 304 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:32.707716 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.718982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343af4-f8f7-4505-989a-2dc44de9914e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.724665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.725275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.725590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.725877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.726524 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.728131 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.740231 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4249/8522] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:32.744354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.755742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff4d39-ed00-4f85-9ed2-5c1cef708edd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.762011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.762630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.762914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.763185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.763838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.765489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070be62-7111-4a1b-a560-f551bdfeed9d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.780487 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4274/8523] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:32.782859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:32.794726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4019e8-a32c-4c54-8918-0803b7c61b53 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:32.800137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:32.800794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.801074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.801367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] PATH_INFO: `/v3/projects/c250afd7e27f472ba2eeb902475519a9/users/c81f4855ac264bfe94ec6ec50447c2c1/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.817360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c250afd7e27f472ba2eeb902475519a9, user_id=c81f4855ac264bfe94ec6ec50447c2c1, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:32.820074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:32.835016 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4250/8524] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:32 2022] PUT /identity/v3/projects/c250afd7e27f472ba2eeb902475519a9/users/c81f4855ac264bfe94ec6ec50447c2c1/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:32.846817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:32.847108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:32.847414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:32.876557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] MFA Rules not processed for user `c81f4855ac264bfe94ec6ec50447c2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:32.878370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:32.949250 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4275/8525] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:32.953897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.020269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac5248-861b-4f6c-ac9b-ad76f1c33978 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.025028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.025963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.026245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.026523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.027171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.029139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.058466 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4251/8526] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:32 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:33.062513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.074074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb185ac-fecd-4b13-918f-550170cc557d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.135103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.135714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.135992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.136264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.136935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.139030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.166498 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4276/8527] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:33 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:45:33.168373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.179902 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d78c51-11eb-4f48-837d-1170ee86cf05 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.185484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.186093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.186378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.186657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.187300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.188916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.202046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4252/8528] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:33.206350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.217759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87dd6e-d54d-4fda-98eb-de924c4b0100 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.223337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.224031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.224310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.224589 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] PATH_INFO: `/v3/projects/c43422aeb15c4ba1b9c858049f274f9f/users/fd5f658fb8e941e3bf19a76d5e16d62f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.243698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43422aeb15c4ba1b9c858049f274f9f, user_id=fd5f658fb8e941e3bf19a76d5e16d62f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.246475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.262585 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4277/8529] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:33 2022] PUT /identity/v3/projects/c43422aeb15c4ba1b9c858049f274f9f/users/fd5f658fb8e941e3bf19a76d5e16d62f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:33.266153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.278679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45923-1629-4f16-890b-5cf35abc04cf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.333274 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:33.349630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.350246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.350522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.350789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.351532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.353128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f6d2-a365-4817-b8a6-1f4549c78905 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.365895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4253/8530] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:33.369949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.375479 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:33.383823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad494af-ecc2-4504-8d57-e4c8e361c0b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.392399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.393811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.394231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.394511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] PATH_INFO: `/v3/projects/c43422aeb15c4ba1b9c858049f274f9f/users/fd5f658fb8e941e3bf19a76d5e16d62f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.396465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43422aeb15c4ba1b9c858049f274f9f, user_id=fd5f658fb8e941e3bf19a76d5e16d62f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.399181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.410925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4278/8531] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:33 2022] PUT /identity/v3/projects/c43422aeb15c4ba1b9c858049f274f9f/users/fd5f658fb8e941e3bf19a76d5e16d62f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:33.421241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.421648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.421955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.450676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] MFA Rules not processed for user `fd5f658fb8e941e3bf19a76d5e16d62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:33.451879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:33.531656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4254/8532] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:33.542444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:33.544371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:33.624894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757df25b-e166-4b0e-86d8-cfd3a4fc758b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:33.630968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:33.631600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:33.631880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:33.632148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:33.699635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:33.701048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:33.713475 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4279/8533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:33 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:34.085074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:34.085516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:34.086646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:34.087031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:34.105580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901bcfb-096f-473f-b55f-e56075ebef2f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:34.109287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:34.110204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:34.110204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:34.110507 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:34.113397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:34.220032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb513e-bcf8-49f2-b082-bf971fe5a61e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:34.227111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:34.227731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:34.228011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:34.228281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:34.228408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:34.230003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:34.238910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:34.240677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5f1d8-5517-4ff8-8f01-85eacc5fd725 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:34.250246 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4255/8534] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:34.259278 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4280/8535] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:45:40.154770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:40.229875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54568d-8b6a-4e57-aac2-1278d8420bb7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:40.234316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:40.234974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:40.235256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:40.235534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] PATH_INFO: `/v3/users/c81f4855ac264bfe94ec6ec50447c2c1` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:40.237301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81f4855ac264bfe94ec6ec50447c2c1)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:40.239344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:40.241937 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:40.288976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81f4855ac264bfe94ec6ec50447c2c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.289839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81f4855ac264bfe94ec6ec50447c2c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.297515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81f4855ac264bfe94ec6ec50447c2c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.312565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81f4855ac264bfe94ec6ec50447c2c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.313302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81f4855ac264bfe94ec6ec50447c2c1'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.328861 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4256/8536] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:40 2022] DELETE /identity/v3/users/c81f4855ac264bfe94ec6ec50447c2c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:40.333549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:40.334083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:40.334265 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:40.356779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:40.358036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:40.384987 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:40.428423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4281/8537] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:40.439439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:40.441063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:40.509172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbf4c3-0050-43fd-943f-0ff68f625722 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:40.512844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:40.513608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:40.513890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:40.514174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:40.524385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:40.526235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:40.537271 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4257/8538] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:40.721159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:40.722992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:40.745843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6100e2-2d67-4294-8555-0d54f33a06ee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:40.750760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:40.751395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:40.752067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:40.752407 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] PATH_INFO: `/v3/projects/c250afd7e27f472ba2eeb902475519a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:40.753733 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c250afd7e27f472ba2eeb902475519a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:40.755720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:40.820189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c250afd7e27f472ba2eeb902475519a9', 'request_id': 'req-3621b528-c648-4365-8999-4923945b71bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.827119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c250afd7e27f472ba2eeb902475519a9', 'request_id': 'req-3621b528-c648-4365-8999-4923945b71bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.833436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c250afd7e27f472ba2eeb902475519a9', 'request_id': 'req-3621b528-c648-4365-8999-4923945b71bb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.847563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] The token cache is being invalidate because project c250afd7e27f472ba2eeb902475519a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:40.847892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.848570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.850134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4282/8539] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:40 2022] DELETE /identity/v3/projects/c250afd7e27f472ba2eeb902475519a9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:40.854153 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:40.864133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff28d-775b-4c0f-8565-19bfa1e26e3f service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:40.928150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:40.928784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:40.929065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:40.929339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] PATH_INFO: `/v3/users/fd5f658fb8e941e3bf19a76d5e16d62f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:40.930496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5f658fb8e941e3bf19a76d5e16d62f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:40.932506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:40.966498 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:40.991942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5f658fb8e941e3bf19a76d5e16d62f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:40.992628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5f658fb8e941e3bf19a76d5e16d62f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.000198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5f658fb8e941e3bf19a76d5e16d62f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.013156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5f658fb8e941e3bf19a76d5e16d62f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.013948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e4ec462b-1e6d-4bea-85f7-a539d3465a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5f658fb8e941e3bf19a76d5e16d62f'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.027715 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4258/8540] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:45:40 2022] DELETE /identity/v3/users/fd5f658fb8e941e3bf19a76d5e16d62f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:41.208719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.210613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:41.231512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621b528-c648-4365-8999-4923945b71bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.295496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.296178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.296465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.296744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] PATH_INFO: `/v3/projects/c43422aeb15c4ba1b9c858049f274f9f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.297918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43422aeb15c4ba1b9c858049f274f9f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.300639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.349692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43422aeb15c4ba1b9c858049f274f9f', 'request_id': 'req-a936a94d-fd1b-48e7-95d1-848118c48e17'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.356143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43422aeb15c4ba1b9c858049f274f9f', 'request_id': 'req-a936a94d-fd1b-48e7-95d1-848118c48e17'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.357564 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:41.364434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43422aeb15c4ba1b9c858049f274f9f', 'request_id': 'req-a936a94d-fd1b-48e7-95d1-848118c48e17'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.379042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] The token cache is being invalidate because project c43422aeb15c4ba1b9c858049f274f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:45:41.379334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.379996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a936a94d-fd1b-48e7-95d1-848118c48e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:45:41.381553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4283/8541] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:45:41 2022] DELETE /identity/v3/projects/c43422aeb15c4ba1b9c858049f274f9f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:45:41.386457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.387376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.387845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.410571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:41.411855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:41.475380 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4259/8542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:45:41.483173 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.483477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.483735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.505302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:41.506538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:41.514560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4284/8543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:41.519591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.529354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82e83-c564-4ceb-8eba-07d4860a4b84 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.534345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.534945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.535226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.535498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.536170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:45:41.536478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.538144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.554451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4260/8544] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:45:41.555660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.565965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc923-47c7-44ed-bfd7-768b38784ca0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.570635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.571237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.571521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.571795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.572424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.574382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.605149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4285/8545] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:45:41 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:41.606673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.618110 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902d9f-660f-4e75-a120-969ea97e38c9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.682089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.682617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.682899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.683176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.683824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.685789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.713481 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4261/8546] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:45:41 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:45:41.714729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.725651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed2fd9-0580-48ae-a91d-437bc509f44e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.730228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.730836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.731112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.731379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.732011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.733743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.744768 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4286/8547] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:45:41.748740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.759659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29f46-b055-4022-8832-886f7ec736c5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.764378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.764960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.765250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.765549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.766194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.768072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73252e-7d17-4869-a40d-4a5dd99cdb08 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.778741 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4262/8548] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:45:41.783642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.793981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e199b-26d8-49d7-a34d-bfcf134fd54d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:41.800505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:41.800505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.800505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.800877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] PATH_INFO: `/v3/projects/aeb8470e93994844a6660f30651f25e2/users/d9373c4f8e1f48d58edecf915881fabe/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.818629 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb8470e93994844a6660f30651f25e2, user_id=d9373c4f8e1f48d58edecf915881fabe, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:41.821515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:41.839146 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4287/8549] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:45:41 2022] PUT /identity/v3/projects/aeb8470e93994844a6660f30651f25e2/users/d9373c4f8e1f48d58edecf915881fabe/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:45:41.850888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c163f-a6bc-4969-bfb7-9b5f9eb18e21 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:41.851193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c163f-a6bc-4969-bfb7-9b5f9eb18e21 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:41.851459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c163f-a6bc-4969-bfb7-9b5f9eb18e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:41.886980 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:41.898971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-357c163f-a6bc-4969-bfb7-9b5f9eb18e21 None None] MFA Rules not processed for user `d9373c4f8e1f48d58edecf915881fabe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:41.900663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-357c163f-a6bc-4969-bfb7-9b5f9eb18e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:41.969146 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4263/8550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:41.981676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:41.983534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:42.044830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28f61-2264-415b-a2e1-e149a089d3e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:42.050106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:42.050799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:42.051136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:42.051410 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:42.060470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:42.062027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:42.071208 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4288/8551] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:45:48.352420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:48.353328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:48.353328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:48.377673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:45:48.378903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:48.455427 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4264/8552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:45:49.193120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:49.206750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0f84-6e9a-4570-995a-0042dcac5784 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:49.222303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:49.222852 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:49.223142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:49.223417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:49.225299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:49.324296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:49.326313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aadf4-d6e7-429c-9b41-45d0c4c26be6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:49.363888 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4289/8553] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:54.344378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:45:54.360066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a60d-2aed-4b91-8675-427a23b08deb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:45:54.365885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:45:54.366508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:45:54.366981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:45:54.367263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:45:54.369431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:45:54.387325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:45:54.388734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:45:54.419472 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4265/8554] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:45:59.335272 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:04.397884 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=63 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:10.974240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:10.975223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:10.975735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:11.020526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:11.022369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:11.126714 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4290/8555] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:46:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:11.193845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:11.196640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:11.327274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec81-8a28-46a9-8cb0-2c5d0ad934cd service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:11.334555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:11.335372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:11.335825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:11.336279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:11.345981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:11.348272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc797297-8dad-4d08-b67e-a79832ba45ca service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:11.357561 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4266/8556] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 01:46:12.466355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:12.468269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:12.488779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d510-cb7e-45a8-9b1c-3f4810d78b5e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:12.493590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:12.494666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:12.495138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:12.495592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:12.497693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:12.513711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:12.515697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:12.528824 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4291/8557] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:46:12.768290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a17bd1-e87b-4d39-b6c1-eb58b0d2cd73 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:12.769148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a17bd1-e87b-4d39-b6c1-eb58b0d2cd73 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:12.769148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a17bd1-e87b-4d39-b6c1-eb58b0d2cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:12.794955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-55a17bd1-e87b-4d39-b6c1-eb58b0d2cd73 None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:12.796287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-55a17bd1-e87b-4d39-b6c1-eb58b0d2cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:12.810987 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4267/8558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:22.522128 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=39 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:22.785956 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=39 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:49.155232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:49.226254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7474-4e96-487d-8fd1-5b8c338a8b21 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:49.231350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:49.232127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:49.232387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:49.232723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] PATH_INFO: `/v3/users/d9373c4f8e1f48d58edecf915881fabe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:49.233899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9373c4f8e1f48d58edecf915881fabe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:49.236449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:49.287046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9373c4f8e1f48d58edecf915881fabe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:49.295351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9373c4f8e1f48d58edecf915881fabe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:49.309164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9373c4f8e1f48d58edecf915881fabe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:49.309955 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9373c4f8e1f48d58edecf915881fabe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:49.310580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9373c4f8e1f48d58edecf915881fabe'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:49.325727 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4292/8559] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:46:49 2022] DELETE /identity/v3/users/d9373c4f8e1f48d58edecf915881fabe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:49.331130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:49.331840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:49.331840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:49.351866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:49.353100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:49.419150 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4268/8560] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:49.430055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:49.431473 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:49.500585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f32b-b07c-4b98-b944-a33704c20516 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:49.505674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:49.506878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:49.507358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:49.507688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:49.520166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:49.521649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33bcc-1387-4f95-a6a7-05d8903186c8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:49.533021 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4293/8561] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:46:50.176740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.179563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:50.199843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72a1fb-ab87-43f5-ae8a-6b3f47b513b0 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.207800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.209064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.209779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.210387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] PATH_INFO: `/v3/projects/aeb8470e93994844a6660f30651f25e2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.212220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb8470e93994844a6660f30651f25e2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.215112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.273875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb8470e93994844a6660f30651f25e2', 'request_id': 'req-51725880-b67a-4f96-a177-bbb2f1cdc2eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:50.283193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb8470e93994844a6660f30651f25e2', 'request_id': 'req-51725880-b67a-4f96-a177-bbb2f1cdc2eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:50.291546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb8470e93994844a6660f30651f25e2', 'request_id': 'req-51725880-b67a-4f96-a177-bbb2f1cdc2eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:50.308247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] The token cache is being invalidate because project aeb8470e93994844a6660f30651f25e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:46:50.308681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:50.309613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-51725880-b67a-4f96-a177-bbb2f1cdc2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:50.311336 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4269/8562] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:46:50 2022] DELETE /identity/v3/projects/aeb8470e93994844a6660f30651f25e2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:50.316748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.317356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.317356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.337804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:50.339013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:50.360080 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:50.416915 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4294/8563] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:50.426098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.426786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.426786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.450395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:50.451756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:50.463874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4270/8564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:50.468841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.484944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2face9c1-3db1-454a-ac8e-7a525fc42e7b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.492623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.493416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.493712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.493989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.494828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:46:50.495258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.497249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.513979 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4295/8565] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:46:50.519373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.531846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a1a5d-2ed8-4828-8142-39ae365a68df None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.539446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.540219 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.540576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.540848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.541919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.544296 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.581329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4271/8566] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:46:50 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:46:50.586298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.600608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fed52-eea8-4b09-911e-338d8a132665 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.670607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.670842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.671055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.671328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.672107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.674389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.700689 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4296/8567] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:46:50 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:46:50.706292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.721607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532a0d-373f-49b0-ab8d-622c1820cb4a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.728280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.729245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.729690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.730074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.730905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.733135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.745925 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4272/8568] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:46:50.750353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.764417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294016e2-855d-4db5-8700-d8e877605e54 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.772292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.773290 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.773615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.773932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.774841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.776792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898b22b-1814-4a74-95a4-76ad9d4c9021 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.793001 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4297/8569] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:46:50.797562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:50.809761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e39c-7b3a-452e-9e1c-8a368cef9096 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:50.816078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:50.816774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.817056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.817432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] PATH_INFO: `/v3/projects/005fcb9d3bbf4cf2bd4f4636ec4b5a5c/users/3d52413c17054f8a88e0bc017c062f3b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.838293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=005fcb9d3bbf4cf2bd4f4636ec4b5a5c, user_id=3d52413c17054f8a88e0bc017c062f3b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:50.842683 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:50.861106 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4273/8570] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:46:50 2022] PUT /identity/v3/projects/005fcb9d3bbf4cf2bd4f4636ec4b5a5c/users/3d52413c17054f8a88e0bc017c062f3b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:50.874331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:50.874631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:50.874951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:50.908753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] MFA Rules not processed for user `3d52413c17054f8a88e0bc017c062f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:50.910192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:50.991612 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4298/8571] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:51.010270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:51.012459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:51.042071 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:51.092255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba99e-8c5c-4692-822b-4268cd9b0bfa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:51.096391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:51.097006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.097392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.097700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.107427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:51.108885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f3034-d6c8-4457-afae-ea11e95013f8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:51.120245 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4274/8572] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:46:51.140985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:51.172088 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:51.222702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baae11-b2b2-44b7-8b2c-d8ac767d1d33 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:51.227734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:51.228396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.228674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.228943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] PATH_INFO: `/v3/users/3d52413c17054f8a88e0bc017c062f3b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.230270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d52413c17054f8a88e0bc017c062f3b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:51.232192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:51.284866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d52413c17054f8a88e0bc017c062f3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.292498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d52413c17054f8a88e0bc017c062f3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.305826 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d52413c17054f8a88e0bc017c062f3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.306587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d52413c17054f8a88e0bc017c062f3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.307205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d52413c17054f8a88e0bc017c062f3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.322390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4299/8573] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:46:51 2022] DELETE /identity/v3/users/3d52413c17054f8a88e0bc017c062f3b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:51.326959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.327287 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.327578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.348205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:51.349799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:51.422104 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4275/8574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:51.431302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:51.432833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:51.500434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b89f1-7640-4602-a4f7-8485ebfe36a4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:51.505230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:51.506093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.506401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.506691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.517802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:51.519437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4243210-53a0-4b08-b164-3dd7d817fa6d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:51.531492 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4300/8575] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:46:51.828115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:51.829922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:51.849643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f052c3-a752-4f91-a530-fa3b91f8671a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:51.855164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:51.856018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.856306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.856579 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] PATH_INFO: `/v3/projects/005fcb9d3bbf4cf2bd4f4636ec4b5a5c` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.857748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005fcb9d3bbf4cf2bd4f4636ec4b5a5c)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:51.859842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:51.912373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005fcb9d3bbf4cf2bd4f4636ec4b5a5c', 'request_id': 'req-782d835d-053e-42f7-84e4-b38eafc58ba3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.919245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005fcb9d3bbf4cf2bd4f4636ec4b5a5c', 'request_id': 'req-782d835d-053e-42f7-84e4-b38eafc58ba3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.925609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005fcb9d3bbf4cf2bd4f4636ec4b5a5c', 'request_id': 'req-782d835d-053e-42f7-84e4-b38eafc58ba3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.940362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] The token cache is being invalidate because project 005fcb9d3bbf4cf2bd4f4636ec4b5a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:46:51.940583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.941332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-782d835d-053e-42f7-84e4-b38eafc58ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:46:51.942902 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4276/8576] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:46:51 2022] DELETE /identity/v3/projects/005fcb9d3bbf4cf2bd4f4636ec4b5a5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:51.948259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:51.948648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:51.948966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:51.970546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:51.971867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:52.015911 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:52.047164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4301/8577] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:52.146584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.146877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.147156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.167720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:52.168947 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:52.177808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4277/8578] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:52.182136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.193659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd862f4-b2cd-4821-815e-9a973fbf0bef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.199185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.199886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.200169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.200437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.201084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:46:52.201588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.203259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.216941 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4302/8579] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:46:52.221826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.233256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7770-7c97-4955-ad59-9ad45a74c7e7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.239780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.240619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.241152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.241632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.242473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.244797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.280165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4278/8580] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:46:52.284107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.313182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fa4d-d2eb-4e2a-be40-e6b66e8101f1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.374015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.374696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.374892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.375170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.375836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.378082 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.408519 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4303/8581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:46:52.409708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.422086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedc9e2-91a3-49c4-8b22-3c99525d57a6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.427589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.428241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.428523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.428799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.429485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.431117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.442145 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4279/8582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:46:52.446478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.457319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93c87d-7f24-4494-a8a8-5625fe5003d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.462368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.462993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.463278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.463773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.464440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.466110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9abde-6c9d-40e2-8c0b-55fce828cb92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.489429 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4304/8583] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:46:52.494052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.505481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f538c-3870-479e-a212-bec8dd1cf6aa admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.510282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.510952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.511233 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.511505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] PATH_INFO: `/v3/projects/5966f5d10f2341a8b5d3eee0e5ef11c2/users/30f869a953424b9f9a997bf118d04cb2/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.513974 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:52.531855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5966f5d10f2341a8b5d3eee0e5ef11c2, user_id=30f869a953424b9f9a997bf118d04cb2, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.535159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.549221 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4280/8584] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:46:52 2022] PUT /identity/v3/projects/5966f5d10f2341a8b5d3eee0e5ef11c2/users/30f869a953424b9f9a997bf118d04cb2/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:52.559348 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.559641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.559947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.588631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] MFA Rules not processed for user `30f869a953424b9f9a997bf118d04cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:52.589952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:52.660786 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4305/8585] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:52.665285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.729431 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f2a7-1c58-4cda-940d-ed3c042d4c54 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.734082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.734692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.734974 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.735247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.736189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.738158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.776329 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4281/8586] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:46:52.777745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.790511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ab3a-19ca-4d47-b1c2-3ad4c1cc63a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.824834 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:52.852547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.853164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.853475 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.853762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.854431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.856454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.878483 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4306/8587] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:46:52 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:46:52.882572 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.894488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291f026-82e5-4585-8bd9-da341942cfdf admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.899346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.900036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.900416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.900744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.901390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.903030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.917786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4282/8588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:46:52.918900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.929363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5613-3a67-48ce-8ed8-87f79b8d969a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:52.934121 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:52.934777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:52.935062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:52.935340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] PATH_INFO: `/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3/users/022da0a9729444028e875fbe829c36a7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:52.950610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6573816d3f4ae0b3f3a0b489629ca3, user_id=022da0a9729444028e875fbe829c36a7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:52.953602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:52.968313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4307/8589] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:46:52 2022] PUT /identity/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3/users/022da0a9729444028e875fbe829c36a7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:52.973205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:52.983565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258192-fc62-4a41-826f-b19683999fe6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:53.042393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:53.043001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:53.043278 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:53.043544 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:53.044170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:53.045820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c272c7-8b7d-4d15-9d82-18721e50d0e1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:53.056308 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4283/8590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:46:53.060569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:53.071267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe2035-77c8-4355-9403-80ca50d40937 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:53.076002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:53.076656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:53.076939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:53.077213 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] PATH_INFO: `/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3/users/022da0a9729444028e875fbe829c36a7/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:53.079805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6573816d3f4ae0b3f3a0b489629ca3, user_id=022da0a9729444028e875fbe829c36a7, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:53.083668 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:53.094335 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4308/8591] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:46:53 2022] PUT /identity/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3/users/022da0a9729444028e875fbe829c36a7/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:46:53.113377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:53.113768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:53.114118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:53.144601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] MFA Rules not processed for user `022da0a9729444028e875fbe829c36a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:46:53.146157 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:53.192182 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:53.221095 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4284/8592] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:46:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:46:53.232691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:53.234516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:46:53.312261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35fa4-f3f0-4492-90aa-8c1ee667ada1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:53.316989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:53.317844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:53.317938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:53.318458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:53.330325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:53.331812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:53.342843 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4309/8593] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:46:53.440398 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:46:53.452727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc012a-40e0-4895-94bf-0fba1af0a75e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:46:53.457090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:46:53.457726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:46:53.458010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:46:53.458285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:46:53.517816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:46:53.519272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dc74f-8d35-4df0-be11-4b361eddbce7 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:46:53.528255 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4285/8594] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:46:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:02.305883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:02.307394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:02.439128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a200b-f747-482d-991d-7f2afd518080 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:02.481685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:02.486669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:02.488929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:02.489206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:02.498339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:02.533530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:02.535134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:02.557094 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4310/8595] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:03.525120 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=38 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:10.507482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:10.508136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:10.508136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:10.528598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:10.530108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:10.590286 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4286/8596] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 01:47:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:10.604471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:10.606056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:10.615807 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:10.695751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3427f-a439-4019-9b8c-befc31a54fb9 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:10.701975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:10.703119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:10.703592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:10.704966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:10.716507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:10.718874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eacf70-73d1-409b-b6d9-333a3ecd4c3d service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:10.728831 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4311/8597] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 01:47:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 25 01:47:20.583442 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=25 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:20.725640 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=29 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:26.898204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:26.899721 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:26.961976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437850c-6e6e-46f2-977c-45ce98514c73 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:26.967952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:26.967952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:26.967952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:26.967952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:26.974876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:26.991159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:26.992641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:27.005848 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4287/8598] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:30.073003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac793-5396-414e-b361-d248d6332e5a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:30.073579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac793-5396-414e-b361-d248d6332e5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:30.073579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac793-5396-414e-b361-d248d6332e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:30.093389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4d7ac793-5396-414e-b361-d248d6332e5a None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:30.095229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d7ac793-5396-414e-b361-d248d6332e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:30.153153 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4312/8599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:36.998264 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=26 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:40.146085 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=25 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:44.930983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:44.996391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b5de-a33d-47aa-8929-6e49f88b42d7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:45.001634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:45.002265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:45.002547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:45.002821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] PATH_INFO: `/v3/users/30f869a953424b9f9a997bf118d04cb2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:45.003975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f869a953424b9f9a997bf118d04cb2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:45.005949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:45.061026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f869a953424b9f9a997bf118d04cb2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.061828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f869a953424b9f9a997bf118d04cb2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.071994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f869a953424b9f9a997bf118d04cb2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.086565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f869a953424b9f9a997bf118d04cb2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.087368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f869a953424b9f9a997bf118d04cb2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.102538 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4288/8600] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:44 2022] DELETE /identity/v3/users/30f869a953424b9f9a997bf118d04cb2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:45.107156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:45.107686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:45.107686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:45.131098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:45.132369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:45.196455 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4313/8601] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:47:45.206989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:45.208696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:45.275823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ef3-fa95-42b7-8402-a2a2ec5d2e0c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:45.279489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:45.280360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:45.280662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:45.280934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:45.290340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:45.291771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:45.302205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4289/8602] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:47:45.579525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:45.581044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:45.598287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b6010-5b6c-43da-9b1c-ddf64a8ddea0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:45.603147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:45.603786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:45.604068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:45.604351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] PATH_INFO: `/v3/projects/5966f5d10f2341a8b5d3eee0e5ef11c2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:45.605489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5966f5d10f2341a8b5d3eee0e5ef11c2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:45.607431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:45.659900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5966f5d10f2341a8b5d3eee0e5ef11c2', 'request_id': 'req-c6089701-9a0a-42fc-b834-7c89f26faae9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.666280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5966f5d10f2341a8b5d3eee0e5ef11c2', 'request_id': 'req-c6089701-9a0a-42fc-b834-7c89f26faae9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.671835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5966f5d10f2341a8b5d3eee0e5ef11c2', 'request_id': 'req-c6089701-9a0a-42fc-b834-7c89f26faae9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.686285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] The token cache is being invalidate because project 5966f5d10f2341a8b5d3eee0e5ef11c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:45.686578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.687232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.688936 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4314/8603] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:45 2022] DELETE /identity/v3/projects/5966f5d10f2341a8b5d3eee0e5ef11c2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:45.693101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:45.702699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022c-bc1e-4f8e-b30c-18933b767626 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:45.721604 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:45.761487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:45.762145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:45.762424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:45.762696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] PATH_INFO: `/v3/users/022da0a9729444028e875fbe829c36a7` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:45.763806 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022da0a9729444028e875fbe829c36a7)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:45.766010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:45.812062 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022da0a9729444028e875fbe829c36a7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.813447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022da0a9729444028e875fbe829c36a7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.820780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022da0a9729444028e875fbe829c36a7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.832659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022da0a9729444028e875fbe829c36a7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.833375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-c5543827-05ae-4579-81b9-96b90cbda1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022da0a9729444028e875fbe829c36a7'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:45.847444 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4290/8604] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:45 2022] DELETE /identity/v3/users/022da0a9729444028e875fbe829c36a7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:46.125594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.127680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:46.143268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089701-9a0a-42fc-b834-7c89f26faae9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.201337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.202000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.202282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.202556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] PATH_INFO: `/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.204386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6573816d3f4ae0b3f3a0b489629ca3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.206333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.237484 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:46.255920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6573816d3f4ae0b3f3a0b489629ca3', 'request_id': 'req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:46.262464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6573816d3f4ae0b3f3a0b489629ca3', 'request_id': 'req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:46.269161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6573816d3f4ae0b3f3a0b489629ca3', 'request_id': 'req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:46.283703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] The token cache is being invalidate because project be6573816d3f4ae0b3f3a0b489629ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:46.286058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:46.289313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f90e7be-41b1-4682-abb8-78b2e2f5cb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:46.291107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4315/8605] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:46 2022] DELETE /identity/v3/projects/be6573816d3f4ae0b3f3a0b489629ca3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:46.295756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.296265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.296468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.319028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:46.320612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:46.389367 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4291/8606] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:46.394150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.394438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.394717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.415308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:46.416531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:46.424740 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4316/8607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:46.429077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.439809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3afd3-cafe-4a6f-b4b0-a0942b607450 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.444553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.445155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.445469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.445747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.446397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:47:46.446702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.448311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.460527 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4292/8608] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:47:46.464916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.474548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c76a5f-c2b9-4381-86be-4b62c04e32ee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.479341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.479981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.480304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.480591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.481236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.483519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.510925 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4317/8609] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:47:46.515202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.526154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a1d7-07b1-46c1-b8e5-e45462659663 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.553106 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:46.585840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.586446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.586725 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.586995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.587618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.589560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.610958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4293/8610] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:47:46.614757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.625658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a527-84c7-42f8-86b0-202804d4fd33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.630504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.631045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.631327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.631602 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.632246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.634001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.644413 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4318/8611] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:46.648235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.658575 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c316-87ba-4a77-b94d-f64194c80e33 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.663194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.663788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.664069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.664341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.665042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.666613 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b0d2-84b4-4740-84b8-146c97d1d74f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.678205 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4294/8612] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:46.682431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.693445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f890c-c44b-46d9-ad88-2bca991ef6b3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.698160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.698823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.699111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.699388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] PATH_INFO: `/v3/projects/cd8eeecbe06948e084ed50652a1546bc/users/8675dd84f41e4e04b6308f21271c9b9d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.716029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8eeecbe06948e084ed50652a1546bc, user_id=8675dd84f41e4e04b6308f21271c9b9d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.719287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.732325 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4319/8613] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:46 2022] PUT /identity/v3/projects/cd8eeecbe06948e084ed50652a1546bc/users/8675dd84f41e4e04b6308f21271c9b9d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:47:46.744033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.744319 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.744593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.772543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] MFA Rules not processed for user `8675dd84f41e4e04b6308f21271c9b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:46.773794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:46.837990 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4295/8614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:46.842591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.903697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83e225-0595-47db-a03a-d4192c51dece admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:46.909258 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:46.909890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:46.910167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:46.910436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:46.911057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:46.912972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:46.939149 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4320/8615] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:46.943060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:46.954502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815c7ce-669f-493e-85a2-1d40b9cf3826 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.010919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.011532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.011817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.012116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.012748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.014766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.037077 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4296/8616] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:46 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:47.041088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.053019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607deb8-5dfc-424a-a141-e64e5f69f924 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.059383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.060226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.060664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.061199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.061889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.064615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.076667 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4321/8617] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:47.081587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.091733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef98d4-e99e-4b0e-9a89-1ac84a649ba5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.096692 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.097344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.097658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.097942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] PATH_INFO: `/v3/projects/cf2a44a71b104541a043968b5fa3fcb5/users/1b24560686d241bfa8233f84daa9a624/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.113465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2a44a71b104541a043968b5fa3fcb5, user_id=1b24560686d241bfa8233f84daa9a624, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.116320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.131564 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4297/8618] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:47 2022] PUT /identity/v3/projects/cf2a44a71b104541a043968b5fa3fcb5/users/1b24560686d241bfa8233f84daa9a624/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:47.135567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.146799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a7f5-f07f-4963-8345-d6bc82d42193 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.168574 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:47.210628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.211248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.211530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.211814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.212457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.214105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec6a2-089b-4220-99c0-754bfe5c02ed admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.227071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4322/8619] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:47.228300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.233815 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:47.239862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615abc3-c066-4be0-a63c-5cb9e02062d6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.248170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.248478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.248737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.249018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] PATH_INFO: `/v3/projects/cf2a44a71b104541a043968b5fa3fcb5/users/1b24560686d241bfa8233f84daa9a624/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.251527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2a44a71b104541a043968b5fa3fcb5, user_id=1b24560686d241bfa8233f84daa9a624, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.254390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.265216 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4298/8620] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:47 2022] PUT /identity/v3/projects/cf2a44a71b104541a043968b5fa3fcb5/users/1b24560686d241bfa8233f84daa9a624/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:47:47.276398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.276769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.277046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.307115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] MFA Rules not processed for user `1b24560686d241bfa8233f84daa9a624`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:47.308338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:47.377457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4323/8621] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:47.388605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.390361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:47.456963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a76ee4-b90b-4134-b7cb-acc209c53ca7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.460663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.461269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.461588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.461862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.472411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.473919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872bb3-8911-40da-92b8-db0be4969fb8 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.485064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4299/8622] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:47.555081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.618867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059afa3-9686-4ce0-8b7c-5823d8f042a8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.623604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.624271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.624555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.624855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] PATH_INFO: `/v3/users/8675dd84f41e4e04b6308f21271c9b9d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.626640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8675dd84f41e4e04b6308f21271c9b9d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.628615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.678678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8675dd84f41e4e04b6308f21271c9b9d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:47.679902 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:47.688782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8675dd84f41e4e04b6308f21271c9b9d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:47.701766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8675dd84f41e4e04b6308f21271c9b9d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:47.702499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8675dd84f41e4e04b6308f21271c9b9d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:47.703678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8675dd84f41e4e04b6308f21271c9b9d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:47.717514 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4324/8623] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:47 2022] DELETE /identity/v3/users/8675dd84f41e4e04b6308f21271c9b9d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:47.723154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.723517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.724037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.743183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:47.744375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:47.809454 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4300/8624] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:47.819846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:47.821274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:47.884085 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003cd5b-245f-4e31-a30d-e0e36c458f7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:47.887835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:47.888445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:47.888725 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:47.889001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:47.898520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:47.899956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:47.910379 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4325/8625] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:48.181603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:48.183016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:48.195318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e6ffe-8094-4926-b321-7d9b725edd4b None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:48.200033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:48.200672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:48.200959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:48.201236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] PATH_INFO: `/v3/projects/cd8eeecbe06948e084ed50652a1546bc` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:48.202799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8eeecbe06948e084ed50652a1546bc)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:48.205259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:48.253109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8eeecbe06948e084ed50652a1546bc', 'request_id': 'req-9848e479-f9f5-484e-b43b-0bae11d2ff58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.259533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8eeecbe06948e084ed50652a1546bc', 'request_id': 'req-9848e479-f9f5-484e-b43b-0bae11d2ff58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.265195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8eeecbe06948e084ed50652a1546bc', 'request_id': 'req-9848e479-f9f5-484e-b43b-0bae11d2ff58'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.278343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] The token cache is being invalidate because project cd8eeecbe06948e084ed50652a1546bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:48.278634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.279262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.281064 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4301/8626] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:48 2022] DELETE /identity/v3/projects/cd8eeecbe06948e084ed50652a1546bc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:48.285828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:48.295535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84b67-5711-4392-9641-304e67d7ef2b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:48.351344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:48.351969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:48.352247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:48.352519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] PATH_INFO: `/v3/users/1b24560686d241bfa8233f84daa9a624` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:48.353644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b24560686d241bfa8233f84daa9a624)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:48.355561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:48.407769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b24560686d241bfa8233f84daa9a624'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.414898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b24560686d241bfa8233f84daa9a624'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.425250 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:48.427580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b24560686d241bfa8233f84daa9a624'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.428543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b24560686d241bfa8233f84daa9a624'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.429814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5658893c-0101-4a47-834a-2a733201acfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b24560686d241bfa8233f84daa9a624'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.444336 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4326/8627] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:48 2022] DELETE /identity/v3/users/1b24560686d241bfa8233f84daa9a624 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:48.725041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:48.726583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:48.739889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e479-f9f5-484e-b43b-0bae11d2ff58 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:48.753069 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:48.801116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:48.801779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:48.802079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:48.802340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] PATH_INFO: `/v3/projects/cf2a44a71b104541a043968b5fa3fcb5` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:48.803447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2a44a71b104541a043968b5fa3fcb5)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:48.805352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:48.850660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2a44a71b104541a043968b5fa3fcb5', 'request_id': 'req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.856608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2a44a71b104541a043968b5fa3fcb5', 'request_id': 'req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.862291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2a44a71b104541a043968b5fa3fcb5', 'request_id': 'req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.874103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] The token cache is being invalidate because project cf2a44a71b104541a043968b5fa3fcb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:48.874391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.875561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3f57eb6e-7267-4f5e-ba53-4cbe704951a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:48.877137 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4302/8628] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:48 2022] DELETE /identity/v3/projects/cf2a44a71b104541a043968b5fa3fcb5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:48.882197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:48.882490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:48.882768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:48.902806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:48.904022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:48.963705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4327/8629] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:48.971561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:48.971852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:48.972125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:48.992197 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:48.993420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:49.002020 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4303/8630] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:49.007721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.017728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1431-25c0-4b13-852e-afe500189f2a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.022387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.022987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.023267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.023539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.024182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:47:49.024483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.026126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.038071 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4328/8631] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:47:49.042361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.052198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99da81d-5e89-4553-8f89-da5d003cf5aa None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.057156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.057783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.058059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.058328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.058979 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.060875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.089017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4304/8632] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:49.093317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.105766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cba26-2608-4563-b1cf-c3f128e6d785 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.166081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.166695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.166979 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.167672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.167874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.169873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.192595 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4329/8633] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:49.196582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.207794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798242d-bca0-4e3a-8420-0e6291b502c4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.212592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.213204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.213534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.213867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.214457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.216079 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.230117 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4305/8634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:49.234986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.246390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2881568-06cd-4ee9-b0ba-84fc878ddd6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.252844 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.253622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.253972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.254428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.255136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.256755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ec7cc-7dc7-4a6c-ad3b-08d463ff250a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.270017 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4330/8635] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:47:49.274264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.289349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4a2b-7924-4b93-825b-5ac83e8fb527 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.294300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.294962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.295243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.295515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] PATH_INFO: `/v3/projects/34d23abe8746412b8fa0c80d13849b69/users/4484c50589d741fa84fef95668977118/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.310730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d23abe8746412b8fa0c80d13849b69, user_id=4484c50589d741fa84fef95668977118, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.314187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.327097 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4306/8636] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:49 2022] PUT /identity/v3/projects/34d23abe8746412b8fa0c80d13849b69/users/4484c50589d741fa84fef95668977118/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:49.337957 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.338476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.338583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.368497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] MFA Rules not processed for user `4484c50589d741fa84fef95668977118`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:49.369747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:49.419546 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:49.445747 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4331/8637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:49.450391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.498323 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:49.516679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02d74-7204-4d22-a55f-9f89e1d60ae1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.521414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.522252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.522533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.522805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.523465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.525382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.556147 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4307/8638] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:49.557376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.568468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a0f77-56e4-4fcb-a66d-dcd1fe9aad96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.624619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.625486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.625783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.626057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.626680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.628594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.652083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4332/8639] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:47:49.653202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.664898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ca3e-a2e0-40fa-b17b-91b8207e5111 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.669945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.670545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.670828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.671103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.671826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.673978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.685025 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4308/8640] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:47:49.689050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.699879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711b25-60dc-4a26-bab0-c3a442d926fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.705592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.706295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.706612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.706895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] PATH_INFO: `/v3/projects/7667611562a942699a504deb51a7e3a2/users/67f6835454ea49a6b303e1bded958f8a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.723516 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7667611562a942699a504deb51a7e3a2, user_id=67f6835454ea49a6b303e1bded958f8a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.726260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.738867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4333/8641] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:49 2022] PUT /identity/v3/projects/7667611562a942699a504deb51a7e3a2/users/67f6835454ea49a6b303e1bded958f8a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:49.742941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.753009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a65cf-d29a-404b-a13e-179f537e0684 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.817385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.818027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.818312 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.818590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.819267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.820885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb3546-f5e1-404a-8bc5-4e9bae2502f6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.840371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4309/8642] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:49.841630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:49.852871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833a76-6958-4282-84d8-4fbb472ff9f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:49.857677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:49.858352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.858635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.858912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] PATH_INFO: `/v3/projects/7667611562a942699a504deb51a7e3a2/users/67f6835454ea49a6b303e1bded958f8a/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.861108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7667611562a942699a504deb51a7e3a2, user_id=67f6835454ea49a6b303e1bded958f8a, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:49.863806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:49.875232 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4334/8643] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:49 2022] PUT /identity/v3/projects/7667611562a942699a504deb51a7e3a2/users/67f6835454ea49a6b303e1bded958f8a/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:49.885533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:49.885822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:49.886100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:49.915811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] MFA Rules not processed for user `67f6835454ea49a6b303e1bded958f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:49.917058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:49.989078 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4310/8644] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:50.001678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.003458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:50.063721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcabf7-61a1-4428-b28f-75ed5ad545a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:50.067370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:50.067968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:50.068247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:50.068518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:50.077467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:50.079594 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:50.088942 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4335/8645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:50.401542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.411125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74932-ee74-4698-bf98-42b1e4f4b8ed None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:50.415807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67f6835454ea49a6b303e1bded958f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7667611562a942699a504deb51a7e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:50.416418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:50.416702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:50.416980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:50.417662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:47:50.417971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:50.419576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:50.432186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4311/8646] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:47:50.436670 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.446525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987738f-0160-4663-b01c-ac85b0e08c11 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:50.451165 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67f6835454ea49a6b303e1bded958f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7667611562a942699a504deb51a7e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:50.451762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:50.452047 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:50.452326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:50.453008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:50.454968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:50.481055 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4336/8647] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:50 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:50.485874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.495932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271defe6-47ea-4c31-9d50-ce6833ed8614 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:50.517313 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:50.558298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67f6835454ea49a6b303e1bded958f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7667611562a942699a504deb51a7e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:50.558908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:50.559193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:50.559490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:50.560313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:47:50.560630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:50.562515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:50.581017 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4312/8648] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 01:47:50.615203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.626512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3d6d-e844-4e74-b800-9be8ec37423f tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:50.631269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67f6835454ea49a6b303e1bded958f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7667611562a942699a504deb51a7e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:50.631902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:50.632218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:50.632498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] PATH_INFO: `/v3/projects/e7bc77fac1b445c18b9695d7b8bb6aa0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:50.633674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e7bc77fac1b445c18b9695d7b8bb6aa0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:50.635597 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:50.646700 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:50.683915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bc77fac1b445c18b9695d7b8bb6aa0', 'request_id': 'req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:50.691598 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bc77fac1b445c18b9695d7b8bb6aa0', 'request_id': 'req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:50.697374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bc77fac1b445c18b9695d7b8bb6aa0', 'request_id': 'req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:50.709669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] The token cache is being invalidate because project e7bc77fac1b445c18b9695d7b8bb6aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:50.709968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:50.710613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d8ce99-cd68-460d-aa56-d28c1c9bc9df tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:50.712123 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4337/8649] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:50 2022] DELETE /identity/v3/projects/e7bc77fac1b445c18b9695d7b8bb6aa0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:50.908410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:50.910262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:50.974952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9227a-9d90-43d3-825f-a794cb0dff10 tempest-VolumeQuotaClassesTest-769213563 tempest-VolumeQuotaClassesTest-769213563-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:51.035283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:51.035921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:51.036201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:51.036474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] PATH_INFO: `/v3/users/4484c50589d741fa84fef95668977118` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:51.037656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4484c50589d741fa84fef95668977118)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:51.039610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:51.087957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4484c50589d741fa84fef95668977118'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.088614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4484c50589d741fa84fef95668977118'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.096346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4484c50589d741fa84fef95668977118'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.104365 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:51.109842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4484c50589d741fa84fef95668977118'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.110769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4484c50589d741fa84fef95668977118'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.125271 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4313/8650] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:50 2022] DELETE /identity/v3/users/4484c50589d741fa84fef95668977118 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:51.130125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60514-773a-4418-958c-d95651c31c56 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:51.130420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60514-773a-4418-958c-d95651c31c56 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:51.130699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60514-773a-4418-958c-d95651c31c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:51.150211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51b60514-773a-4418-958c-d95651c31c56 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:51.151408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51b60514-773a-4418-958c-d95651c31c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:51.214024 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4338/8651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:51.224914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:51.226463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:51.289303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899308f-444d-447f-b1a2-a0b9a73fca53 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:51.293078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:51.293720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:51.294029 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:51.294308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:51.304601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:51.306096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:51.316733 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4314/8652] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:51.618235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60514-773a-4418-958c-d95651c31c56 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:51.619759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51b60514-773a-4418-958c-d95651c31c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:51.633569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60514-773a-4418-958c-d95651c31c56 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:51.641336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:51.642666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:51.643022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:51.643421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] PATH_INFO: `/v3/projects/34d23abe8746412b8fa0c80d13849b69` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:51.644734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d23abe8746412b8fa0c80d13849b69)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:51.646880 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:51.697837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d23abe8746412b8fa0c80d13849b69', 'request_id': 'req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.705101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d23abe8746412b8fa0c80d13849b69', 'request_id': 'req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.711201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d23abe8746412b8fa0c80d13849b69', 'request_id': 'req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.725812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] The token cache is being invalidate because project 34d23abe8746412b8fa0c80d13849b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:51.726104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.726898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.728588 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4339/8653] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:51 2022] DELETE /identity/v3/projects/34d23abe8746412b8fa0c80d13849b69 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:51.732557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:51.742976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b059-f14a-4a5e-9f23-c8f230ca4262 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:51.806096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:51.806818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:51.807166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:51.807498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] PATH_INFO: `/v3/users/67f6835454ea49a6b303e1bded958f8a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:51.809088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f6835454ea49a6b303e1bded958f8a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:51.811586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:51.866251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f6835454ea49a6b303e1bded958f8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.867058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f6835454ea49a6b303e1bded958f8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.875313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f6835454ea49a6b303e1bded958f8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.888520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f6835454ea49a6b303e1bded958f8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.889253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-08519bc0-db87-43c2-92b2-56d6b7dfe680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f6835454ea49a6b303e1bded958f8a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:51.903143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4315/8654] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:47:51 2022] DELETE /identity/v3/users/67f6835454ea49a6b303e1bded958f8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:52.184436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.185941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:52.215920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a4b1-b6a6-4c3f-8601-ed1ab8ad83bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.235563 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:52.286756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.286986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.287267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.287536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] PATH_INFO: `/v3/projects/7667611562a942699a504deb51a7e3a2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.288663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7667611562a942699a504deb51a7e3a2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.291034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.339799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7667611562a942699a504deb51a7e3a2', 'request_id': 'req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:52.346334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7667611562a942699a504deb51a7e3a2', 'request_id': 'req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:52.352400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7667611562a942699a504deb51a7e3a2', 'request_id': 'req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:52.365535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] The token cache is being invalidate because project 7667611562a942699a504deb51a7e3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:47:52.365832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:52.366465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7cc5a160-9af0-4b16-90ae-8ddc089d21dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:47:52.368025 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4340/8655] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:47:52 2022] DELETE /identity/v3/projects/7667611562a942699a504deb51a7e3a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:52.372939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.373485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.373591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.387768 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:52.395596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:52.397681 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:52.463888 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4316/8656] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:52.473166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.473563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.473863 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.500403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:52.501789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:52.511319 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4341/8657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:52.515255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.525770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8924906-9cc6-4f8d-9dd2-a132b6db77c6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.530882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.532294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.532641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.533030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.533787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:47:52.534170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.535849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.549669 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4317/8658] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:47:52.554089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.564528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd222c0-8e19-4ca6-af9f-02acaf023099 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.569468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.570079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.570355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.570625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.571307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.573217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.601704 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4342/8659] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:52.606325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.618688 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72fdf-dfa0-4e74-b69c-0149974828fd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.678371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.678982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.679262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.679534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.680171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.682135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.704856 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4318/8660] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:52.708912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.720980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6b91-7584-4b52-8c96-b4d57c880e06 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.725866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.726575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.726926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.727266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.727982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.729688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.741117 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4343/8661] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:52.745268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.756030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd9c0-1ba3-47c2-832a-c6df17d611bd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.761698 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.762303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.762580 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.762852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.763495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.765103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602e8ef-bb24-4a0f-99c9-c1a6997e32d2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.780022 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4319/8662] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:47:52.781268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:52.791850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1cd-e05a-41ab-8294-16006fb411d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:52.797687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:52.798571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.798853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.799127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] PATH_INFO: `/v3/projects/6f275b0f2bd44e979fec87a910688116/users/6a6d3e9636034cc382e5e470c16e7aee/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.823582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f275b0f2bd44e979fec87a910688116, user_id=6a6d3e9636034cc382e5e470c16e7aee, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:52.826436 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:52.841539 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4344/8663] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:52 2022] PUT /identity/v3/projects/6f275b0f2bd44e979fec87a910688116/users/6a6d3e9636034cc382e5e470c16e7aee/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:52.852757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:52.853043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:52.853315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:52.885470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] MFA Rules not processed for user `6a6d3e9636034cc382e5e470c16e7aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:52.886749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:52.957585 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4320/8664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:47:52.962215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.014232 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:53.030232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea37-6a1b-41fe-ad03-de34fdc144d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.037558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.038180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.038457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.038727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.039371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.041426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.070823 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4345/8665] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:47:52 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:47:53.074911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.080990 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:53.088366 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e952d-3abb-4734-83ef-eb84eeb9f4e8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.148451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.149076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.149359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.149669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.150311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.152248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.181712 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4321/8666] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:47:53 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:47:53.182592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.194036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c8f6-d56b-480f-9c66-9fd8fff496d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.199454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.200091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.200375 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.200649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.201314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.203333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.217578 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4346/8667] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:47:53.222535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.233473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c625e2-0bcc-4d24-8e7c-2e17815e5894 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.239404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.240182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.240536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.240878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] PATH_INFO: `/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7/users/53eaccc616d0402c9ce2d05d423f0d1e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.261054 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26f3d69f28e47e38d9cbe6063465bb7, user_id=53eaccc616d0402c9ce2d05d423f0d1e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.264004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.295564 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4322/8668] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:53 2022] PUT /identity/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7/users/53eaccc616d0402c9ce2d05d423f0d1e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:47:53.301001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.312519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6702e-86e8-4cac-a5f2-12e985680079 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.383403 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.386390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.386390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.386390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.386390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.387342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.401705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4347/8669] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:47:53.402912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.414576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e641c-3e08-4a47-8522-f8298f6e46a3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.419807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.420478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.421021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.421304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] PATH_INFO: `/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7/users/53eaccc616d0402c9ce2d05d423f0d1e/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.424535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26f3d69f28e47e38d9cbe6063465bb7, user_id=53eaccc616d0402c9ce2d05d423f0d1e, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.427318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f80cc-c16c-42dc-abee-cff30a30a647 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.440558 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4323/8670] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:47:53 2022] PUT /identity/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7/users/53eaccc616d0402c9ce2d05d423f0d1e/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:47:53.445708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.447506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:53.450770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.451058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.451604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.487552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] MFA Rules not processed for user `53eaccc616d0402c9ce2d05d423f0d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:47:53.488892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:53.519820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee50e-51c3-47f3-b42b-9f1161400fe6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.574873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.575570 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.579913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.579913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.580186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4324/8671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:47:53.580301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:53.588027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:53.590493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:53.594777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.596792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.609167 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4348/8672] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:47:53.645044 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:53.665529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032608-58c1-4289-b9f1-a5425fcd75d6 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:53.669710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:53.670326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:53.670605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:53.671033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:53.739687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:53.741383 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:53.751612 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4325/8673] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:47:58.056884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:47:58.058311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:47:58.073194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e435ea9-9351-4179-b569-d032a2ec0931 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:47:58.078411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:47:58.079011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:47:58.079843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:47:58.080260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:47:58.089307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:47:58.090774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af5880-903b-4d44-ad36-89162e6fe622 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:47:58.101143 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4349/8674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:47:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:03.746802 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=30 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:06.212041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:06.276397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5368a-4cc3-4e02-b0c3-d9d9b74c7724 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:06.281220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:06.281882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:06.282171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:06.282445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] PATH_INFO: `/v3/users/6a6d3e9636034cc382e5e470c16e7aee` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:06.283596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6d3e9636034cc382e5e470c16e7aee)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:06.285578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:06.341432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6d3e9636034cc382e5e470c16e7aee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.342118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6d3e9636034cc382e5e470c16e7aee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.349605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6d3e9636034cc382e5e470c16e7aee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.364341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6d3e9636034cc382e5e470c16e7aee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.365074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6d3e9636034cc382e5e470c16e7aee'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.380059 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4326/8675] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:48:06 2022] DELETE /identity/v3/users/6a6d3e9636034cc382e5e470c16e7aee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:06.385518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:06.385518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:06.386148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:06.397643 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:06.411571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:06.412857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:06.473766 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4350/8676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:48:06.483578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:06.485042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:06.553901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3c15-5dc4-445a-9a51-1ce6146371c3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:06.557759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:06.558374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:06.558655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:06.558923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:06.569257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:06.570758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:06.581497 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4327/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:06.871217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:06.872782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:06.886954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2af94-1359-4ecf-ba20-a96797c90157 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:06.893504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:06.894179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:06.894466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:06.894738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] PATH_INFO: `/v3/projects/6f275b0f2bd44e979fec87a910688116` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:06.895890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f275b0f2bd44e979fec87a910688116)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:06.897912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:06.946958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f275b0f2bd44e979fec87a910688116', 'request_id': 'req-f8f89c69-5273-45ee-b11e-fe450cd2482e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.953229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f275b0f2bd44e979fec87a910688116', 'request_id': 'req-f8f89c69-5273-45ee-b11e-fe450cd2482e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.959913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f275b0f2bd44e979fec87a910688116', 'request_id': 'req-f8f89c69-5273-45ee-b11e-fe450cd2482e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.974162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] The token cache is being invalidate because project 6f275b0f2bd44e979fec87a910688116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:48:06.974454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.975249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:06.976751 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4351/8678] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:48:06 2022] DELETE /identity/v3/projects/6f275b0f2bd44e979fec87a910688116 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:06.981019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:06.991412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db346e-56ee-40b2-9883-fc503d4206c9 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.009739 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:07.053543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.054186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.054509 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.054783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] PATH_INFO: `/v3/users/53eaccc616d0402c9ce2d05d423f0d1e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.056007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53eaccc616d0402c9ce2d05d423f0d1e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.058385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.105593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53eaccc616d0402c9ce2d05d423f0d1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.106272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53eaccc616d0402c9ce2d05d423f0d1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.114130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53eaccc616d0402c9ce2d05d423f0d1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.126857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53eaccc616d0402c9ce2d05d423f0d1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.127671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-55d7a008-8d34-47bb-92a1-9baf2dd37e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53eaccc616d0402c9ce2d05d423f0d1e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.143929 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4328/8679] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:48:06 2022] DELETE /identity/v3/users/53eaccc616d0402c9ce2d05d423f0d1e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:07.445665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.447378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:07.462279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89c69-5273-45ee-b11e-fe450cd2482e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.526388 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.527031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.527315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.527593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] PATH_INFO: `/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.528746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26f3d69f28e47e38d9cbe6063465bb7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.530966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.566932 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:07.581040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26f3d69f28e47e38d9cbe6063465bb7', 'request_id': 'req-69605961-eb2b-4ed7-9e63-415fc18061c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.587352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26f3d69f28e47e38d9cbe6063465bb7', 'request_id': 'req-69605961-eb2b-4ed7-9e63-415fc18061c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.593113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26f3d69f28e47e38d9cbe6063465bb7', 'request_id': 'req-69605961-eb2b-4ed7-9e63-415fc18061c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.608292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] The token cache is being invalidate because project d26f3d69f28e47e38d9cbe6063465bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:48:07.608713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.609460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69605961-eb2b-4ed7-9e63-415fc18061c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:07.611814 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4352/8680] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:48:07 2022] DELETE /identity/v3/projects/d26f3d69f28e47e38d9cbe6063465bb7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:07.617622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.618295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.618295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.638004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:07.639223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:07.702056 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4329/8681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:07.710940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.711228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.711508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.732119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:07.733336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:07.741394 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4353/8682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:07.745702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.756028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096a72-7d85-406f-add1-c07d6656fd60 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.760596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.761189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.761501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.761774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.762419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:48:07.762718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.764323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.776294 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4330/8683] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:48:07.780824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.791187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a003c-b265-43c0-b3c7-e33e5ce505b5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.796391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.797012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.797297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.797615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.798352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.800289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.830313 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4354/8684] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:48:07 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:07.833828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.843759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eed43-177f-4228-b5fc-10f21cda8beb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.870635 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:07.903927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.904530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.905065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.905337 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.906026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.908780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.929825 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4331/8685] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:48:07 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:07.933834 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.944262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d1d9-9ef3-487e-8961-1163886075da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.948914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.949529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.949813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.950194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.950833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.952435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.962939 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4355/8686] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:07.966818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:07.977598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5681db-fb8c-4f79-878f-a862ce70ee8e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:07.982285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:07.982877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:07.983160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:07.983435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:07.984119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:07.986013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196866c3-01d3-4502-b92e-972dc81e5e0d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:07.996688 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4332/8687] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:08.000663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:08.010755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441b4d-fce3-4884-83cc-7210c6fbc0c0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:08.015567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:08.016217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.017039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.017314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] PATH_INFO: `/v3/projects/81de51c78904491898c5b04edbedb72b/users/204b4f6e3da441e99fb0d7b08bd7dddf/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.032933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=81de51c78904491898c5b04edbedb72b, user_id=204b4f6e3da441e99fb0d7b08bd7dddf, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:08.035534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:08.048032 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4356/8688] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:07 2022] PUT /identity/v3/projects/81de51c78904491898c5b04edbedb72b/users/204b4f6e3da441e99fb0d7b08bd7dddf/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:08.059072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898318-9098-4218-aeed-5690c67c419a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.059385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898318-9098-4218-aeed-5690c67c419a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.059659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898318-9098-4218-aeed-5690c67c419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.088637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9d898318-9098-4218-aeed-5690c67c419a None None] MFA Rules not processed for user `204b4f6e3da441e99fb0d7b08bd7dddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:08.089883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d898318-9098-4218-aeed-5690c67c419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:08.154189 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4333/8689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:08.165796 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:08.167511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:08.227523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571035-18dc-4579-b134-a68e6475dfaf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:08.231236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:08.231842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.232124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.232400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.240751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:08.242216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401b65-fe4b-412e-ad30-bf2c035ce5af service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:08.251470 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4357/8690] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:08.273971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898318-9098-4218-aeed-5690c67c419a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:08.336936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898318-9098-4218-aeed-5690c67c419a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:08.341458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:08.342077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.342355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.342621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] PATH_INFO: `/v3/users/204b4f6e3da441e99fb0d7b08bd7dddf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.343807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=204b4f6e3da441e99fb0d7b08bd7dddf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:08.346244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:08.387455 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:08.395321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204b4f6e3da441e99fb0d7b08bd7dddf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.396328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204b4f6e3da441e99fb0d7b08bd7dddf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.403736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204b4f6e3da441e99fb0d7b08bd7dddf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.416895 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204b4f6e3da441e99fb0d7b08bd7dddf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.417641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204b4f6e3da441e99fb0d7b08bd7dddf'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.431120 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4334/8691] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:48:08 2022] DELETE /identity/v3/users/204b4f6e3da441e99fb0d7b08bd7dddf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:08.435750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.436038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.436313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.456143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:08.457354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:08.509603 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:08.521045 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4358/8692] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:08.531193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:08.533155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:08.597763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de87ed-90fe-4517-972f-f618c5bb7fac admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:08.601298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:08.601938 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.602220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.602495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.612409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:08.613882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eccc81-f8c8-40d5-b1aa-fb8f74386d3c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:08.623633 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4335/8693] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:08.896006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:08.897593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:08.915449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665efb3-e448-406d-8c75-d2fb652b08f7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:08.921861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:08.922424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:08.923418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:08.923738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] PATH_INFO: `/v3/projects/81de51c78904491898c5b04edbedb72b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:08.924945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81de51c78904491898c5b04edbedb72b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:08.926890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:08.976625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81de51c78904491898c5b04edbedb72b', 'request_id': 'req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.982807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81de51c78904491898c5b04edbedb72b', 'request_id': 'req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:08.989235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81de51c78904491898c5b04edbedb72b', 'request_id': 'req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:09.001812 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] The token cache is being invalidate because project 81de51c78904491898c5b04edbedb72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:48:09.002109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:09.002750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-99db9be7-1604-4f15-a167-c2f2ee6a4b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:09.004274 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4359/8694] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:48:08 2022] DELETE /identity/v3/projects/81de51c78904491898c5b04edbedb72b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:09.009539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.009835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.010108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.029308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:09.030815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:09.090002 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4336/8695] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:09.099346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.099637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.099944 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.121180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:09.122428 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:09.131566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4360/8696] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:09.135982 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.146470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f996d1-f10e-4b4e-acb1-c1ffca856738 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.150993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.151588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.151890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.152161 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.152802 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:48:09.153099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.154995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.166921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4337/8697] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:48:09.171007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.180824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324e7e-9cbf-403f-89f4-4769b4d56711 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.185545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.186139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.186421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.186692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.187327 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.189873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.216468 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4361/8698] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:48:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:09.220855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.230855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045894-0e84-454d-91fc-0eeb5ada944c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.275297 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:09.290099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.290701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.290984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.291260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.291886 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.293862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.316488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4338/8699] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:48:09 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:48:09.320744 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.331211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5eee9-e5af-46e7-9a99-6b9bc4365dc3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.335876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.336484 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.336763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.337034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.337696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.339292 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.349884 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4362/8700] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:09.353736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.364414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667845c-9c3c-457a-9094-9ca62fdce9a9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.369229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.369853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.370139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.370416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.371056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.372654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5d5b-2e54-4791-8469-b04e9630d01d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.384142 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4339/8701] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:09.390755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.401235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76716a8c-b1cb-47c0-bb9a-64412b68227e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.405989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.406628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.406906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.407342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] PATH_INFO: `/v3/projects/236c864738564db79f8f4eb498394ae6/users/8934eaf56a804f7bbe5e365f67f038fe/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.424195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236c864738564db79f8f4eb498394ae6, user_id=8934eaf56a804f7bbe5e365f67f038fe, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.426938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.440788 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4363/8702] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:09 2022] PUT /identity/v3/projects/236c864738564db79f8f4eb498394ae6/users/8934eaf56a804f7bbe5e365f67f038fe/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:09.451321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.451612 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.451890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.479574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] MFA Rules not processed for user `8934eaf56a804f7bbe5e365f67f038fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:09.481174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:09.551281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4340/8703] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:09.562714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:09.564922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:09.624507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20128-c686-4939-a042-87d72edf0af2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:09.628298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:09.628905 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:09.629187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:09.629493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:09.637846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:09.639282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce31fa-420d-4ff8-83c3-bb1cf5b60977 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:09.648321 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4364/8704] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:18.175991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:18.239862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72b3b-fc97-40a9-8042-4bf728ebb2a8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:18.244459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:18.245088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:18.245365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:18.245669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] PATH_INFO: `/v3/users/8934eaf56a804f7bbe5e365f67f038fe` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:18.246800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8934eaf56a804f7bbe5e365f67f038fe)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:18.248736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:18.300008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8934eaf56a804f7bbe5e365f67f038fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.300677 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8934eaf56a804f7bbe5e365f67f038fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.307759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8934eaf56a804f7bbe5e365f67f038fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.308950 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:18.323021 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8934eaf56a804f7bbe5e365f67f038fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.323652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8934eaf56a804f7bbe5e365f67f038fe'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.337259 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4341/8705] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:48:18 2022] DELETE /identity/v3/users/8934eaf56a804f7bbe5e365f67f038fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:18.341963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:18.342429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:18.342580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:18.362806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:18.364010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:18.377285 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:18.426880 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4365/8706] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:48:18.436669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:18.439073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:18.508986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1b96-a263-4351-afab-430fcfbfc77d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:18.512853 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:18.513491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:18.513811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:18.514082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:18.523739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:18.525187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fe64-7e27-4cdd-8b3f-91e514b7e63d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:18.536398 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4342/8707] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:18.815898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:18.817946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:18.841354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b476586-4014-41c6-be83-bf11cfd5f31d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:18.847111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:18.847764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:18.848046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:18.848320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] PATH_INFO: `/v3/projects/236c864738564db79f8f4eb498394ae6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:18.849663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236c864738564db79f8f4eb498394ae6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:18.851596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:18.907286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236c864738564db79f8f4eb498394ae6', 'request_id': 'req-dd5e8276-3fab-47f5-998b-b212ad995107'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.915379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236c864738564db79f8f4eb498394ae6', 'request_id': 'req-dd5e8276-3fab-47f5-998b-b212ad995107'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.922118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236c864738564db79f8f4eb498394ae6', 'request_id': 'req-dd5e8276-3fab-47f5-998b-b212ad995107'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.935315 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] The token cache is being invalidate because project 236c864738564db79f8f4eb498394ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:48:18.935610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.936234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-dd5e8276-3fab-47f5-998b-b212ad995107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:18.937948 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4366/8708] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:48:18 2022] DELETE /identity/v3/projects/236c864738564db79f8f4eb498394ae6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:18.943641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:18.943931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:18.944208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:18.964581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:18.965822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:19.028213 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4343/8709] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:48:19.036896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.037200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.037633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.058455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:19.059766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:19.068598 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4367/8710] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:48:19.072943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.083003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129a79-ed59-4b38-8850-8619a7072658 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.087711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.088315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.088597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.088873 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.089558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:48:19.089870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.091487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.103305 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4344/8711] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:48:19.107694 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.117912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b484d9-46d4-419d-a215-c162ba218963 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.123100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.123910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.124200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.124477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.125128 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.127669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.155938 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4368/8712] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:48:19 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:19.160468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.170473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699f4e8-1488-432c-bda5-53bc280f1629 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.231263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.231987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.232211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.232490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.233127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.235656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.246162 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:19.261125 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4345/8713] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:48:19 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:19.265152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.277038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f17d-a9c7-44ef-a296-fab168b93af5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.283195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.283811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.284093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.284367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.285020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.286666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.296990 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4369/8714] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:19.301578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.311839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80671a2-f2e3-4d98-ad86-5ecedb37ae16 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.317149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.317796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.318082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.318357 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.319003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.320696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c00896-e750-4dc3-87b6-cdcc4b0aa5ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.333257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4346/8715] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:19.337541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.350726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045aec4-4a67-4624-a8cf-08ccbf80d3be admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.356083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.356761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.357046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.357323 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] PATH_INFO: `/v3/projects/9c9c5dc3b0094503b630cefa055f1253/users/c62f16d2fdbe44aaab1d7c957c28198a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.373628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9c5dc3b0094503b630cefa055f1253, user_id=c62f16d2fdbe44aaab1d7c957c28198a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.377104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.397429 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4370/8716] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:19 2022] PUT /identity/v3/projects/9c9c5dc3b0094503b630cefa055f1253/users/c62f16d2fdbe44aaab1d7c957c28198a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:19.408946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.409206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.409515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.439626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] MFA Rules not processed for user `c62f16d2fdbe44aaab1d7c957c28198a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:19.440851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:19.508895 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4347/8717] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:19.520404 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:19.522164 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:19.566459 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:19.584361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7f514-6864-4a04-81ee-31764bc0f5ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:19.588186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:19.588825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:19.589106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:19.589380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:19.599033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:19.600500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96610875-7c6f-40d6-bbe8-bf9affe9c5f5 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:19.609276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4371/8718] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:23.234030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:23.299704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803645db-1fdc-46ec-b24b-4503fcbde833 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:23.304700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:23.305326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:23.305627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:23.305897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] PATH_INFO: `/v3/users/c62f16d2fdbe44aaab1d7c957c28198a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:23.307006 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62f16d2fdbe44aaab1d7c957c28198a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:23.308954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:23.357375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62f16d2fdbe44aaab1d7c957c28198a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.358068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62f16d2fdbe44aaab1d7c957c28198a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.365697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62f16d2fdbe44aaab1d7c957c28198a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.377765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62f16d2fdbe44aaab1d7c957c28198a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.378460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62f16d2fdbe44aaab1d7c957c28198a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.380120 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:23.399451 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4348/8719] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:48:23 2022] DELETE /identity/v3/users/c62f16d2fdbe44aaab1d7c957c28198a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:23.404362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:23.405077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:23.405199 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:23.426974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:23.428198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:23.492268 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4372/8720] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:23.502483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:23.503915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:23.568567 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36306d4-69d9-43e3-a9eb-fe7e96a0fa8c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:23.572402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:23.572984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:23.573268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:23.573597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:23.584373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:23.585975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f60c-a72f-4d33-9810-4bed494a3964 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:23.597815 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4349/8721] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:23.879229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:23.880987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:23.895773 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e800-81c8-46b6-b1d2-70025761c468 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:23.903463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:23.905342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:23.905662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:23.906296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] PATH_INFO: `/v3/projects/9c9c5dc3b0094503b630cefa055f1253` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:23.908124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9c5dc3b0094503b630cefa055f1253)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:23.910574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:23.967034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9c5dc3b0094503b630cefa055f1253', 'request_id': 'req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.974064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9c5dc3b0094503b630cefa055f1253', 'request_id': 'req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:23.979742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9c5dc3b0094503b630cefa055f1253', 'request_id': 'req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:24.007296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] The token cache is being invalidate because project 9c9c5dc3b0094503b630cefa055f1253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:48:24.007735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:24.008445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc85f02a-0ccd-4497-9e23-5f97a6b2c37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:48:24.010225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4373/8722] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:48:23 2022] DELETE /identity/v3/projects/9c9c5dc3b0094503b630cefa055f1253 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:24.016834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.017297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.017630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.038619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:24.040435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:24.100811 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4350/8723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:24.108970 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.109264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.109592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.131261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:24.132632 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:24.140635 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4374/8724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:24.145897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.156352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582489e-a253-40ef-8257-360e43fdc2c7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.161000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.161624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.161940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.162206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.162847 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:48:24.163148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.164785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.176899 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4351/8725] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:48:24.181382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.191868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3dd76-232e-4d16-8d36-9cdb46fd2491 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.197663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.198295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.198716 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.198995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.199651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.201935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.231418 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4375/8726] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:24.236306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.246970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71d96-b600-43e9-b166-8f8fab1dc7d2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.314150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.314804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.315083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.315360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.315981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.318227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.341426 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4352/8727] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:48:24.345607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.356935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcdbee-c838-4131-96db-c2c9b32d45fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.362862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.363637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.364044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.364331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.365061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.366917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.378415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4376/8728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:24.382676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.394081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2a67-8b0c-4a55-a59e-7edbad123eb3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.398984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.399619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.399901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.400175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.400814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.402471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404135b-5c1f-437b-9131-62be25a61dd9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.408128 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:24.414379 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4353/8729] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:48:24.418521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.430210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba510b2-22a7-48fe-823c-9be17d228eb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.435217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.435964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.436250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.436609 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] PATH_INFO: `/v3/projects/2935e753a36e4a25b0362b13a4c12ebf/users/7d3b3eec24d94748b8b55a52a0e3e422/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.454732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2935e753a36e4a25b0362b13a4c12ebf, user_id=7d3b3eec24d94748b8b55a52a0e3e422, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.457544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.470623 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4377/8730] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:24 2022] PUT /identity/v3/projects/2935e753a36e4a25b0362b13a4c12ebf/users/7d3b3eec24d94748b8b55a52a0e3e422/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:48:24.482327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.482621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.482897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.512226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] MFA Rules not processed for user `7d3b3eec24d94748b8b55a52a0e3e422`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:24.513656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:24.580799 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4354/8731] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:24.585600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.590387 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:24.651078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593b3c5-900e-45c2-81f7-0547f29b68d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.656208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.657683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.657967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.658308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.658860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.660761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.687531 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4378/8732] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:24.691753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.702741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8401e-a743-4e4f-98a2-338daf7d23b8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.764326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.764857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.765137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.765609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.766794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.769003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.792616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4355/8733] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:48:24 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:48:24.796620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.807897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c8e7-a09f-4bbd-9499-8f444ad23b7a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.812886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.813946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.814490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.814906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.815555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.817136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.828094 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4379/8734] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:24.832749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.843292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8c8c-548c-4501-80ba-8be1452614b3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.849216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.849924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.850341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.850621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] PATH_INFO: `/v3/projects/6768fcf2a21b47309da69f215ec784f6/users/2f2384bc2c52453d9bd0ce9d5f1754c1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.866990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6768fcf2a21b47309da69f215ec784f6, user_id=2f2384bc2c52453d9bd0ce9d5f1754c1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.869778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.884373 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4356/8735] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:24 2022] PUT /identity/v3/projects/6768fcf2a21b47309da69f215ec784f6/users/2f2384bc2c52453d9bd0ce9d5f1754c1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:48:24.888646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.900567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dfb6b-3e0a-48d2-8de8-648ab47adc0b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:24.965235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:24.965876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:24.966156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:24.966568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:24.967227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:24.968821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851408ce-4424-45c7-8e16-b8d32d811af4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:24.979909 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4380/8736] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:48:24.984442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:24.995391 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f491-b983-4271-af8e-daaa30805a6c admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:25.000764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:25.001472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:25.001740 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:25.002015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] PATH_INFO: `/v3/projects/6768fcf2a21b47309da69f215ec784f6/users/2f2384bc2c52453d9bd0ce9d5f1754c1/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:25.004168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6768fcf2a21b47309da69f215ec784f6, user_id=2f2384bc2c52453d9bd0ce9d5f1754c1, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:25.007557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:25.020050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4357/8737] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:48:24 2022] PUT /identity/v3/projects/6768fcf2a21b47309da69f215ec784f6/users/2f2384bc2c52453d9bd0ce9d5f1754c1/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:48:25.030504 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5fbad-5e9b-448a-83fc-7bc16b4b1169 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:25.030919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5fbad-5e9b-448a-83fc-7bc16b4b1169 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:25.031993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5fbad-5e9b-448a-83fc-7bc16b4b1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:25.062280 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c7d5fbad-5e9b-448a-83fc-7bc16b4b1169 None None] MFA Rules not processed for user `2f2384bc2c52453d9bd0ce9d5f1754c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:25.063813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7d5fbad-5e9b-448a-83fc-7bc16b4b1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:25.132606 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:25.139916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4381/8738] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:25.157614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:25.159638 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:25.212668 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:25.245554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740edc06-49f7-438e-9277-f028913128a7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:25.252892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:25.254035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:25.254349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:25.254798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:25.318955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:25.320533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:25.330974 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4358/8739] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:29.216322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e34ab-ce3b-4e55-916b-349b7e837571 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:29.216848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e34ab-ce3b-4e55-916b-349b7e837571 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:29.216965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e34ab-ce3b-4e55-916b-349b7e837571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:29.257296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3a1e34ab-ce3b-4e55-916b-349b7e837571 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:29.258560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a1e34ab-ce3b-4e55-916b-349b7e837571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:29.311681 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4382/8740] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 25 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:29.318246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:29.327707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa0ec-b2a1-4298-945a-c06c47f85f56 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:29.332373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:29.332927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:29.333341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:29.333662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:29.343256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:29.344759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:29.354204 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4359/8741] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:32.441095 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:32.441689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:32.441689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:32.465328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] MFA Rules not processed for user `7d3b3eec24d94748b8b55a52a0e3e422`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:48:32.466704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:32.475670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4383/8742] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:48:33.250654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:33.252289 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:33.347504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd768ff-8070-427f-a7df-4b9611e30161 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:33.352706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:33.353334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:33.353675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:33.353925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:33.356243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:33.371365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:33.373276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6399-12df-4c10-ad08-7192ba8c2072 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:33.393547 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4360/8743] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:41.635790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:48:41.637915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:41.658555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd770-2562-4b9f-aa35-a97dfb8edce7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:48:41.664162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:48:41.664774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:48:41.665059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:48:41.665330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:48:41.667090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:48:41.682066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:48:41.683677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:48:41.697574 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4384/8744] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:48:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:48:43.379997 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=75 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:51.692095 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=39 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:20.724056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:20.724671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:20.724671 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:20.763300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:49:20.764501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:20.791179 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4361/8745] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 25 01:49:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:49:20.797062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:20.815502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634d3d-16f4-46a2-ac72-30e05e3f8d3b service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:20.819317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:20.820439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:20.820794 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:20.821264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:20.823161 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:20.835382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:20.837764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:20.847969 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4385/8746] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:20.877182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:20.914837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de456e7-3504-4e8c-b1a7-77e1b3ac7931 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:20.919919 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:20.920521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:20.920804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:20.921078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:20.922823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:20.936708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:20.938343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ea6ef-ca22-460a-80a2-887343275014 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:20.951340 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4362/8747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:21.105177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:21.113611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ca84-ac7c-4ac3-8202-0b868a915d57 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:21.117729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:21.118339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.118619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.118888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.120621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:21.134336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:21.135816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:21.146664 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4386/8748] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:21.229720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.230013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.230288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.268221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:49:21.269444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:21.278753 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4363/8749] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:49:21.290828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:21.292192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:21.310612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a2a2-dbd6-4241-8edd-33722c3bc1fa service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:21.315591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:21.316181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.316463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.316737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.325644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:21.327219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fad64-23db-4046-a7b6-5edc6040f6f1 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:21.337092 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4387/8750] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:21.512753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:21.522022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8025-845b-4dc6-96dc-afa66c872326 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:21.525763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:21.526359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.526639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.526912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.528616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:21.545300 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:21.546758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:21.561518 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4364/8751] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:21.606762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.607053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.607338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.627649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:49:21.628919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:21.637693 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4388/8752] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:49:21.649624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:21.664298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31023ddc-b9b3-463f-b18b-0e7851286f67 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:21.669423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:21.670018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:21.670302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:21.670576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:21.678855 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:21.681258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e8049-3a24-40ba-b94d-4f2445ed167f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:21.691232 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4365/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:31.622729 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=26 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:31.687144 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=56 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:48.682083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:48.697295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75cd2-ae4a-41ec-ad14-07dbe34695ee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:48.702828 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:48.703424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:48.703703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:48.703973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:48.705703 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:48.773876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:48.775491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d96d96-b157-4f52-b093-bd37d001a1fe service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:48.785591 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4389/8754] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:49:56.923657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:56.924183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:56.924183 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:56.944151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:49:56.945780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:56.953282 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4366/8755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:49:57.704687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:57.705205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:57.705474 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:57.726449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:49:57.727772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:49:57.736530 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4390/8756] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:49:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:49:57.748697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:49:57.764227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c0ff-b34c-4972-87f4-49e7e33f50a2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:49:57.769293 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:49:57.769924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:49:57.770200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:49:57.770466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:49:57.778822 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:49:57.780646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:49:57.790668 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4367/8757] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:07.720489 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=31 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:07.786111 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:16.059746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:16.069009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b284-9af7-48c7-9518-32d640c19b2e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:16.073089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:16.073714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:16.073999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:16.074267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:16.076013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:16.140731 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:16.142233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:16.161235 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4391/8758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:18.717328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:18.742235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd032-c49a-4183-8752-6f84d68a40e5 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:18.748242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:18.749003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:18.749473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:18.749713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:18.751732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:18.825652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:18.827302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:18.838080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4368/8759] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:50:19.233669 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:19.249883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912649cd-5225-4ea5-a563-8d540a784f8c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:19.255561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:19.256181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:19.256462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:19.256787 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:19.259021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:19.289611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:19.291349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:19.306333 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4392/8760] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:21.954552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:21.964358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e38c-205f-49fa-b4b4-ee0f431c5ac1 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:21.968082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:21.968676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:21.968952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:21.969220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:21.971145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:22.059116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:22.060582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:22.071114 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4369/8761] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:50:22.344858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:22.358279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4956-2dc6-4380-8ff8-3fa7cb49b4a0 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:22.363692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:22.364416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:22.364705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:22.365092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:22.366879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:22.381374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:22.383706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:22.398078 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4393/8762] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:25.279272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:25.294093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f7f70-f662-4a94-aa4b-1fd970bd92a4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:25.299109 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:25.300074 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:25.300354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:25.300627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:25.302409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:25.317553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:25.320072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:25.337099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4370/8763] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:28.415442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:28.417934 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:28.437848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d8fd-a740-4653-845e-6dc66aca2959 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:28.442615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:28.443380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:28.443665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:28.443983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] PATH_INFO: `/v3/users/63d2512caf0f4a00a8962db23bd4803d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:28.445235 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d2512caf0f4a00a8962db23bd4803d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:28.447243 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:28.497532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d2512caf0f4a00a8962db23bd4803d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.505056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d2512caf0f4a00a8962db23bd4803d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.517954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d2512caf0f4a00a8962db23bd4803d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.518676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d2512caf0f4a00a8962db23bd4803d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.519287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d2512caf0f4a00a8962db23bd4803d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.546617 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4394/8764] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:50:28 2022] DELETE /identity/v3/users/63d2512caf0f4a00a8962db23bd4803d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:50:28.719610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:28.731964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f72e-980b-4651-8210-48c78f3a1fce service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:28.780567 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:28.791018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:28.791769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:28.792045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:28.792313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] PATH_INFO: `/v3/projects/b9cacbcf9a194a09b0df90cdd54dc482` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:28.793438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cacbcf9a194a09b0df90cdd54dc482)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:28.795344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:28.841550 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cacbcf9a194a09b0df90cdd54dc482', 'request_id': 'req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.847474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cacbcf9a194a09b0df90cdd54dc482', 'request_id': 'req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.853191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cacbcf9a194a09b0df90cdd54dc482', 'request_id': 'req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.865821 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] The token cache is being invalidate because project b9cacbcf9a194a09b0df90cdd54dc482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:50:28.866105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.866805 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:28.868314 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4371/8765] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:50:28 2022] DELETE /identity/v3/projects/b9cacbcf9a194a09b0df90cdd54dc482 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:50:28.872443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:28.873896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:28.888029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf13d6-e1a0-4f97-b52c-a2b2cb521fe6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:28.906817 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:28.950106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:28.950748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:28.951033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:28.951308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] PATH_INFO: `/v3/users/ee3a2f642fbc4f2c858bb2ca32ff4336` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:28.952430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3a2f642fbc4f2c858bb2ca32ff4336)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:28.954400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:29.000829 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3a2f642fbc4f2c858bb2ca32ff4336'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.008546 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3a2f642fbc4f2c858bb2ca32ff4336'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.020130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3a2f642fbc4f2c858bb2ca32ff4336'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.020800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3a2f642fbc4f2c858bb2ca32ff4336'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.021386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3a2f642fbc4f2c858bb2ca32ff4336'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.035026 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4395/8766] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:50:28 2022] DELETE /identity/v3/users/ee3a2f642fbc4f2c858bb2ca32ff4336 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:50:29.213670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:29.215211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:29.229508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc3d1-121f-4e90-a9f5-14a4791d990a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:29.287991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:29.288626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:29.288912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:29.289216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] PATH_INFO: `/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:29.290351 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff52eccdc6e45f8b57253e569be7ae2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:29.292265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:29.338315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff52eccdc6e45f8b57253e569be7ae2', 'request_id': 'req-254018ec-245d-43e7-a0d2-ca96a5de9431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.344493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff52eccdc6e45f8b57253e569be7ae2', 'request_id': 'req-254018ec-245d-43e7-a0d2-ca96a5de9431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.350027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff52eccdc6e45f8b57253e569be7ae2', 'request_id': 'req-254018ec-245d-43e7-a0d2-ca96a5de9431'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.361980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] The token cache is being invalidate because project 5ff52eccdc6e45f8b57253e569be7ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:50:29.362273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.362911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-254018ec-245d-43e7-a0d2-ca96a5de9431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:50:29.364430 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4372/8767] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:50:29 2022] DELETE /identity/v3/projects/5ff52eccdc6e45f8b57253e569be7ae2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:50:39.031581 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:39.359066 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:50.152451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:50.153953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:50.235218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b349d-2c52-4bd8-a8bb-615555f653a5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:50.303351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:50.304066 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:50.305019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:50.305366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:50.307190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:50.321696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:50.323426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa71bdc-4863-482f-89d7-6c534df0861b service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:50.336885 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4396/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:56.043495 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:56.044156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:56.044156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:56.066913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] MFA Rules not processed for user `7d3b3eec24d94748b8b55a52a0e3e422`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:50:56.068532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:56.146517 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4373/8769] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:50:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:50:56.203576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145492-a85b-44aa-8606-2a32e578628d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:56.204331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145492-a85b-44aa-8606-2a32e578628d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:56.204331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145492-a85b-44aa-8606-2a32e578628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:56.255373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-de145492-a85b-44aa-8606-2a32e578628d None None] MFA Rules not processed for user `8565cc85e8a149ac8761b7f687ff7552`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:50:56.257616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de145492-a85b-44aa-8606-2a32e578628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:56.320606 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4397/8770] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 25 01:50:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:50:56.327960 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:56.340589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac815-1843-408c-af7e-b2c030a907b4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:56.344848 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:56.345605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:56.345991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:56.346373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:56.348457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:56.463348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:56.464832 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:56.482814 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4374/8771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:56.798020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145492-a85b-44aa-8606-2a32e578628d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:56.799850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de145492-a85b-44aa-8606-2a32e578628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:56.833163 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:56.872750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145492-a85b-44aa-8606-2a32e578628d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:56.876271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:56.876876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:56.877153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:56.877443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:56.879212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:56.891664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:56.893097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:56.903858 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4398/8772] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:50:57.242335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:50:57.252403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ed54-c5fc-4a71-84e3-8e148a76487f service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:50:57.257945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:50:57.258662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:50:57.258803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:50:57.259047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:50:57.260973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:50:57.278610 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:50:57.280396 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:50:57.297307 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4375/8773] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:50:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:51:00.538227 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:51:00.539781 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:00.561389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2b6f2-d7be-4398-b708-04f299b01d4f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:51:00.569392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:51:00.570296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:00.571543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:00.571817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:00.573679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:00.591354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:51:00.593025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abd51-800a-4dbe-95cd-971566e9fdbf service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:51:00.608390 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4399/8774] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:51:07.294382 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=70 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:10.600132 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=24 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:45.969908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:51:45.979753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213c4d3-179e-4a21-86e8-e39a3b88bdd6 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:51:45.983788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:51:45.984408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:45.984690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:45.984964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:45.986794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:45.999427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:51:46.000884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:51:46.012357 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4376/8775] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:51:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:51:46.120183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:46.120730 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:46.120914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:46.142502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:51:46.143706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:46.153018 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4400/8776] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:51:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:51:46.164999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:51:46.166395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:46.183782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc447-d0c3-4b06-a61c-f0dca994275b service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:51:46.189020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:51:46.189663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:46.189948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:46.190223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:46.199420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:51:46.201005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057797f-d28a-4b2d-94a2-d89366ca4404 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:51:46.211808 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4377/8777] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:51:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:51:46.391147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:51:46.401610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f86d-1115-486d-b9d6-ab0e34bd09f1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:51:46.405548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:51:46.406274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:46.406558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:46.406833 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:46.408575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:46.431202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:51:46.432654 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:51:46.446979 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4401/8778] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:51:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:51:56.207054 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=12 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:56.438795 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:58.188090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:51:58.188598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:51:58.188739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:51:58.208038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] MFA Rules not processed for user `3e4dec25611148a99a5103582540a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:51:58.209220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:51:58.263464 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4378/8779] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:51:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:52:06.624276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:52:06.625836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:52:06.646482 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386c118-9c40-4984-993e-682f8cb50971 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:52:06.653033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:52:06.653847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:52:06.654132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:52:06.654420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:52:06.656421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:52:06.672634 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:52:06.674285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ccd5e-003d-4c75-b5b6-ef29cd12b667 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:52:06.688760 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4402/8780] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:52:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:52:08.256795 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=25 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:16.681235 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:31.903469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:52:31.905098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:52:31.917201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcc215-19fb-4646-b913-dde6e596f65f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:52:31.920778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:52:31.921372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:52:31.921687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:52:31.921961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:52:31.923662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:52:31.935554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:52:31.936996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:52:31.948272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4379/8781] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:52:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:52:41.941554 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:06.679556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:53:06.680059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:53:06.680149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:53:06.700862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] MFA Rules not processed for user `7d3b3eec24d94748b8b55a52a0e3e422`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:53:06.702155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:53:06.709616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4403/8782] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:53:09.554909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:53:09.564988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb5e9-ae80-4ec3-a65a-097727bcb78c service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:53:09.569151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:53:09.569937 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:53:09.570569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:53:09.571015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:53:09.573630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:53:09.591049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:53:09.592586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:53:09.605546 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4380/8783] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:53:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:53:16.695399 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:19.598128 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:53.281891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:53:53.297883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86772e7c-4ed9-481e-a36d-7b3fad2eb8dc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:53:53.303216 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:53:53.303807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:53:53.304084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:53:53.304350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:53:53.306069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:53:53.316489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:53:53.318099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:53:53.327153 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4404/8784] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:53:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:03.322744 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:22.453348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:22.462478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e74a-1a21-481c-ba2d-730a541b93e8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:22.466739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:22.467361 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:22.467650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:22.467927 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:22.469772 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:22.542049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:22.543506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:22.554099 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4381/8785] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:24.417658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:24.433267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65f49-72f3-47da-8a09-b8611671b7a1 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:24.439885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:24.440678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:24.441088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:24.441524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:24.443569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:24.530019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:24.531885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:24.545107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4405/8786] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:24.933799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:24.959229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630595c-1696-4ac3-a042-7e6757e5434e service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:24.977243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:24.977989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:24.978374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:24.979051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:24.981114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:25.000117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:25.001194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:25.011735 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4382/8787] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:25.218242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:25.227418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d5d1-d12c-42c2-a108-0338f2f9cc76 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:25.231105 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:25.231904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:25.232317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:25.232596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:25.234312 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:25.246697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:25.248533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:25.259302 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4406/8788] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:54:25.360582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:25.372794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9acbe-a79c-489c-951d-68850dd435e9 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:25.376900 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:25.377901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:25.378025 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:25.378258 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:25.380996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:25.407801 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:25.409470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:25.429462 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4383/8789] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:25.504682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:25.523564 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8cbb-6fac-4ca8-82b7-2516707e1bfb service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:25.533615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:25.534262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:25.534545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:25.534823 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:25.541468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:25.558005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:25.560184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:25.577507 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4407/8790] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:54:29.745249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:29.747598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:29.762286 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3576b7-4141-42a6-942e-168424a4e7b4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:29.767907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:29.768576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:29.768856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:29.769125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] PATH_INFO: `/v3/users/3e4dec25611148a99a5103582540a52e` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:29.786045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4dec25611148a99a5103582540a52e)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:29.788397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:29.864595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4dec25611148a99a5103582540a52e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:29.865326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4dec25611148a99a5103582540a52e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:29.873778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4dec25611148a99a5103582540a52e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:29.886972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4dec25611148a99a5103582540a52e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:29.888976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4dec25611148a99a5103582540a52e'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:29.902272 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4384/8791] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:54:29 2022] DELETE /identity/v3/users/3e4dec25611148a99a5103582540a52e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:54:30.084491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:30.102224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc908-f822-45dd-86d4-90448880c5b9 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:30.164382 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:30.165014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:30.165291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:30.165590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] PATH_INFO: `/v3/projects/3132ad168f614e279ea7695322517136` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:30.176719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3132ad168f614e279ea7695322517136)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:30.178655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:30.224012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3132ad168f614e279ea7695322517136', 'request_id': 'req-a3c79d35-f225-4a81-a24e-d2436a1e50a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.230613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3132ad168f614e279ea7695322517136', 'request_id': 'req-a3c79d35-f225-4a81-a24e-d2436a1e50a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.236252 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:30.237622 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3132ad168f614e279ea7695322517136', 'request_id': 'req-a3c79d35-f225-4a81-a24e-d2436a1e50a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.250604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] The token cache is being invalidate because project 3132ad168f614e279ea7695322517136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:54:30.250895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.251520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.253069 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4408/8792] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:54:30 2022] DELETE /identity/v3/projects/3132ad168f614e279ea7695322517136 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:54:30.257166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:30.258586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:30.272531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ba2a-c7f5-4b5f-bc00-363a1bf85bc8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:30.299117 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:30.332538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:30.333090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:30.333370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:30.333674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] PATH_INFO: `/v3/users/332790afce72483ba1ff666940b4256a` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:30.347440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332790afce72483ba1ff666940b4256a)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:30.349358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:30.396122 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332790afce72483ba1ff666940b4256a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.396788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332790afce72483ba1ff666940b4256a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.403996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332790afce72483ba1ff666940b4256a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.416291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332790afce72483ba1ff666940b4256a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.416985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-2e0278d5-feee-4dd8-a35a-4ff1d1f2e178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332790afce72483ba1ff666940b4256a'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.433085 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4385/8793] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:54:30 2022] DELETE /identity/v3/users/332790afce72483ba1ff666940b4256a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:54:30.609363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:54:30.610849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:30.624871 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79d35-f225-4a81-a24e-d2436a1e50a7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:54:30.688256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:54:30.688893 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:30.689168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:30.689465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] PATH_INFO: `/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:30.700053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39d121ee1c04e1ca6254fdc8c898c1d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:54:30.702245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:54:30.748295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39d121ee1c04e1ca6254fdc8c898c1d', 'request_id': 'req-614e92c8-eb41-48ba-8bde-7da93d0b9223'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.754870 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39d121ee1c04e1ca6254fdc8c898c1d', 'request_id': 'req-614e92c8-eb41-48ba-8bde-7da93d0b9223'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.760706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39d121ee1c04e1ca6254fdc8c898c1d', 'request_id': 'req-614e92c8-eb41-48ba-8bde-7da93d0b9223'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.773144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] The token cache is being invalidate because project a39d121ee1c04e1ca6254fdc8c898c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:54:30.773607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.774254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:54:30.775758 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4409/8794] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:54:30 2022] DELETE /identity/v3/projects/a39d121ee1c04e1ca6254fdc8c898c1d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:54:40.428109 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:40.770148 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:50.036883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:54:50.037332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:54:50.037494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:54:50.069498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] MFA Rules not processed for user `7d3b3eec24d94748b8b55a52a0e3e422`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:54:50.070856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:54:50.154249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4386/8795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:55:00.144348 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=25 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:01.254012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:55:01.255385 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:01.336414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e92c8-eb41-48ba-8bde-7da93d0b9223 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:55:01.342299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:55:01.342908 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:55:01.343193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:55:01.343470 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:55:01.345202 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:01.360438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:55:01.362073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:55:01.375820 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4410/8796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:55:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:55:11.368207 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=34 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:24.227440 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:55:24.228926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:24.312242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59687-04fd-4bf2-b372-dee9a6c8ba90 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:55:24.317145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:55:24.317779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:55:24.318057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:55:24.318327 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:55:24.320004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:24.335309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:55:24.336917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:55:24.356700 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4387/8797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:55:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:55:28.345535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:55:28.347009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:28.363512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972673-48c6-443c-b688-a6260d61d82f service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:55:28.368600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:55:28.369198 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:55:28.369515 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:55:28.369793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:55:28.371491 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:28.385728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:55:28.387399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:55:28.401049 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4411/8798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:55:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:55:34.349567 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=36 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:38.394140 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:58.258189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:55:58.259696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:58.325155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5577b3-5a35-4ab9-815b-42ce460bf123 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:55:58.329845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:55:58.330441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:55:58.330722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:55:58.330994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:55:58.332946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:58.348560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:55:58.350030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:55:58.373019 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4388/8799] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:55:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:55:59.560081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:55:59.570077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969463ea-b3a0-497e-a620-11996636f3ff service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:55:59.573779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:55:59.574376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:55:59.574658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:55:59.574931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:55:59.576657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:55:59.593326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:55:59.595011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876f02-cc83-4b63-b0dd-4f9ae032abc3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:55:59.608592 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4412/8800] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:55:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:08.370558 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=34 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:09.601060 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:40.613778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:40.630323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09737-6d79-4fb1-826b-6f3abb0256a5 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:40.635932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:40.636548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:40.636826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:40.637099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:40.639012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:40.656662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:40.659239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:40.676460 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4389/8801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:56:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:40.797146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589bdb0-b6dd-4523-b34b-77ead60174ea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:40.797759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589bdb0-b6dd-4523-b34b-77ead60174ea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:40.797759 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589bdb0-b6dd-4523-b34b-77ead60174ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:40.832012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0589bdb0-b6dd-4523-b34b-77ead60174ea None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:40.833159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0589bdb0-b6dd-4523-b34b-77ead60174ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:40.841992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4413/8802] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Sep 25 01:56:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:40.864513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:40.879640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbd4e-8f39-4eb3-814c-6b90fb1c2856 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:40.884766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:40.885382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:40.885728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:40.886004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:40.895989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:40.897625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:40.909079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4390/8803] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:56:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:45.137947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.138391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.138673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.159791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:45.161098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.169733 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4414/8804] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:45.176018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:45.192324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd13d-c669-4bb0-8371-bf50321bcf15 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:45.198326 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:45.199162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.199547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.199923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.212059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.232828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:45.234501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447021c6-7fc0-4e22-bf29-6efcdf2b7bc9 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:45.248163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4391/8805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:56:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:45.407218 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:45.409132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.491451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fddf29-cbc8-4e58-984a-c033682047bb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:45.496063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:45.496691 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.496973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.497246 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] PATH_INFO: `/v3/users/7d3b3eec24d94748b8b55a52a0e3e422` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.498384 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3b3eec24d94748b8b55a52a0e3e422)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:45.500330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:45.548721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3b3eec24d94748b8b55a52a0e3e422'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:45.556272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3b3eec24d94748b8b55a52a0e3e422'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:45.568567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3b3eec24d94748b8b55a52a0e3e422'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:45.569269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3b3eec24d94748b8b55a52a0e3e422'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:45.569920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3b3eec24d94748b8b55a52a0e3e422'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:45.582962 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4415/8806] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:56:45 2022] DELETE /identity/v3/users/7d3b3eec24d94748b8b55a52a0e3e422 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:45.587615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.587909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.588215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.616707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:45.617957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.677223 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4392/8807] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:45.686835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:45.688233 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.742995 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:45.747022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc9f2-adfd-4f77-b2ab-fddd64dd39c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:45.751431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:45.752369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.753355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.753661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.763039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:45.764460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:45.774101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4416/8808] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:45.946271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:45.948005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:45.961390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a673-f3e1-4dcb-a818-5fe2a0e9776c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:45.966272 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:45.966923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:45.967205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:45.967485 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] PATH_INFO: `/v3/projects/2935e753a36e4a25b0362b13a4c12ebf` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:45.968617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2935e753a36e4a25b0362b13a4c12ebf)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:45.970553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.016928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2935e753a36e4a25b0362b13a4c12ebf', 'request_id': 'req-98cbec18-a0d6-4d38-9496-5666763aba06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.023788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2935e753a36e4a25b0362b13a4c12ebf', 'request_id': 'req-98cbec18-a0d6-4d38-9496-5666763aba06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.029394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2935e753a36e4a25b0362b13a4c12ebf', 'request_id': 'req-98cbec18-a0d6-4d38-9496-5666763aba06'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.044723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] The token cache is being invalidate because project 2935e753a36e4a25b0362b13a4c12ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:56:46.045010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.045670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.047139 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4393/8809] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:56:45 2022] DELETE /identity/v3/projects/2935e753a36e4a25b0362b13a4c12ebf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:46.051534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.061232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e1033-87e2-4873-afa4-9270780aed91 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.119440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.120083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.120370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.120650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] PATH_INFO: `/v3/users/2f2384bc2c52453d9bd0ce9d5f1754c1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.121830 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2384bc2c52453d9bd0ce9d5f1754c1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.123770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.173635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2384bc2c52453d9bd0ce9d5f1754c1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.181153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2384bc2c52453d9bd0ce9d5f1754c1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.193806 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2384bc2c52453d9bd0ce9d5f1754c1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.194561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2384bc2c52453d9bd0ce9d5f1754c1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.195162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6ec56777-47c2-43da-a8a5-fd1d586fea3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2384bc2c52453d9bd0ce9d5f1754c1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.210840 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4417/8810] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:56:46 2022] DELETE /identity/v3/users/2f2384bc2c52453d9bd0ce9d5f1754c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:56:46.391147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.392617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:46.406640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbec18-a0d6-4d38-9496-5666763aba06 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.451101 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:46.487566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.488203 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.488487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.488764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] PATH_INFO: `/v3/projects/6768fcf2a21b47309da69f215ec784f6` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.489933 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6768fcf2a21b47309da69f215ec784f6)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.491852 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.539508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6768fcf2a21b47309da69f215ec784f6', 'request_id': 'req-48d34944-5f9d-4174-9343-09400509c9eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.545586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6768fcf2a21b47309da69f215ec784f6', 'request_id': 'req-48d34944-5f9d-4174-9343-09400509c9eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.552052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6768fcf2a21b47309da69f215ec784f6', 'request_id': 'req-48d34944-5f9d-4174-9343-09400509c9eb'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.564477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] The token cache is being invalidate because project 6768fcf2a21b47309da69f215ec784f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:56:46.565540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.566297 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-48d34944-5f9d-4174-9343-09400509c9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:46.567799 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4394/8811] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:56:46 2022] DELETE /identity/v3/projects/6768fcf2a21b47309da69f215ec784f6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:46.572941 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.573230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.573672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.611480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:46.613580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:46.661578 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:46.675402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4418/8812] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:46.684679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.684967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.685243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.704882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:46.706384 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:46.714723 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4395/8813] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:46.718949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.729544 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a963-64e1-4f35-9120-f39e67477878 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.734279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.734881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.735166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.735441 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.736087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:56:46.736393 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.738734 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.750256 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4419/8814] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:56:46.754562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.763835 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43f58-0e2e-4976-8be6-734a85fc3b8f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.768656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.769244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.769564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.769839 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.770473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.772385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.810331 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4396/8815] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:56:46 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:56:46.814499 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.824875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2f64-b662-42d4-af4e-30da95c21032 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.883191 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.883805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.884089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.884365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.885020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.886989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.908044 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4420/8816] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:56:46 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:56:46.915133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.926496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef2c0-5f03-4df9-a050-cdbfd828df0a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.931181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.931784 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.932069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.932345 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.932985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.934628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.944812 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4397/8817] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:56:46.948849 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.959479 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00f8da-6193-4c56-946a-8e6b2768af3b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.964020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.964616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.964892 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.965163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:46.965846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:46.967446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f1da-e0c7-416b-8bf8-1833f96a21ed admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:46.978724 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4421/8818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:56:46.982814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:46.993734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d8ec-98b7-4e53-a794-fb9820e6eda0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:46.998526 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:46.999180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:46.999457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:46.999724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] PATH_INFO: `/v3/projects/fad7707ee69341aba3a9776eaac38c63/users/5dd7fc85c0474aceb66da862fc67de68/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:47.014516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad7707ee69341aba3a9776eaac38c63, user_id=5dd7fc85c0474aceb66da862fc67de68, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:47.017169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:47.030079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4398/8819] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:56:46 2022] PUT /identity/v3/projects/fad7707ee69341aba3a9776eaac38c63/users/5dd7fc85c0474aceb66da862fc67de68/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:47.036007 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d271-b687-4f07-824a-6f5d3b914b91 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:47.036294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d271-b687-4f07-824a-6f5d3b914b91 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:47.036571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5d271-b687-4f07-824a-6f5d3b914b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:47.055714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7eb5d271-b687-4f07-824a-6f5d3b914b91 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:47.056898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7eb5d271-b687-4f07-824a-6f5d3b914b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:47.117975 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4422/8820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:47.128198 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:47.129909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:47.186112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe52de-8e87-4e78-8dd7-3400f9225c3b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:47.189799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:47.191015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:47.191288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:47.191557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:47.200291 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:47.201769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:47.205615 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:47.213474 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4399/8821] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:56:51.214380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.214861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.214967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.243981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] MFA Rules not processed for user `5dd7fc85c0474aceb66da862fc67de68`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:51.245325 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:51.301078 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:51.322935 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4423/8822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:56:51.327690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:51.338736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780032-9c87-4e28-83f6-a909e8b256a4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:51.343878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:51.344508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.344785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.345052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.345727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:51.348549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:51.373510 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4400/8823] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:56:51 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:56:51.375368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:51.391151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866649aa-ad01-41af-b053-2a83754d0fea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:51.396014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:51.396732 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.397078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.397517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.398362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:51.400033 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902751f-cbc3-48df-82d7-48090f7bd404 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:51.419729 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4424/8824] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:56:51.420707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:51.437268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583ff5-426e-4c45-bf0d-62d6b2ec5cf1 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:51.447481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:51.448285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.448627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.448972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] PATH_INFO: `/v3/system/users/a360bbfa279141c79917e19337d7988d/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.464175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a360bbfa279141c79917e19337d7988d, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:51.465915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:51.473371 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4401/8825] 10.222.0.16 () {60 vars in 1378 bytes} [Sun Sep 25 01:56:51 2022] PUT /identity/v3/system/users/a360bbfa279141c79917e19337d7988d/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:51.485676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.485959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.486236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.516090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] MFA Rules not processed for user `a360bbfa279141c79917e19337d7988d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:56:51.517683 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:51.601821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4425/8826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:56:51 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 25 01:56:51.606191 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:51.719171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498da04f-6b51-4e11-b411-f4513ea92fc7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:51.759256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a360bbfa279141c79917e19337d7988d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:51.759874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.760152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.760424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] PATH_INFO: `/v3/services` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.761037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:51.762452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:51.770918 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4402/8827] 10.222.0.16 () {58 vars in 1110 bytes} [Sun Sep 25 01:56:51 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:56:51.775445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:51.902099 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb3841-fdef-41a9-b94c-ac8df209f245 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:51.903992 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:51.958021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a360bbfa279141c79917e19337d7988d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:51.958728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:51.959015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:51.959296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] PATH_INFO: `/v3/limits` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:51.960143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:51.961508 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Sep 25 01:56:52.009449 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.NoLimitReference Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 25 01:56:52.010568 n-d-master-1 devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 25 01:56:52.012508 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4426/8828] 10.222.0.16 () {60 vars in 1126 bytes} [Sun Sep 25 01:56:51 2022] POST /identity/v3/limits => generated 124 bytes in 237 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 25 01:56:52.017500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:52.048862 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:52.134980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1167d-b795-4e11-9b4a-8e0da8ea47f2 None tempest-ImageQuotaTest-164215129-system-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:52.173655 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a360bbfa279141c79917e19337d7988d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:52.174574 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:52.175067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:52.175483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:52.176207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:52.178273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:52.185998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4403/8829] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:56:52 2022] GET /identity/v3/registered_limits => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:56:52.192701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:52.326904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32a75-a58e-4f90-a882-d720b6376822 None tempest-ImageQuotaTest-164215129-system-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:52.367862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a360bbfa279141c79917e19337d7988d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:52.368483 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:52.368762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:52.369037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:52.369689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:52.370757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:52.379272 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4427/8830] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:56:52 2022] GET /identity/v3/registered_limits => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:56:55.730468 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:55.742555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56bf0-8fdd-4ebf-b926-db515d9a9351 None tempest-ImageQuotaTest-164215129-system-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:55.747342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:55.747972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:55.748252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:55.748522 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] PATH_INFO: `/v3/users/5dd7fc85c0474aceb66da862fc67de68` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:55.749680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd7fc85c0474aceb66da862fc67de68)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:55.751609 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:55.797699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd7fc85c0474aceb66da862fc67de68'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:55.798307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd7fc85c0474aceb66da862fc67de68'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:55.805894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd7fc85c0474aceb66da862fc67de68'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:55.817963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd7fc85c0474aceb66da862fc67de68'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:55.818611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd7fc85c0474aceb66da862fc67de68'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:55.831197 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4404/8831] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:56:55 2022] DELETE /identity/v3/users/5dd7fc85c0474aceb66da862fc67de68 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:56.006879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:56.008692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:56:56.042297 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:56.081087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588788-86b0-4d46-b045-c533fe9e392e None tempest-ImageQuotaTest-164215129-system-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:56.085707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:56.086334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:56.086643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:56.086920 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] PATH_INFO: `/v3/projects/fad7707ee69341aba3a9776eaac38c63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:56.088039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad7707ee69341aba3a9776eaac38c63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:56.090010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:56.140413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad7707ee69341aba3a9776eaac38c63', 'request_id': 'req-55ec83b0-8068-4e3a-987d-ca6b85f26720'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.147786 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad7707ee69341aba3a9776eaac38c63', 'request_id': 'req-55ec83b0-8068-4e3a-987d-ca6b85f26720'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.153328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad7707ee69341aba3a9776eaac38c63', 'request_id': 'req-55ec83b0-8068-4e3a-987d-ca6b85f26720'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.166991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] The token cache is being invalidate because project fad7707ee69341aba3a9776eaac38c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:56:56.167304 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.167927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-55ec83b0-8068-4e3a-987d-ca6b85f26720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.169451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4428/8832] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:56:56 2022] DELETE /identity/v3/projects/fad7707ee69341aba3a9776eaac38c63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:56:56.173600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:56:56.184635 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20ace-faf7-4f77-a347-c8424b8737e8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:56:56.195777 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:56.247764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:56:56.248401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:56:56.248685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:56:56.248959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] PATH_INFO: `/v3/users/a360bbfa279141c79917e19337d7988d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:56:56.250107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a360bbfa279141c79917e19337d7988d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:56:56.252053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:56:56.307965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a360bbfa279141c79917e19337d7988d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.308607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a360bbfa279141c79917e19337d7988d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.316056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a360bbfa279141c79917e19337d7988d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.327776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a360bbfa279141c79917e19337d7988d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.328417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5b4a011b-075b-4789-ae68-c8b377051c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a360bbfa279141c79917e19337d7988d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:56:56.340799 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4405/8833] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:56:56 2022] DELETE /identity/v3/users/a360bbfa279141c79917e19337d7988d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:57:06.164210 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:06.314997 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.315300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.315575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.336747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:06.337257 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=51,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:06.337977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:06.398063 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4429/8834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:06.407332 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.407648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.407924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.430313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:06.431605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:06.439765 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4406/8835] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:06.444480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.454071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac5f9d-5259-4ee1-8cab-b26df691dc08 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.458865 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.459457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.459735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.459998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.460631 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:57:06.460926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.462538 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.474566 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4430/8836] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:57:06.489534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.499773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386b80-2cc3-4e36-8192-dc7861198a71 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.504901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.505541 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.505827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.506107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.506736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.508646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.539984 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4407/8837] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:57:06.541316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.552034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b7a4-866d-4280-8ef2-e7e60a300b98 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.607553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.608083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.608368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.608642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.609276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.611259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.633648 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4431/8838] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:57:06.637701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.648744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25fbc-8904-4abf-a3d6-60cfbc91aa1f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.653394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.654023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.654311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.654588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.655232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.657090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.667539 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4408/8839] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:57:06.671595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.681839 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5163-ca20-46ad-b0f9-99bd708aa6aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.686953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.687553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.687837 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.688112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.688750 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.690614 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e26451-4f83-455d-8f91-d32eca9b682a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.701817 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4432/8840] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 01:57:06.706411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.716401 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89691-f3de-4cb9-9dbc-cfa1405edcbd admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.721617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.722186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.722465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.722738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] PATH_INFO: `/v3/projects/26011f6774e24fa3ac59faf52212870d/users/d632f58cc9544d9296097ce72ef268e0/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.737116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26011f6774e24fa3ac59faf52212870d, user_id=d632f58cc9544d9296097ce72ef268e0, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.739816 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.752376 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4409/8841] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:57:06 2022] PUT /identity/v3/projects/26011f6774e24fa3ac59faf52212870d/users/d632f58cc9544d9296097ce72ef268e0/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:57:06.765334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.765655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.765930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.795413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] MFA Rules not processed for user `d632f58cc9544d9296097ce72ef268e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:06.796637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:06.852485 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:06.862111 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4433/8842] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:06.866464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.930441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd840ef-481f-4354-b5cb-16268d5fb4b0 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:06.935221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:06.935818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:06.936100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:06.936373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:06.936994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:06.938935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:06.968958 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4410/8843] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:57:06.970167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:06.981168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919f0b-38f5-40ea-a519-e4688e9b1a4f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.039058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.039711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.040053 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.040329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.040972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.042942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.063683 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4434/8844] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:57:06 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:57:07.068178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:07.078496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3af9-18ee-4a08-99ea-06f9b6052527 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.083878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.084476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.084758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.085032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.085706 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.087343 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.098103 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4411/8845] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:57:07.101959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:07.111874 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7425-ac84-4890-b301-00fca2b0b1ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.116612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.117201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.117512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.117785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] PATH_INFO: `/v3/projects/7fc9cc3e48084ed6827c73d740804219/users/dc4a44689d67419f98d18a2dbd8dc357/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.133192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc9cc3e48084ed6827c73d740804219, user_id=dc4a44689d67419f98d18a2dbd8dc357, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.135910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.149262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4435/8846] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:57:07 2022] PUT /identity/v3/projects/7fc9cc3e48084ed6827c73d740804219/users/dc4a44689d67419f98d18a2dbd8dc357/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:57:07.153275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:07.163748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c9c6-6395-4938-bff8-4a8b65be6348 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.219787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.220382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.221346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.221651 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.222282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.223903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d59943-35b1-4b2a-a38a-ee39daa6935f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.233434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4412/8847] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:57:07.237724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:07.247968 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0887-c9de-45ab-a4e0-58358aef7b04 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.253254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.253930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.254211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.254481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] PATH_INFO: `/v3/projects/7fc9cc3e48084ed6827c73d740804219/users/dc4a44689d67419f98d18a2dbd8dc357/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.256401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc9cc3e48084ed6827c73d740804219, user_id=dc4a44689d67419f98d18a2dbd8dc357, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.259138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c509645-7d86-45f5-8ba6-33b0c33a0e94 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.269877 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4436/8848] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:57:07 2022] PUT /identity/v3/projects/7fc9cc3e48084ed6827c73d740804219/users/dc4a44689d67419f98d18a2dbd8dc357/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:57:07.279911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.280200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.280477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.294599 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:07.310117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] MFA Rules not processed for user `dc4a44689d67419f98d18a2dbd8dc357`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:07.311315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:07.379847 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4413/8849] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:07.393078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e144-be3b-4970-941a-16e83dd48681 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.393234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e144-be3b-4970-941a-16e83dd48681 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.393541 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e144-be3b-4970-941a-16e83dd48681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.413784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-80c2e144-be3b-4970-941a-16e83dd48681 None None] MFA Rules not processed for user `d632f58cc9544d9296097ce72ef268e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:07.415005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-80c2e144-be3b-4970-941a-16e83dd48681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:07.470214 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4437/8850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:07.483774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:07.485192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:07.566048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dea824-f32e-48b6-8f5b-471acd7c6b7d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:07.571552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:07.572160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:07.572438 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:07.572709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:07.580503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:07.582135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b9cc8-aa52-4ed4-9c0a-db9e1be8c3fa service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:07.590786 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4414/8851] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:08.594860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:08.595932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:08.595932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:08.616055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:08.617302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:08.664876 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:08.682286 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4438/8852] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Sep 25 01:57:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:08.694355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:08.694830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:08.694922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:08.714463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:08.715656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:08.724845 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4415/8853] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:57:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:08.730800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:08.741909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007a633-6ae4-4ea0-b556-c5031b9a5620 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:08.747006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:08.747601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:08.747888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:08.748156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:08.756652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:08.758263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:08.767815 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4439/8854] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:57:10.912339 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:10.929481 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4d95-695f-45ce-afa5-e865caf92519 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:10.935515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:10.936120 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:10.936404 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:10.936678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:10.938788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:10.961371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:10.963039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1243774-c58a-404c-8c14-c4f4e75896b1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:10.977165 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4416/8855] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:18.763805 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:18.805821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:18.807264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:18.826666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d877f-5e32-41a6-a2b7-fb52f6fbd778 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:18.832568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:18.833176 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:18.833495 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:18.833912 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:18.842364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:18.843956 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:18.854208 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4440/8856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:18.870005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:18.870521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:18.870624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] PATH_INFO: `/` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:18.871878 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4417/8857] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:57:18.876141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] Authenticating service token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:57:18.889793 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:18.898301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ba09-05b2-44c4-8db1-3c4a6ceef198 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:18.902902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4a44689d67419f98d18a2dbd8dc357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fc9cc3e48084ed6827c73d740804219', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:18.903522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:18.903808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:18.904090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] PATH_INFO: `/v3/projects/7fc9cc3e48084ed6827c73d740804219` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:18.905221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fc9cc3e48084ed6827c73d740804219)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:18.907302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c409fd-d2c0-4d24-991d-bc9f2b573461 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:18.908911 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4441/8858] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:57:18 2022] GET /identity/v3/projects/7fc9cc3e48084ed6827c73d740804219 => generated 391 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:57:19.065423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:19.067149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:19.125591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743c920-0bcd-46f6-abfa-6e6d86a39b83 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:19.129078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:19.129708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:19.129990 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:19.130260 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:19.132459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:19.144782 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:19.146230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:19.150976 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=100 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:19.158399 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4418/8859] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:19.317210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b52-791f-49ca-a9a3-a0510caf7447 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:19.317556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b52-791f-49ca-a9a3-a0510caf7447 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:19.317840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b52-791f-49ca-a9a3-a0510caf7447 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:19.319208 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4442/8860] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 25 01:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 25 01:57:19.324007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] Authenticating service token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 25 01:57:19.340615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:19.350349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccde0-c14a-49c0-bdb6-40f72fb2ff33 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:19.355800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4a44689d67419f98d18a2dbd8dc357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fc9cc3e48084ed6827c73d740804219', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:19.356426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:19.356709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:19.356985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] PATH_INFO: `/v3/projects/7fc9cc3e48084ed6827c73d740804219` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:19.358410 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fc9cc3e48084ed6827c73d740804219)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:19.360218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:19.361867 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4419/8861] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 25 01:57:19 2022] GET /identity/v3/projects/7fc9cc3e48084ed6827c73d740804219 => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:57:19.518498 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52b52-791f-49ca-a9a3-a0510caf7447 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:19.531824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52b52-791f-49ca-a9a3-a0510caf7447 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:19.535704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:19.536298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:19.536578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:19.536850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:19.539331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:19.552108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:19.553580 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5ae7-ccef-49d0-97f9-3f4cdc1019d5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:19.564343 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4443/8862] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:23.339605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:23.402838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592f1fa-1fa0-419f-a170-196d0f9ef18c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:23.407556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:23.408166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:23.408447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:23.408715 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] PATH_INFO: `/v3/users/d632f58cc9544d9296097ce72ef268e0` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:23.409844 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d632f58cc9544d9296097ce72ef268e0)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:23.411758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:23.462700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd632f58cc9544d9296097ce72ef268e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:23.463400 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd632f58cc9544d9296097ce72ef268e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:23.473344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd632f58cc9544d9296097ce72ef268e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:23.487713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd632f58cc9544d9296097ce72ef268e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:23.488352 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd632f58cc9544d9296097ce72ef268e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:23.501618 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4420/8863] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:57:23 2022] DELETE /identity/v3/users/d632f58cc9544d9296097ce72ef268e0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:57:23.506502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:23.506932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:23.507055 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:23.528675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:23.529917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:23.592335 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4444/8864] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:23.602376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:23.603851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:23.669630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132940ac-5daf-455d-9713-3b4bd748aaba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:23.673346 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:23.673992 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:23.674276 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:23.674553 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:23.685071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:23.686570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:23.699868 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4421/8865] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:23.907366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:23.909356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:23.924774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d56bc-63cc-4afb-a9d1-59dbcb611865 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:23.931345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:23.932294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:23.932605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:23.932878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] PATH_INFO: `/v3/projects/26011f6774e24fa3ac59faf52212870d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:23.934114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26011f6774e24fa3ac59faf52212870d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:23.936444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:23.995207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26011f6774e24fa3ac59faf52212870d', 'request_id': 'req-45082136-0a2a-46e2-96f7-3552312d8e45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.002256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26011f6774e24fa3ac59faf52212870d', 'request_id': 'req-45082136-0a2a-46e2-96f7-3552312d8e45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.010409 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26011f6774e24fa3ac59faf52212870d', 'request_id': 'req-45082136-0a2a-46e2-96f7-3552312d8e45'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.027603 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] The token cache is being invalidate because project 26011f6774e24fa3ac59faf52212870d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:57:24.027894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.028610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.030163 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4445/8866] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:57:23 2022] DELETE /identity/v3/projects/26011f6774e24fa3ac59faf52212870d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:57:24.034728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.045850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82a47b-377e-4e81-9bf5-d0b0c61200fe service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.056048 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:24.109288 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.109962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.110243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.110515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] PATH_INFO: `/v3/users/dc4a44689d67419f98d18a2dbd8dc357` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.111709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4a44689d67419f98d18a2dbd8dc357)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.113925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:24.171307 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4a44689d67419f98d18a2dbd8dc357'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.171956 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4a44689d67419f98d18a2dbd8dc357'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.179190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4a44689d67419f98d18a2dbd8dc357'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.194563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4a44689d67419f98d18a2dbd8dc357'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.195517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-7dc9ad92-4abe-44e1-8e2e-82accffde8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4a44689d67419f98d18a2dbd8dc357'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.212062 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4422/8867] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:57:24 2022] DELETE /identity/v3/users/dc4a44689d67419f98d18a2dbd8dc357 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:57:24.495137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.496572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:24.510100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45082136-0a2a-46e2-96f7-3552312d8e45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.559407 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:24.573420 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.574034 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.574319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.574592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] PATH_INFO: `/v3/projects/7fc9cc3e48084ed6827c73d740804219` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.575719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc9cc3e48084ed6827c73d740804219)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.577674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:24.623749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc9cc3e48084ed6827c73d740804219', 'request_id': 'req-1cb74372-4186-40e9-abe2-277e356664a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.629782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc9cc3e48084ed6827c73d740804219', 'request_id': 'req-1cb74372-4186-40e9-abe2-277e356664a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.635486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc9cc3e48084ed6827c73d740804219', 'request_id': 'req-1cb74372-4186-40e9-abe2-277e356664a7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.647643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] The token cache is being invalidate because project 7fc9cc3e48084ed6827c73d740804219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:57:24.647933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.649640 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1cb74372-4186-40e9-abe2-277e356664a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:57:24.651247 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4446/8868] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:57:24 2022] DELETE /identity/v3/projects/7fc9cc3e48084ed6827c73d740804219 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:57:24.657453 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.657905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.658018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.677912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:24.679105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:24.738404 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4423/8869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:24.747011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.747299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.747582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.768903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:24.770156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:24.779157 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4447/8870] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:57:24.783807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.793885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fb5b5-d2d2-44e1-a4dd-6992fddab776 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.798530 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.799127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.799411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.799687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.800710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:57:24.801019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.802673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:24.814678 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4424/8871] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:57:24.819192 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.829120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189d10-0064-42fa-9f88-01abb36425e1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.834167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.834765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.835046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.835324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.836583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.838556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:24.871718 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4448/8872] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:57:24 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:57:24.872859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.883547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe7f9-d4d7-4269-a322-e462977fec59 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.901766 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:24.942647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.943256 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.943539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.943818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.944451 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.947182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:24.972024 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4425/8873] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:57:24 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 01:57:24.973520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:24.984980 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae12e-190f-4515-b1b0-f44b99eaeff5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:24.989721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:24.990326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:24.990606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:24.990890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:24.991528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:24.993349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:25.003734 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4449/8874] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:57:25.007445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:25.018008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab198-f353-4d7f-90c9-d13768e8bd52 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:25.022585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:25.023182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:25.024046 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:25.024323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:25.024958 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:25.026587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496b64f-a5a1-4b58-989e-0221e2a2a8f9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:25.037445 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4426/8875] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:57:25.041660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:25.051789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4473-7232-4bfc-9f1e-0d069baafac9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:25.056974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:25.057661 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:25.057946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:25.058224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] PATH_INFO: `/v3/projects/69079674a8234d9d87d2d3c78561b958/users/afb45cff708a4e40a27f57f5900a8442/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:25.074278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69079674a8234d9d87d2d3c78561b958, user_id=afb45cff708a4e40a27f57f5900a8442, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:25.077674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:25.091826 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4450/8876] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:57:25 2022] PUT /identity/v3/projects/69079674a8234d9d87d2d3c78561b958/users/afb45cff708a4e40a27f57f5900a8442/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:57:25.097018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ed00-00c3-4d3d-8e11-0efe2e7307ff None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:25.097308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ed00-00c3-4d3d-8e11-0efe2e7307ff None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:25.097618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ed00-00c3-4d3d-8e11-0efe2e7307ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:25.116325 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a495ed00-00c3-4d3d-8e11-0efe2e7307ff None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:25.117664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a495ed00-00c3-4d3d-8e11-0efe2e7307ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:25.180591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4427/8877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:25.191425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:25.193158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:25.253573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25d44-aa85-4660-91e0-fadc63dd5313 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:25.258680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:25.259298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:25.259611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:25.259887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:25.269903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:25.271351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becbe62-22c3-4ec2-976b-8a21634f0f2d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:25.281388 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4451/8878] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:29.446458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:29.446939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:29.447053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:29.483491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] MFA Rules not processed for user `afb45cff708a4e40a27f57f5900a8442`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:29.484942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:29.553557 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4428/8879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:29.564813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:29.565331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:29.565331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:29.585377 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] MFA Rules not processed for user `afb45cff708a4e40a27f57f5900a8442`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:57:29.587252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:29.594286 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4452/8880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:57:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:57:29.607476 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:29.609118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:29.641708 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:29.688521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecfa4a-f444-4ae3-8e6f-22443336a724 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:29.694223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:29.694841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:29.695819 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:29.696096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:29.704540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:29.706178 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:29.715186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4429/8881] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:31.309674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:31.312182 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:31.327761 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:31.401371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6351ac-05c6-46f0-9a91-51abc0d2610f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:31.407046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:31.407671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:31.407952 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:31.408220 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:31.412321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:31.425556 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:31.427194 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:31.439188 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4453/8882] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:33.452533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:33.454096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:33.467225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6fcf4-ea11-47ef-95c4-59c47d472f55 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:33.471235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:33.471872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:33.472156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:33.472423 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:33.474226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:33.487078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:33.488536 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:33.500899 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4430/8883] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:41.434298 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=27 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:42.195678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:42.204973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401f30-94e2-49ec-982f-387681971160 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:42.208604 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:42.209208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:42.209526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:42.209804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:42.211743 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:42.224496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:42.226628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:42.237596 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4454/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:57:42.340607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:57:42.355882 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57603826-9878-4816-bfdb-eae110f7f243 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:57:42.361734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:57:42.362342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:57:42.362622 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:57:42.362920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:57:42.364670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:57:42.376406 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:57:42.378206 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:57:42.388989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4431/8885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:57:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:57:52.231286 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:52.393240 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=33 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:11.353583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:11.362138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0d8d-e028-4cc4-85de-73549d0f670a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:11.366395 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:11.367000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:11.367283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:11.367553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:11.369318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:11.381877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:11.383316 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:11.394135 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4455/8886] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:58:21.387801 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:23.955078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:23.966285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4567-be32-4a47-bb51-ef043e376499 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:23.971350 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:23.971971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:23.972245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:23.972517 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:23.974267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:23.989493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:23.991585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.021394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.022429 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4432/8887] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:58:24.035027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafebb-2729-4eac-b982-343a8de76604 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.040722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.041361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.041667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.041939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] PATH_INFO: `/v3/users/afb45cff708a4e40a27f57f5900a8442` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.043068 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb45cff708a4e40a27f57f5900a8442)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.044977 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.093932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb45cff708a4e40a27f57f5900a8442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.101002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb45cff708a4e40a27f57f5900a8442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.112931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb45cff708a4e40a27f57f5900a8442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.113647 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb45cff708a4e40a27f57f5900a8442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.114288 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-53ed5f65-50ba-49a6-a797-eebc29c0cca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb45cff708a4e40a27f57f5900a8442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.126560 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4456/8888] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:58:24 2022] DELETE /identity/v3/users/afb45cff708a4e40a27f57f5900a8442 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 01:58:24.305117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.315829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfc8f-46cb-45f1-b576-ab5cc4375b86 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.375010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.375633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.375908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.376176 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] PATH_INFO: `/v3/projects/69079674a8234d9d87d2d3c78561b958` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.377280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69079674a8234d9d87d2d3c78561b958)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.379257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.431814 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69079674a8234d9d87d2d3c78561b958', 'request_id': 'req-5f84974b-6e38-43b3-9a34-b24e2e8329e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.441244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69079674a8234d9d87d2d3c78561b958', 'request_id': 'req-5f84974b-6e38-43b3-9a34-b24e2e8329e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.447926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69079674a8234d9d87d2d3c78561b958', 'request_id': 'req-5f84974b-6e38-43b3-9a34-b24e2e8329e5'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.462052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] The token cache is being invalidate because project 69079674a8234d9d87d2d3c78561b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 01:58:24.462342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.462991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5f84974b-6e38-43b3-9a34-b24e2e8329e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 01:58:24.464694 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4433/8889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:58:24 2022] DELETE /identity/v3/projects/69079674a8234d9d87d2d3c78561b958 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:58:24.470831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.471225 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.473605 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.498367 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:24.499926 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:24.563108 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4457/8890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:58:24.571643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.571930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.572205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.592242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:24.593540 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:24.601853 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4434/8891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:24.606379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.617738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f6ca6-3b7b-481a-a1d2-671d39de8338 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.622354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.622958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.623236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.623506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.624412 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 01:58:24.624720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.626421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.640177 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4458/8892] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 01:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 01:58:24.644719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.655299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187a96-5170-48cb-80d5-84c60451a17c None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.660392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.661003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.661285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.661591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.662240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.664494 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.696361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4435/8893] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 01:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:58:24.701364 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.711836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0b04-5c73-4d23-a9b5-c9170738ea8e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.772666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.773275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.773592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.773867 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.774512 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.776439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.785042 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:24.805454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4459/8894] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 01:58:24 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 01:58:24.806923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.818798 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2ce9-b551-487b-bd85-c9657f9f276e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.823811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.824421 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.824700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.824972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.825654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.827253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.839369 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4436/8895] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:58:24.843345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.854431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7307-0aa8-4257-8d4e-89c039475833 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.859307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.859915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.860195 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.860468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.861113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.862751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8b7f-680a-4760-9115-f7312b13001d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.874317 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4460/8896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 01:58:24.878685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:24.890275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4a39-fabd-43b4-a786-f754dc522eed admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:24.894736 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:24.895386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.895663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.895934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] PATH_INFO: `/v3/projects/779611b4d82845a48d34180747a77c16/users/1fa684ff6c6c4beca6835a46dc9b7938/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.913216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779611b4d82845a48d34180747a77c16, user_id=1fa684ff6c6c4beca6835a46dc9b7938, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:24.916019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:24.931836 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4437/8897] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 01:58:24 2022] PUT /identity/v3/projects/779611b4d82845a48d34180747a77c16/users/1fa684ff6c6c4beca6835a46dc9b7938/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 01:58:24.937205 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38c8a-3d02-4875-a967-6870fa85f584 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:24.937524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38c8a-3d02-4875-a967-6870fa85f584 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:24.937805 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38c8a-3d02-4875-a967-6870fa85f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:24.958307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0ad38c8a-3d02-4875-a967-6870fa85f584 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:24.959539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ad38c8a-3d02-4875-a967-6870fa85f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:25.034924 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4461/8898] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:25.045556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:25.047365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:25.062675 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:25.113065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981198b-fe96-4e7b-bc14-acbeb0c3cdd7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:25.117767 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:25.118412 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:25.118695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:25.119018 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:25.129380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:25.130894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f708-cb92-454e-8946-4fd0b84da2de service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:25.141696 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4438/8899] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:58:28.932234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda402c2-e473-4704-a360-789592aca051 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:28.932766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda402c2-e473-4704-a360-789592aca051 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:28.932901 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda402c2-e473-4704-a360-789592aca051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:28.962281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eda402c2-e473-4704-a360-789592aca051 None None] MFA Rules not processed for user `1fa684ff6c6c4beca6835a46dc9b7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:28.963414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eda402c2-e473-4704-a360-789592aca051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:29.035039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4462/8900] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 01:58:29.045135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7611a41-f15c-4b05-8845-89e8cfb6380b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:29.045709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7611a41-f15c-4b05-8845-89e8cfb6380b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:29.045709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7611a41-f15c-4b05-8845-89e8cfb6380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:29.065254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-a7611a41-f15c-4b05-8845-89e8cfb6380b None None] MFA Rules not processed for user `1fa684ff6c6c4beca6835a46dc9b7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:29.066491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a7611a41-f15c-4b05-8845-89e8cfb6380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:29.073921 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4439/8901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:58:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:29.086308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda402c2-e473-4704-a360-789592aca051 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:29.087737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eda402c2-e473-4704-a360-789592aca051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:29.173014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda402c2-e473-4704-a360-789592aca051 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:29.178804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:29.179524 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:29.179702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:29.179978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:29.188975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:29.190041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60e55-9da7-4836-96a1-7079b7a71c9d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:29.203377 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:29.210810 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4463/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:58:35.747818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfd56-16c7-4dd0-8049-722b59b37f19 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:35.748308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfd56-16c7-4dd0-8049-722b59b37f19 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:35.748416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfd56-16c7-4dd0-8049-722b59b37f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:35.786764 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-afdcfd56-16c7-4dd0-8049-722b59b37f19 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:35.788049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-afdcfd56-16c7-4dd0-8049-722b59b37f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:35.797260 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4440/8903] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:58:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:36.978947 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:36.979465 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:36.979553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:36.999644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:37.000850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:37.010102 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4464/8904] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 25 01:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:38.189118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5dae-249a-4c15-8de3-908c50f61bdb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:38.189722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5dae-249a-4c15-8de3-908c50f61bdb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:38.189722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5dae-249a-4c15-8de3-908c50f61bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:38.211914 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f92b5dae-249a-4c15-8de3-908c50f61bdb None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:38.213167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f92b5dae-249a-4c15-8de3-908c50f61bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:38.223716 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4441/8905] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:58:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:38.236178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:38.237848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:38.250169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979337b-a2c6-439f-9731-26d99edc1332 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:38.254078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:38.254684 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:38.254993 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:38.255262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:38.265965 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:38.267457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:38.278874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4465/8906] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 01:58:39.503283 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ee4e-40fd-4ad3-b5ef-de1d3658fbc6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:39.503803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ee4e-40fd-4ad3-b5ef-de1d3658fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:39.503916 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ee4e-40fd-4ad3-b5ef-de1d3658fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:39.525708 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-9730ee4e-40fd-4ad3-b5ef-de1d3658fbc6 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:58:39.526898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9730ee4e-40fd-4ad3-b5ef-de1d3658fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:58:39.538461 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4442/8907] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 01:58:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:58:39.549383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:58:39.558181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e11-64dc-4fc6-a07a-b0612c92384a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:58:39.561783 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:58:39.562371 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:58:39.562648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:58:39.562917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:58:39.573018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:58:39.574486 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:58:39.585799 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4466/8908] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:58:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:58:49.518327 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=38 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:49.580324 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=18 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:10.559912 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e96c-34db-4254-86cf-1cb871aafc7f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:10.560445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e96c-34db-4254-86cf-1cb871aafc7f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:10.560445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e96c-34db-4254-86cf-1cb871aafc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:10.596924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-7f65e96c-34db-4254-86cf-1cb871aafc7f None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:59:10.598151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7f65e96c-34db-4254-86cf-1cb871aafc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:10.605180 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4443/8909] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Sep 25 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:59:10.621012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:10.629650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b12a1-3c49-4b05-8133-bb7b01fe72d3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:10.633511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:10.634106 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:10.634391 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:10.634664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:10.641690 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:10.643133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:10.650985 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4467/8910] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:10.885016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00cc8-6d8c-410b-9c31-b87373d120ac None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:10.885590 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00cc8-6d8c-410b-9c31-b87373d120ac None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:10.885903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00cc8-6d8c-410b-9c31-b87373d120ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:10.907531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b1a00cc8-6d8c-410b-9c31-b87373d120ac None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:59:10.908762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b1a00cc8-6d8c-410b-9c31-b87373d120ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:10.916166 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4444/8911] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Sep 25 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:59:10.929746 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:10.938704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609434d2-533f-4806-8ebb-4be6d2bf9840 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:10.942558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:10.943155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:10.943437 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:10.943735 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:10.950890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:10.952324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:10.960160 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4468/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:11.669703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaf692-e6bf-4ec5-a554-9a7f7ecf06e6 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:11.670167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaf692-e6bf-4ec5-a554-9a7f7ecf06e6 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:11.670447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaf692-e6bf-4ec5-a554-9a7f7ecf06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:11.691755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3aeaf692-e6bf-4ec5-a554-9a7f7ecf06e6 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:59:11.692968 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3aeaf692-e6bf-4ec5-a554-9a7f7ecf06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:11.702963 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4445/8913] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:59:11.724535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:11.737936 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11a2c-0775-40cb-89f7-ceb4d47d3d7f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:11.744802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:11.745817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:11.746261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:11.746827 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:11.756701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:11.760050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:11.772532 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4469/8914] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:17.041068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf079-b323-46d4-9163-a6ff390b0f5b None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:17.041637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf079-b323-46d4-9163-a6ff390b0f5b None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:17.041751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf079-b323-46d4-9163-a6ff390b0f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:17.064771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-2ffbf079-b323-46d4-9163-a6ff390b0f5b None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:59:17.066121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-2ffbf079-b323-46d4-9163-a6ff390b0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:17.077327 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4446/8915] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 01:59:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:59:17.091917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:17.103383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45707-b10d-4e81-b635-f8be3c342eed service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:17.109480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:17.109962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:17.110240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:17.110510 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:17.120688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:17.122318 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:17.140913 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4470/8916] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:20.768251 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:20.768789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:20.768897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:20.797465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] MFA Rules not processed for user `1fa684ff6c6c4beca6835a46dc9b7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 01:59:20.799014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:20.806684 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4447/8917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 01:59:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 01:59:27.136285 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=24 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:30.792646 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=25 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:34.023698 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:34.043438 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f79c-25cc-4c15-8930-07bf0dad19ae service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:34.047123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:34.047721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:34.048002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:34.048276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:34.049994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:34.096543 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:34.098029 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962a4da-27c7-4953-a722-350dde46b20c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:34.111677 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4471/8918] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:34.172416 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 01:59:34.173917 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:34.260004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6f62e-d773-4d31-b7a9-991ab55c1922 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 01:59:34.264996 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 01:59:34.265629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 01:59:34.265915 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 01:59:34.266186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 01:59:34.267881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 01:59:34.279587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 01:59:34.281177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 01:59:34.291309 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4448/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 01:59:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 01:59:44.104309 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=24 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:44.287238 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=40 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:03.500768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:03.501328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:03.501328 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:03.534259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:03.535481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:03.546964 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4472/8920] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:00:03.580682 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:03.595051 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddc781-99c9-491f-8164-708726cea6ce service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:03.600833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:03.601486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:03.601779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:03.602055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:03.611630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:03.613229 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:03.625079 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4449/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:00:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:00:13.528989 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:13.620532 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:16.526739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:16.543843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5811-49de-4d96-8dbf-1af5acc80f36 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:16.550625 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:16.551360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:16.551757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:16.552736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] PATH_INFO: `/v3/users/1fa684ff6c6c4beca6835a46dc9b7938` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:16.554018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa684ff6c6c4beca6835a46dc9b7938)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:16.556046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:16.611457 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa684ff6c6c4beca6835a46dc9b7938'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.618998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa684ff6c6c4beca6835a46dc9b7938'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.632339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa684ff6c6c4beca6835a46dc9b7938'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.633104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa684ff6c6c4beca6835a46dc9b7938'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.633807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b581728e-288f-42ef-9fdd-6132839d5beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa684ff6c6c4beca6835a46dc9b7938'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.648726 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4473/8922] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:00:16 2022] DELETE /identity/v3/users/1fa684ff6c6c4beca6835a46dc9b7938 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:00:16.832691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:16.847014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb5da-b8cd-4fc8-93c1-0fd2ba890635 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:16.909105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:16.909778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:16.910058 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:16.910329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] PATH_INFO: `/v3/projects/779611b4d82845a48d34180747a77c16` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:16.911436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779611b4d82845a48d34180747a77c16)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:16.913386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:16.959162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779611b4d82845a48d34180747a77c16', 'request_id': 'req-f0ebac6e-f2f1-455a-b035-e4c1700a6315'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.965878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779611b4d82845a48d34180747a77c16', 'request_id': 'req-f0ebac6e-f2f1-455a-b035-e4c1700a6315'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.971534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779611b4d82845a48d34180747a77c16', 'request_id': 'req-f0ebac6e-f2f1-455a-b035-e4c1700a6315'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.984036 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] The token cache is being invalidate because project 779611b4d82845a48d34180747a77c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:00:16.984334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.984986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f0ebac6e-f2f1-455a-b035-e4c1700a6315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:00:16.986739 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4450/8923] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:00:16 2022] DELETE /identity/v3/projects/779611b4d82845a48d34180747a77c16 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:00:16.991960 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:16.992249 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:16.992527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.014527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:17.015789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:17.078805 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4474/8924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:17.088285 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.088582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.088861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.109094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:17.110356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:17.119253 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4451/8925] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:17.123478 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.133528 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53de1a-6ec6-4beb-a5f1-c1827ed41934 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.138113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.138717 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.139000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.139276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.139928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:00:17.140234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.141887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.153454 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4475/8926] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:00:17.157935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.167571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad5ea-6e38-4758-a42f-5d31754e4245 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.172253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.172845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.173128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.173426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.174067 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.175972 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.204127 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4452/8927] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 02:00:17.208341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.219167 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64633-574b-46ec-a525-494160cc698b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.276247 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.276851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.277136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.277434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.278079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.280046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.288842 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:17.305276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4476/8928] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:00:17 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:00:17.307077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.317347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c811-714b-480f-8a1c-7c087e49326a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.322934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.323534 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.323842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.324115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.324750 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.326385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.337186 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4453/8929] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:00:17.341126 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.351883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a330bfe-1d0f-4e83-8725-d83b6fab92ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.356576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.357178 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.357500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.357777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.358416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.360010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbc85-7f45-4d33-869b-4ed25ddb5a20 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.370673 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4477/8930] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:00:17.374888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.384930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b11e-d53e-47a3-af83-519c684d342a admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.389792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.390939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.390939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.391115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] PATH_INFO: `/v3/projects/33f8acaa10da4a938d2677f9d91ad6a6/users/8edfad57c63f4b89ace3e8fcab4a680b/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.408238 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f8acaa10da4a938d2677f9d91ad6a6, user_id=8edfad57c63f4b89ace3e8fcab4a680b, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.410961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.424661 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4454/8931] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:00:17 2022] PUT /identity/v3/projects/33f8acaa10da4a938d2677f9d91ad6a6/users/8edfad57c63f4b89ace3e8fcab4a680b/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:00:17.429885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c39-47ee-405b-aeca-b1abd24fe3c8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.430185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c39-47ee-405b-aeca-b1abd24fe3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.430468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c39-47ee-405b-aeca-b1abd24fe3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.449500 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0e9d9c39-47ee-405b-aeca-b1abd24fe3c8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:17.450708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e9d9c39-47ee-405b-aeca-b1abd24fe3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:17.511131 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4478/8932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:17.521028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:17.523501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:17.557394 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:17.587177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaef09-0d0a-43f0-aaa3-ac9b259f0997 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:17.590829 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:17.591433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:17.591713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:17.591983 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:17.600825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:17.602299 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:17.611874 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4455/8933] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:00:21.753760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ab98-574a-4013-a03f-b899d12ad0a0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:21.754282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ab98-574a-4013-a03f-b899d12ad0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:21.754282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ab98-574a-4013-a03f-b899d12ad0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:21.788334 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3872ab98-574a-4013-a03f-b899d12ad0a0 None None] MFA Rules not processed for user `8edfad57c63f4b89ace3e8fcab4a680b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:21.789788 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3872ab98-574a-4013-a03f-b899d12ad0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:21.861366 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4479/8934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:00:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:21.876498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:21.878057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:21.964147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827879-9971-4427-b9d2-285315f6fdb7 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:21.971103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:21.971707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:21.971987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:21.972262 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:21.981489 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:21.983372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439fbcf-0ae8-4323-adc2-cedb5be4a2c0 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:21.994111 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4456/8935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:00:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:00:23.314058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:23.314574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:23.314680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:23.334134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] MFA Rules not processed for user `8edfad57c63f4b89ace3e8fcab4a680b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:23.335888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:23.342988 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4480/8936] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:00:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:23.670865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eddc95-5f0d-4c85-af19-d298522e7e77 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:23.671392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eddc95-5f0d-4c85-af19-d298522e7e77 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:23.671471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eddc95-5f0d-4c85-af19-d298522e7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:23.692158 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-49eddc95-5f0d-4c85-af19-d298522e7e77 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:00:23.693302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49eddc95-5f0d-4c85-af19-d298522e7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:00:23.700670 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4457/8937] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:00:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:00:23.713738 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:00:23.723397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27156-be12-4b7a-93e9-30a6c0993fcd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:00:23.727497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:00:23.728112 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:00:23.728392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:00:23.728679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:00:23.736075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:00:23.737739 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7691dd-0178-4c56-96fc-6c0232b7c464 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:00:23.747281 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4481/8938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:00:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:00:33.686927 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=54 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:33.742526 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:44.533301 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:01:44.533800 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:01:44.534078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:01:44.553513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] MFA Rules not processed for user `8edfad57c63f4b89ace3e8fcab4a680b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:01:44.554796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:01:44.562033 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4458/8939] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:01:44.869046 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:01:44.869615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:01:44.869615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:01:44.900991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:01:44.902219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:01:44.909032 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4482/8940] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:01:44.920857 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:01:44.931252 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525b30-f276-49da-a025-9bdd7900e8bd None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:01:44.934813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:01:44.935402 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:01:44.935680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:01:44.935949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:01:44.943828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:01:44.945250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:01:44.953120 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4459/8941] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:01:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:01:54.896145 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:54.949489 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:31.233011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:02:31.234439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:02:31.315015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898452aa-f488-4bfd-92e5-8d55f1c4e6a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:02:31.320181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:02:31.320789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:02:31.321071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:02:31.321347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:02:31.323070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:02:31.334815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:02:31.336398 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d5248-3b31-48f7-b6f5-e0782c208b1f service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:02:31.346613 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4483/8942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:02:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:02:34.371728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:02:34.384615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08be3-846c-439b-bf05-1a71553edef3 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:02:34.389687 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:02:34.390456 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:02:34.390700 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:02:34.390976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:02:34.392734 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:02:34.404309 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:02:34.405931 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:02:34.416213 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4460/8943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:02:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:02:41.341998 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=37 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:44.412000 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:09.773922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:09.774555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:09.774555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:09.798596 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:03:09.799927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:09.806753 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4484/8944] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:03:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:03:09.820650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:03:09.830100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d93e7-3031-462b-8307-a4fb16595024 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:03:09.833854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:03:09.834457 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:09.834792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:09.835119 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:09.842627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:03:09.844662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e7267-a969-4c0d-a18b-e74d7ce761c7 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:03:09.852994 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4461/8945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:03:09.963116 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:03:09.964545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:09.979534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c57dd-9e97-4413-9d2c-5aa7354905d5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:03:09.985254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:03:09.985982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:09.986263 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:09.986531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:09.988187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:09.999269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:03:10.000846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:03:10.010547 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4485/8946] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:03:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:03:19.849357 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:20.006419 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:25.127472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:25.127997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:25.128106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:25.147585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] MFA Rules not processed for user `8edfad57c63f4b89ace3e8fcab4a680b`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:03:25.148776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:25.155554 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4462/8947] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:03:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:03:25.781989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:03:25.792756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643725-296f-4d9d-b238-089145cea7e5 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:03:25.798520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:03:25.799272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:25.799552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:25.799822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:25.801664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:25.815267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:03:25.816889 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:03:25.827259 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4486/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:03:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:03:35.142653 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:35.823418 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:39.014302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:03:39.024049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bbe38-0039-46e6-9d00-c64a5f76938e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:03:39.028013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:03:39.028607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:03:39.028890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:03:39.029179 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:03:39.030898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:03:39.057673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:03:39.059047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac20916-ce32-49af-a010-74e6d30b2760 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:03:39.069755 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4463/8949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:03:49.065286 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:41.967362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:04:41.977636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9758c3-1869-4555-a3fe-1f830f43375d service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:04:41.981286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:04:41.981930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:41.982210 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:41.982490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:41.984224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:41.999529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:04:42.001027 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:04:42.012415 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4487/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:04:42.185490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673829-4579-49e9-83b8-87d81732e88d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:42.185953 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673829-4579-49e9-83b8-87d81732e88d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:42.186055 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673829-4579-49e9-83b8-87d81732e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:42.207146 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-08673829-4579-49e9-83b8-87d81732e88d None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:04:42.208349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-08673829-4579-49e9-83b8-87d81732e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:42.217668 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4464/8951] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:04:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:04:42.228054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:04:42.229518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:42.240678 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7732d1-4b12-4357-9597-21295465376a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:04:42.244308 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:04:42.244899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:42.245179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:42.245481 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:42.256051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:04:42.257561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:04:42.268610 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4488/8952] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:04:42.330306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673829-4579-49e9-83b8-87d81732e88d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:04:42.341920 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673829-4579-49e9-83b8-87d81732e88d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:04:42.346973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:04:42.347588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:42.347869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:42.348140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:42.349868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:42.362068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:04:42.363834 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:04:42.373436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4465/8953] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:04:43.448272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:04:43.457811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbb91-e7bf-48dc-8531-8c3f058195c6 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:04:43.461506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:04:43.462104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:43.462387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:43.462662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:43.464413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:43.473900 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:04:43.475366 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:04:43.483380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4489/8954] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:04:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:04:52.369422 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:53.479832 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=18 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:56.525044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:04:56.534549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fea4-68e6-4a4f-8974-1c68669ca5b5 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:04:56.538218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:04:56.538808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:04:56.539087 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:04:56.539359 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:04:56.541089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:04:56.550932 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:04:56.552371 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:04:56.560846 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4466/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:05:03.896702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:05:03.913914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94927-486a-4f7e-bf70-92747fc51b13 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:05:03.920768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:05:03.921583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:05:03.921869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:05:03.922141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:05:03.924056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:05:03.936763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:05:03.938434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d62b-e8cd-4546-82c1-4a8112cc421c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:05:03.950846 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4490/8956] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:05:04.544344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:05:04.546136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:05:04.563502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda9bc-34d4-49fd-8029-a87a784f8bbb service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:05:04.569893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:05:04.570539 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:05:04.570823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:05:04.571123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:05:04.572846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:05:04.585748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:05:04.587354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:05:04.598596 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4467/8957] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:05:13.835576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:05:13.836014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:05:13.836014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:05:13.855103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] MFA Rules not processed for user `8edfad57c63f4b89ace3e8fcab4a680b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:05:13.856300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:05:13.863821 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4491/8958] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:05:14.593692 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=12 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:17.123315 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:05:17.136392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b2489-e8f0-43ae-b898-92f4b2fdf3ea service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:05:17.143601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:05:17.144464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:05:17.144745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:05:17.144997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:05:17.146790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:05:17.160316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:05:17.162269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:05:17.174788 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4468/8959] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:05:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:05:22.540451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:05:22.553261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7485ef-c859-4918-a4f7-cd98c8d92e0c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:05:22.559208 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:05:22.560090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:05:22.560090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:05:22.560365 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:05:22.569887 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:05:22.571547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d4741-5ab4-4c8f-b036-c82f1979e3fa service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:05:22.581903 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4492/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:05:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:05:27.174868 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:32.576673 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=15 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:24.899273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:24.918633 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b9a8e-1835-4291-9fcf-fd255cfe5a5d service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:24.922265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:24.922860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:24.923139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:24.923409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:24.932324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:24.933783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:24.961092 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4469/8961] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:27.828533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:27.829775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:27.830429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:27.901057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:27.902350 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:27.904948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:27.919094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1174-5cd4-45b3-b991-a572cff47003 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:27.927083 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4493/8962] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:07:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:27.934037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:27.934528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:27.934846 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:27.935143 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] PATH_INFO: `/v3/users/8edfad57c63f4b89ace3e8fcab4a680b` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:27.936496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edfad57c63f4b89ace3e8fcab4a680b)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:27.938516 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:27.957347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:27.968635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0661-816d-49fa-8e40-ee19d0292590 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:27.974320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:27.975032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:27.975394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:27.975850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:27.985025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:27.986699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:27.988320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edfad57c63f4b89ace3e8fcab4a680b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:27.988978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edfad57c63f4b89ace3e8fcab4a680b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:27.997057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edfad57c63f4b89ace3e8fcab4a680b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.003226 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4494/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:28.009804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edfad57c63f4b89ace3e8fcab4a680b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.010513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0da1faa6-1fef-4d3a-8890-9719e08a4f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edfad57c63f4b89ace3e8fcab4a680b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.024948 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4470/8964] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:07:27 2022] DELETE /identity/v3/users/8edfad57c63f4b89ace3e8fcab4a680b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:07:28.202689 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.214059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bb01-5455-4611-93e3-7396f14bc652 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.271536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.272175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.272530 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.272808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] PATH_INFO: `/v3/projects/33f8acaa10da4a938d2677f9d91ad6a6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.273963 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f8acaa10da4a938d2677f9d91ad6a6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.275881 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.322153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f8acaa10da4a938d2677f9d91ad6a6', 'request_id': 'req-03bb9002-703d-4fb8-94ab-c5e00bf210ef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.328122 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f8acaa10da4a938d2677f9d91ad6a6', 'request_id': 'req-03bb9002-703d-4fb8-94ab-c5e00bf210ef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.333655 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f8acaa10da4a938d2677f9d91ad6a6', 'request_id': 'req-03bb9002-703d-4fb8-94ab-c5e00bf210ef'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.358666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] The token cache is being invalidate because project 33f8acaa10da4a938d2677f9d91ad6a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:07:28.358959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.359576 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-03bb9002-703d-4fb8-94ab-c5e00bf210ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:07:28.361057 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4495/8965] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:07:28 2022] DELETE /identity/v3/projects/33f8acaa10da4a938d2677f9d91ad6a6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:07:28.366812 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.367175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.367623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.415991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:28.417215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:28.480744 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4471/8966] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:28.488660 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.488951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.489229 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.509370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:28.510633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:28.518607 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4496/8967] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:28.523711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.534224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93921f-ec44-464f-ba68-23544eacc34e None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.539697 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.540305 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.540591 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.540868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.541559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:07:28.541862 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.543478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.553224 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:28.557719 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4472/8968] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:07:28.562561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.571995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18adb-493e-41c5-8812-10929df0c693 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.576922 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.577502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.577784 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.578056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.578714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.580633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.602870 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:28.619685 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4497/8969] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:07:28 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:07:28.624280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.634969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b97f5-10c2-4fa7-acaa-c5794448e84b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.692808 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.693420 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.693718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.693993 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.694843 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.696762 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.718636 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4473/8970] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:07:28 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:07:28.722836 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.734159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17859d45-0fa3-4e07-9adb-c81bed7f8f29 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.738817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.739416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.739711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.739976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.740616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.742421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.752423 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4498/8971] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:07:28.756324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.766389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0122ea-2536-4bcf-9b59-2a3c657f49ba admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.771069 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.771658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.771936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.772207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.773511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.775128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b139-1078-4f25-b6f7-f0005a6cad1e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.786063 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4474/8972] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:07:28.791269 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.801359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d5e74-0033-40f2-9084-174782abdaf6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.806429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.807074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.807359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.807665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] PATH_INFO: `/v3/projects/db37cf1c523e4b3d80845b512bfa4045/users/9d822638f4cd4770905d6551e669d4c3/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.822770 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db37cf1c523e4b3d80845b512bfa4045, user_id=9d822638f4cd4770905d6551e669d4c3, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:28.825456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:28.838908 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4499/8973] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:07:28 2022] PUT /identity/v3/projects/db37cf1c523e4b3d80845b512bfa4045/users/9d822638f4cd4770905d6551e669d4c3/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:07:28.844080 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d9e3-92f8-4285-a1b6-f2cc64ed5536 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.844373 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d9e3-92f8-4285-a1b6-f2cc64ed5536 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.844652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d9e3-92f8-4285-a1b6-f2cc64ed5536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:28.864237 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fcc5d9e3-92f8-4285-a1b6-f2cc64ed5536 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:28.865479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fcc5d9e3-92f8-4285-a1b6-f2cc64ed5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:28.923769 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4475/8974] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:28.933608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:28.935329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:28.992133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783aa1-9c40-4928-8398-135176a699e4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:28.995884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:28.996489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:28.996769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:28.997042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:29.006070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:29.008336 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b012b0-08b2-4696-a5e2-3d5ec2922d2e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:29.017749 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4500/8975] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:33.029763 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:33.030523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:33.030523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:33.060149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] MFA Rules not processed for user `9d822638f4cd4770905d6551e669d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:33.061365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:33.145468 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4476/8976] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:33.157841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:33.158389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:33.158389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:33.179642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] MFA Rules not processed for user `9d822638f4cd4770905d6551e669d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:33.181159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:33.188494 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4501/8977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:33.203000 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:33.204411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:33.216707 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:33.298899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c64d5-a24a-44fb-85a5-9a6e2465ce24 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:33.304632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:33.305282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:33.305603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:33.305942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:33.314646 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:33.316566 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:33.327410 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4477/8978] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:33.599037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:33.608974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e11eb-71da-4f7d-9b63-13754a474738 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:33.612674 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:33.613289 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:33.613758 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:33.614058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:33.615803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:33.625976 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:33.627431 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:33.636355 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4502/8979] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:34.501017 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:34.503154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:34.584108 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1075-e70b-4220-a336-b453e74aae32 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:34.592088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:34.592707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:34.593180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:34.593498 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:34.595277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:34.610441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:34.612106 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b64b-e9f6-499e-b91d-bd4464a62948 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:34.625600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4478/8980] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:38.228913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:07:38.230347 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:38.246035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a36d8-9504-4b03-b32d-81500523ed25 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:07:38.251133 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:07:38.251761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:38.252042 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:38.252317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:38.254015 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:38.265569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:07:38.267152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:07:38.277586 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4503/8981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:07:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:07:44.619538 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=66 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:45.926961 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4659f2-b062-462f-806e-b0f81432e04a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:07:45.927589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4659f2-b062-462f-806e-b0f81432e04a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:07:45.927589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4659f2-b062-462f-806e-b0f81432e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:07:45.948066 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-bd4659f2-b062-462f-806e-b0f81432e04a None None] MFA Rules not processed for user `9d822638f4cd4770905d6551e669d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:07:45.949310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-bd4659f2-b062-462f-806e-b0f81432e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:07:45.956257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4479/8982] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:07:48.273396 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:55.941862 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:01.692590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:01.702452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169d22-a487-43c5-b3ef-4d17e521eb20 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:01.706071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:01.706667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:01.706940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:01.707206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:01.709392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:01.719868 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:01.722601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:01.736238 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4504/8983] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:08.867317 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:08.867890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:08.867890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:08.893464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] MFA Rules not processed for user `d9805de18a574ac1bba25ba2a64ebae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:08.895270 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:08.906450 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4480/8984] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:08:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:08.935999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:08.950085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:08.957687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecbec-d0b5-428e-9dc2-ad0051fc4b3e service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:08.964222 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:08.965010 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:08.965573 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:08.966238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:08.970637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e917-2e76-483c-98ac-e16a00b6aadb None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:08.976294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:08.976832 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:08.977004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:08.977216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:08.977559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] PATH_INFO: `/v3/users/9d822638f4cd4770905d6551e669d4c3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:08.978728 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d822638f4cd4770905d6551e669d4c3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:08.978842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:08.980672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:08.989602 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4505/8985] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:09.037991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d822638f4cd4770905d6551e669d4c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.038737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d822638f4cd4770905d6551e669d4c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.047295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d822638f4cd4770905d6551e669d4c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.060787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d822638f4cd4770905d6551e669d4c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.061658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d1e4b9f8-d58e-44c2-bcff-f95b946685fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d822638f4cd4770905d6551e669d4c3'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.077498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4481/8986] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:08:08 2022] DELETE /identity/v3/users/9d822638f4cd4770905d6551e669d4c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:08:09.258174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.269973 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b9d6b-b7e3-4e26-81fc-0410b934f146 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.329525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.330169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.330452 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.330728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] PATH_INFO: `/v3/projects/db37cf1c523e4b3d80845b512bfa4045` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.331853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db37cf1c523e4b3d80845b512bfa4045)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.334368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.386417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db37cf1c523e4b3d80845b512bfa4045', 'request_id': 'req-9f6eb584-d863-4585-9434-3b7056b8741e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.393197 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db37cf1c523e4b3d80845b512bfa4045', 'request_id': 'req-9f6eb584-d863-4585-9434-3b7056b8741e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.399566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db37cf1c523e4b3d80845b512bfa4045', 'request_id': 'req-9f6eb584-d863-4585-9434-3b7056b8741e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.412162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] The token cache is being invalidate because project db37cf1c523e4b3d80845b512bfa4045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:08:09.412415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.413054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6eb584-d863-4585-9434-3b7056b8741e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:09.414622 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4506/8987] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:08:09 2022] DELETE /identity/v3/projects/db37cf1c523e4b3d80845b512bfa4045 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:09.419787 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.420103 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.420387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.440362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:09.441615 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:09.501942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4482/8988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:09.510866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.511252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.511537 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.532026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:09.533257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:09.542293 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4507/8989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:09.547205 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.557274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091003e9-923b-4960-8c77-f69ab28f777f None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.562032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.562645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.562934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.563212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.563863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:08:09.564171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.565837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.578604 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4483/8990] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:08:09.584343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.594446 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef6b9-1775-444f-97f0-c03ab1de98a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.599177 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.599981 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.600253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.600519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.601153 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.603092 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.630295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4508/8991] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:08:09 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 02:08:09.635152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.645531 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef4ce-a6ea-49ad-8b09-cbd405d853b9 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.699163 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:09.710155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.710774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.711056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.711329 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.711971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.713945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.735932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4484/8992] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:08:09 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:09.740822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.751728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c81c-c961-49da-9f08-768908a19107 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.757038 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.757679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.757959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.758234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.758902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.760522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.770862 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4509/8993] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:09.775221 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.785554 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cb75-fcad-4455-bb9a-75a06e50b1de admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.790314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.790913 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.791194 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.791469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.792112 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.793749 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e92204-71a5-42c2-bea1-62dbda8296b2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.805264 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4485/8994] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:09.809636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.820649 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9896-d6e5-4343-ae7d-67c415600de7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:09.825588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:09.826250 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.826532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.826809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] PATH_INFO: `/v3/projects/34648dd7a06542ca9c625f3c72ea345c/users/80a7d2ae7fb54d9c865e9bb697449629/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.842659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34648dd7a06542ca9c625f3c72ea345c, user_id=80a7d2ae7fb54d9c865e9bb697449629, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:09.845341 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:09.859579 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:09.866376 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4510/8995] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:08:09 2022] PUT /identity/v3/projects/34648dd7a06542ca9c625f3c72ea345c/users/80a7d2ae7fb54d9c865e9bb697449629/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:09.878374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:09.878889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:09.879052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:09.907876 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] MFA Rules not processed for user `80a7d2ae7fb54d9c865e9bb697449629`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:09.909011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:09.974831 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4486/8996] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:09.985139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:09.986953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:10.045492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57d19-9c59-4dd3-945e-e3f2333ada32 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:10.049138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:10.049782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:10.050063 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:10.050331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:10.059876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:10.061320 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ae0c-8235-4c26-ac7f-580d9de4817a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:10.072295 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4511/8997] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:19.971713 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:20.066474 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=26 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:20.933002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:20.998699 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1396e-8a69-485d-b28b-3ccc770b5f41 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.003378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.004040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.004342 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.004599 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] PATH_INFO: `/v3/users/80a7d2ae7fb54d9c865e9bb697449629` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.006503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a7d2ae7fb54d9c865e9bb697449629)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.008447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.055463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a7d2ae7fb54d9c865e9bb697449629'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.056053 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a7d2ae7fb54d9c865e9bb697449629'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.064076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a7d2ae7fb54d9c865e9bb697449629'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.076634 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a7d2ae7fb54d9c865e9bb697449629'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.077340 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a7d2ae7fb54d9c865e9bb697449629'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.090628 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4487/8998] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:08:20 2022] DELETE /identity/v3/users/80a7d2ae7fb54d9c865e9bb697449629 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:21.095309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.095790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.095885 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.115939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:21.117087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:21.175070 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4512/8999] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:08:21.185542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.187014 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:21.246535 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec99f-4a69-4518-b82f-3d4afc29e795 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.250259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.250869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.251148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.251419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.261616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.263068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fafbb-cffb-43da-8aa4-f7b0db6a2bcc service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.272683 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4488/9000] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:21.449507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.451044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:21.466451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec353-8b93-41d6-a753-58e8a35e9ec3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.471163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.471817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.472100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.472374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] PATH_INFO: `/v3/projects/34648dd7a06542ca9c625f3c72ea345c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.474450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34648dd7a06542ca9c625f3c72ea345c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.476535 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.526636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34648dd7a06542ca9c625f3c72ea345c', 'request_id': 'req-78bbc559-51b2-4da7-92ad-b9f6d1832e34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.532906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34648dd7a06542ca9c625f3c72ea345c', 'request_id': 'req-78bbc559-51b2-4da7-92ad-b9f6d1832e34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.539187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34648dd7a06542ca9c625f3c72ea345c', 'request_id': 'req-78bbc559-51b2-4da7-92ad-b9f6d1832e34'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.551864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] The token cache is being invalidate because project 34648dd7a06542ca9c625f3c72ea345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:08:21.552270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.553154 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78bbc559-51b2-4da7-92ad-b9f6d1832e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:21.554871 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4513/9001] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:08:21 2022] DELETE /identity/v3/projects/34648dd7a06542ca9c625f3c72ea345c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:21.560741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.561052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.561466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.584707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:21.586193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:21.603748 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:21.656072 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4489/9002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:21.664572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.664890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.665168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.686139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:21.687381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:21.695529 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4514/9003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:21.700064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.710336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41573f94-3e3b-4c37-bec8-b97d244e90a5 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.714994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.715598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.715875 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.716144 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.716788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:08:21.717089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.718720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.731187 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4490/9004] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 25 02:08:21.735875 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.747236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472cd80-58f2-4dbe-bf15-35d7d41adc6c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.752527 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.753282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.753585 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.753862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.754630 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.757211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.789584 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4515/9005] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:21.794145 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.804557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424197-6c80-4185-8bc6-fb4edd3a71e3 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.862831 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.863445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.863732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.864007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.865035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.867027 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.892141 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4491/9006] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:08:21 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:21.893425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.905186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d04c0-5077-48f8-89a5-89fb61925100 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.910306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.910858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.911140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.912159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.912933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.914588 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.928279 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4516/9007] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:21.929680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.940943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9b48-d579-471d-9dde-c908bcd01e00 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.946030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.946731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.947132 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.947472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.948267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:21.949986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31520-4f22-49a0-aedd-94a2f027463e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:21.961528 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4492/9008] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:21.965771 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:21.976563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166ed9-c471-4db6-adf0-2b3daf56b2c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:21.981223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:21.981949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:21.982237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:21.982513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] PATH_INFO: `/v3/projects/b28cea8a84d34603be407def1ceab83c/users/fa98d399c4774f5a92424f27d1817fef/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:21.997664 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28cea8a84d34603be407def1ceab83c, user_id=fa98d399c4774f5a92424f27d1817fef, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:22.000349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:22.013743 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4517/9009] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:08:21 2022] PUT /identity/v3/projects/b28cea8a84d34603be407def1ceab83c/users/fa98d399c4774f5a92424f27d1817fef/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:08:22.024759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:22.025264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:22.025358 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:22.054799 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] MFA Rules not processed for user `fa98d399c4774f5a92424f27d1817fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:22.056010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:22.122930 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4493/9010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:22.133590 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:22.135386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:22.158141 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:22.198003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7019c6-8256-4d1e-a089-057ba037e9af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:22.201665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:22.202275 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:22.202551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:22.202821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:22.212022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:22.213496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74856-6e26-4532-b118-5c2a5d3984d4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:22.222404 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4518/9011] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:26.578129 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:26.597943 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:26.645702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355af347-a23f-4756-bd20-dc7b2a3d616a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:26.650235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:26.650870 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:26.651148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:26.651447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] PATH_INFO: `/v3/users/fa98d399c4774f5a92424f27d1817fef` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:26.652561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa98d399c4774f5a92424f27d1817fef)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:26.654527 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:26.700988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa98d399c4774f5a92424f27d1817fef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:26.701747 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa98d399c4774f5a92424f27d1817fef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:26.708842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa98d399c4774f5a92424f27d1817fef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:26.720758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa98d399c4774f5a92424f27d1817fef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:26.721477 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa98d399c4774f5a92424f27d1817fef'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:26.734991 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4494/9012] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:08:26 2022] DELETE /identity/v3/users/fa98d399c4774f5a92424f27d1817fef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:26.740214 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:26.740785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:26.740785 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:26.760256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:26.761425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:26.823120 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4519/9013] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:26.832934 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:26.834606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:26.892793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2257-3a5e-4b03-b2b2-6db2e819a2c8 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:26.896627 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:26.897239 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:26.897552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:26.897826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:26.907188 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:26.908632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16651a-0de1-4356-89d3-650aac8b8eba service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:26.919489 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4495/9014] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:27.095693 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.097237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:27.113676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef7c13-961d-4f4e-885b-9ba065f1178b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.120487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.121532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.121959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.122317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] PATH_INFO: `/v3/projects/b28cea8a84d34603be407def1ceab83c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.123645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28cea8a84d34603be407def1ceab83c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.126146 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.176346 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28cea8a84d34603be407def1ceab83c', 'request_id': 'req-400dde42-297f-4a27-993d-34bbbc7e503f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:27.183031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28cea8a84d34603be407def1ceab83c', 'request_id': 'req-400dde42-297f-4a27-993d-34bbbc7e503f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:27.188754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28cea8a84d34603be407def1ceab83c', 'request_id': 'req-400dde42-297f-4a27-993d-34bbbc7e503f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:27.201309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] The token cache is being invalidate because project b28cea8a84d34603be407def1ceab83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:08:27.201624 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:27.202252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-400dde42-297f-4a27-993d-34bbbc7e503f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:08:27.203782 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4520/9015] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:08:27 2022] DELETE /identity/v3/projects/b28cea8a84d34603be407def1ceab83c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:27.209639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.209921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.210196 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.230271 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:27.231466 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:27.264409 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:27.293687 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4496/9016] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:27.302978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.303259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.303534 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.323804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:27.325018 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:27.332989 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4521/9017] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:27.338030 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.347868 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a201-8c84-4670-809b-0779d40bc934 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.353202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.353842 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.354125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.354426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.355071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:08:27.355372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.356975 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.368952 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4497/9018] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:08:27.373518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.383682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9006e-b924-4e55-9e84-54a3907faf18 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.388466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.389081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.389360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.390166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.390282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.392245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.424493 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4522/9019] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:08:27 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 02:08:27.429323 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.439552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f29dc-f56e-47b5-994a-04a43e738afe admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.496298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.496906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.497190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.497492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.498116 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.500041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.521870 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4498/9020] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:08:27 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:27.526001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.537184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10973e04-382c-461a-8ebd-e026a28325b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.541929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.542533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.542815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.543090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.544397 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.546040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.556067 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4523/9021] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:27.559985 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.570636 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f988-eb9b-4418-9d8b-57ea5b51e81f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.575263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.575865 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.576175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.576450 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.577088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.578757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca43742-a97b-44af-ae0f-9f15324df131 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.591108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4499/9022] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:08:27.596062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.607002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3c5-ce13-40d6-9d18-37e23c4fec08 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.611571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.612215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.612493 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.612761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] PATH_INFO: `/v3/projects/bd7e342e28b54ef283747d50e865f50a/users/4dff958dd34144d89a23f45762e76e8d/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.615124 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:27.630416 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7e342e28b54ef283747d50e865f50a, user_id=4dff958dd34144d89a23f45762e76e8d, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.633514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.646833 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4524/9023] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:08:27 2022] PUT /identity/v3/projects/bd7e342e28b54ef283747d50e865f50a/users/4dff958dd34144d89a23f45762e76e8d/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:27.652136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b54fa-906d-4059-9087-4abe6dedd50e None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.652426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b54fa-906d-4059-9087-4abe6dedd50e None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.652702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b54fa-906d-4059-9087-4abe6dedd50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.672335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6a1b54fa-906d-4059-9087-4abe6dedd50e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:27.673585 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a1b54fa-906d-4059-9087-4abe6dedd50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:27.733937 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4500/9024] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:27.744093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:27.745840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:27.806938 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea63a-0c07-4916-a6ed-d0f3e03e7b67 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:27.810568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:27.811174 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:27.811454 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:27.811727 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:27.821860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:27.823313 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:27.833457 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4525/9025] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:32.037545 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.038113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.038113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.069991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] MFA Rules not processed for user `4dff958dd34144d89a23f45762e76e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:32.071216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:32.107909 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:32.143292 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4501/9026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:32.148019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.158266 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557a546-bec9-446c-be8d-e629905cd296 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.164373 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.165104 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.165496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.165846 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.166555 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.168563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.201438 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4526/9027] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:08:32 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:32.203280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.214948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d276a9-9346-466a-9cf9-da351dc9cbcf None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.278690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.279320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.279603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.279879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.280515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.282513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.313384 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4502/9028] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:08:32 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:08:32.318036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.329295 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3b312-bf83-4c15-8497-c4f448547896 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.335168 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.335790 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.336072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.336345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.337000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.338685 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.351700 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4527/9029] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 02:08:32.356078 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.366970 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c219-2efb-4896-8023-1eeec51ad24d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.371811 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.372488 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.372766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.373038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] PATH_INFO: `/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5/users/7c600f693d1949dc8f3e3e366057ceed/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.393680 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477ed2377e2c4279ab552fd3ba63b3b5, user_id=7c600f693d1949dc8f3e3e366057ceed, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.397033 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.416871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4503/9030] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:08:32 2022] PUT /identity/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5/users/7c600f693d1949dc8f3e3e366057ceed/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:08:32.417583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.428359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cced1-7395-44c4-bc2b-72d7fc5c9742 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.492613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.493756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.494262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.494774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.495583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.497928 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46216b25-46fd-49e2-b25c-02f94b8d3f36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.513451 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4528/9031] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 02:08:32.516356 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:32.528738 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae52f-19f9-4dd9-832e-225a6d490cd7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:32.534313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:32.535377 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:32.535773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:32.536766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] PATH_INFO: `/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5/users/7c600f693d1949dc8f3e3e366057ceed/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:32.538893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477ed2377e2c4279ab552fd3ba63b3b5, user_id=7c600f693d1949dc8f3e3e366057ceed, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:32.541664 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:32.554434 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4504/9032] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:08:32 2022] PUT /identity/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5/users/7c600f693d1949dc8f3e3e366057ceed/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:08:37.429343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe401-a74d-49b6-a8eb-cc28186e92be None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:37.429933 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe401-a74d-49b6-a8eb-cc28186e92be None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:37.430302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe401-a74d-49b6-a8eb-cc28186e92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:37.476255 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d62fe401-a74d-49b6-a8eb-cc28186e92be None None] MFA Rules not processed for user `7c600f693d1949dc8f3e3e366057ceed`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:37.477838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d62fe401-a74d-49b6-a8eb-cc28186e92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:37.526314 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.564378 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4529/9033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:37.581042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:37.583883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:37.671624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c57c-083d-4d91-92e6-65e068686167 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:37.677925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:37.678593 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:37.678874 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:37.679141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:37.705949 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.741888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:37.743598 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:37.753475 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4505/9034] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:37.827975 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:37.828267 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:37.828548 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:37.849950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] MFA Rules not processed for user `4dff958dd34144d89a23f45762e76e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:37.851204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:37.859994 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4530/9035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:38.455963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:38.457928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:38.547044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bf644-667d-4eec-9bb1-f79b503ccc4b service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:38.554691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:38.555367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:38.555647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:38.555925 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:38.557714 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:38.570475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:38.572002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982904-7fc1-4cd6-a0fe-0085e631a3de service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:38.582782 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4506/9036] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:39.574971 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:39.576688 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:39.636298 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a14872-144e-4ff0-9e7b-8e2f3352dc6c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:39.640004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:39.641111 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:39.641394 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:39.641697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:39.643445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:39.658175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:39.659616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:39.672658 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4531/9037] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:08:48.577747 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=48 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:49.532867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e1f5-83e2-426e-be37-4e18faa00361 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:49.533149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e1f5-83e2-426e-be37-4e18faa00361 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:49.533449 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e1f5-83e2-426e-be37-4e18faa00361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:49.585217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-3ad8e1f5-83e2-426e-be37-4e18faa00361 None None] MFA Rules not processed for user `fe9dafd81a8947f79616064549817153`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:08:49.586472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3ad8e1f5-83e2-426e-be37-4e18faa00361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:08:49.646321 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4507/9038] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 25 02:08:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:08:49.652389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:08:49.661763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa3bde-12e1-4be5-ab5c-9c3b00dc34fe service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:08:49.665319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:08:49.665945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:08:49.666224 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:08:49.666497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:08:49.675264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:08:49.677343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae79-5f24-4be8-b2df-7f877eea709d service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:08:49.686761 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4532/9039] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:08:59.643219 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=38 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:59.682470 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=47 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:14.880374 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:09:14.880909 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:09:14.881026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:09:14.899689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] MFA Rules not processed for user `4dff958dd34144d89a23f45762e76e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:09:14.900889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:09:14.907756 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4508/9040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:09:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:09:24.894720 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:43.120113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658511-1244-4774-ba12-fd8758e09cda None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:09:43.120610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658511-1244-4774-ba12-fd8758e09cda None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:09:43.120720 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658511-1244-4774-ba12-fd8758e09cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:09:43.150506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9658511-1244-4774-ba12-fd8758e09cda None None] MFA Rules not processed for user `fe9dafd81a8947f79616064549817153`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:09:43.151709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9658511-1244-4774-ba12-fd8758e09cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:09:43.177543 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4533/9041] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 25 02:09:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:09:43.183663 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:09:43.196703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e82d23-2bac-4990-b55a-f56b8268cad8 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:09:43.200367 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:09:43.201165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:09:43.201486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:09:43.201759 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:09:43.203469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:09:43.237879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:09:43.239320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:09:43.250641 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4509/9042] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:09:50.389782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:09:50.390337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:09:50.390337 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:09:50.410142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] MFA Rules not processed for user `4dff958dd34144d89a23f45762e76e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:09:50.412209 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:09:50.419219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4534/9043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:09:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:09:52.740761 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:09:52.750786 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89ae-d934-4ee8-96d5-16d4d60f42c6 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:09:52.755604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:09:52.756220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:09:52.756512 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:09:52.756778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:09:52.758691 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:09:52.769172 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:09:52.770860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:09:52.780119 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4510/9044] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:09:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:10:00.405262 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=19 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:02.776499 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=23 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:26.797329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:26.819372 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f982-60f3-4ecb-8a6a-0838f2507409 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:26.825489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:26.826114 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:26.826390 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:26.826662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:26.828533 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:26.842789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:26.844480 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:26.856402 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4535/9045] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:10:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:10:34.274860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:34.344190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608635-0292-4e2b-b1a7-3655645269a9 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:34.349072 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:34.349788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:34.350073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:34.350484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] PATH_INFO: `/v3/users/4dff958dd34144d89a23f45762e76e8d` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:34.351658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dff958dd34144d89a23f45762e76e8d)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:34.353679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:34.414675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dff958dd34144d89a23f45762e76e8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.415321 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dff958dd34144d89a23f45762e76e8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.423964 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dff958dd34144d89a23f45762e76e8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.436830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dff958dd34144d89a23f45762e76e8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.437608 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dff958dd34144d89a23f45762e76e8d'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.450807 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4511/9046] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:10:34 2022] DELETE /identity/v3/users/4dff958dd34144d89a23f45762e76e8d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:10:34.655949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:34.672417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacf39f-80e2-4fd6-886f-157cd041e0f3 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:34.739525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:34.739789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:34.740028 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:34.740301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] PATH_INFO: `/v3/projects/bd7e342e28b54ef283747d50e865f50a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:34.741552 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7e342e28b54ef283747d50e865f50a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:34.743521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:34.794449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7e342e28b54ef283747d50e865f50a', 'request_id': 'req-bb9a8d89-1f17-4f05-8abc-26acfa658c47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.801673 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7e342e28b54ef283747d50e865f50a', 'request_id': 'req-bb9a8d89-1f17-4f05-8abc-26acfa658c47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.807667 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7e342e28b54ef283747d50e865f50a', 'request_id': 'req-bb9a8d89-1f17-4f05-8abc-26acfa658c47'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.823803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] The token cache is being invalidate because project bd7e342e28b54ef283747d50e865f50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:10:34.824101 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.824873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.826427 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4536/9047] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:10:34 2022] DELETE /identity/v3/projects/bd7e342e28b54ef283747d50e865f50a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:10:34.830690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:34.832259 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:34.853263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2170a04-4e0d-40ea-b4bd-4bbf75582bee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:34.920442 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:34.922085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:34.922365 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:34.922643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] PATH_INFO: `/v3/users/7c600f693d1949dc8f3e3e366057ceed` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:34.930081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c600f693d1949dc8f3e3e366057ceed)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:34.932057 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:34.957664 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:34.995240 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c600f693d1949dc8f3e3e366057ceed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:34.996280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c600f693d1949dc8f3e3e366057ceed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.004768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c600f693d1949dc8f3e3e366057ceed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.019723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c600f693d1949dc8f3e3e366057ceed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.020884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-958c6d03-5701-4164-aec9-c6baa082474f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c600f693d1949dc8f3e3e366057ceed'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.043298 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4512/9048] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:10:34 2022] DELETE /identity/v3/users/7c600f693d1949dc8f3e3e366057ceed => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:10:35.242094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.243748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:35.257769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a8d89-1f17-4f05-8abc-26acfa658c47 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.316969 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.317645 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.317931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.318206 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] PATH_INFO: `/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.319345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=477ed2377e2c4279ab552fd3ba63b3b5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.321277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.334091 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:35.371071 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477ed2377e2c4279ab552fd3ba63b3b5', 'request_id': 'req-d12b84cb-5e8b-487a-949b-9e84144f32ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.377223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477ed2377e2c4279ab552fd3ba63b3b5', 'request_id': 'req-d12b84cb-5e8b-487a-949b-9e84144f32ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.383077 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477ed2377e2c4279ab552fd3ba63b3b5', 'request_id': 'req-d12b84cb-5e8b-487a-949b-9e84144f32ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.396845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] The token cache is being invalidate because project 477ed2377e2c4279ab552fd3ba63b3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:10:35.397139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.397795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d12b84cb-5e8b-487a-949b-9e84144f32ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:10:35.399297 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4537/9049] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:10:35 2022] DELETE /identity/v3/projects/477ed2377e2c4279ab552fd3ba63b3b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:10:35.404386 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.404872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.404987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.436090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:35.437217 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:35.497295 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4513/9050] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:35.506519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.506810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.507088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.527563 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:35.528779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:35.539134 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4538/9051] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:35.543434 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.554269 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07ad0-4eb6-48d6-b5de-77e853325f99 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.558906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.559508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.559789 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.560063 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.560713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:10:35.561012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.562657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.575115 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4514/9052] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:10:35.579520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.589774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303c7b-80f6-41d9-86be-1d2139b9e74e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.595219 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.595854 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.596160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.596433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.597062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.599069 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.626991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4539/9053] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:10:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:10:35.631859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.641872 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9391b-c18e-4f5c-9ef2-f2b0a1e02577 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.697581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.698100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.698380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.698652 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.699277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.701190 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.721989 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4515/9054] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:10:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:10:35.726702 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.737185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79e489-d5ac-4662-ae50-7c7cbe8bc595 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.742525 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.743123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.743425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.743713 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.744356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.746014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.755991 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4540/9055] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:10:35.759930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.770083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeebe57-4950-45ac-b066-689822259891 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.774689 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.775277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.775565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.775840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.776479 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.778133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823280b-9af3-4e89-b2b5-83be9219b140 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.779373 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:35.791238 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4516/9056] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:10:35.795477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.806389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45d083-37d8-47b6-8f6c-b2b28d5eaaa0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:35.811186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:35.811840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.812123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.812399 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] PATH_INFO: `/v3/projects/3e4dde63604a418d8ff919f35e5928d7/users/4e4a721ce8234a698ef43644a8d96a53/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.826995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4dde63604a418d8ff919f35e5928d7, user_id=4e4a721ce8234a698ef43644a8d96a53, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:35.829749 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:35.842276 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4541/9057] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:10:35 2022] PUT /identity/v3/projects/3e4dde63604a418d8ff919f35e5928d7/users/4e4a721ce8234a698ef43644a8d96a53/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:10:35.847845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d57ac-f053-43f8-b61b-e47599c730c8 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:35.848135 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d57ac-f053-43f8-b61b-e47599c730c8 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:35.848409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d57ac-f053-43f8-b61b-e47599c730c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:35.867889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-156d57ac-f053-43f8-b61b-e47599c730c8 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:35.869094 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-156d57ac-f053-43f8-b61b-e47599c730c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:35.927400 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4517/9058] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:35.937274 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:35.939003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:35.997094 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932812-c4ef-42fd-b8e0-6ceaac2f71c3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:36.000650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:36.001244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:36.001567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:36.001841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:36.011517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:36.012943 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:36.022550 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4542/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:10:40.271885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.272424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.272424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.304525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] MFA Rules not processed for user `4e4a721ce8234a698ef43644a8d96a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:40.305955 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:40.376734 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4518/9060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:40.382148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.395181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59458ff-6147-4bb6-822a-2f521af84f74 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.400579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.401203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.401518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.401799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.402460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.404401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.435345 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4543/9061] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:10:40 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 02:10:40.438813 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.450726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b01d-a336-427f-8ddf-3b4f38475d0d None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.513472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.513757 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.514026 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.514336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.514929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.516896 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.542050 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4519/9062] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:10:40 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:10:40.545804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.557618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca214-a514-4840-a580-602b2e3fded4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.562650 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.565539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.565539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.565539 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.566817 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.568760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.581879 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4544/9063] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 02:10:40.586193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.597727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf81e-5132-425d-bfe0-d59579cfa493 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.602465 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.603141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.603427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.603703 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] PATH_INFO: `/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9/users/aada7d5b313e42a4931ca752522fce34/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.618952 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:40.622602 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92fa4f2f2ca41919f299d5d9bacfef9, user_id=aada7d5b313e42a4931ca752522fce34, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.626004 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.640724 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4520/9064] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:10:40 2022] PUT /identity/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9/users/aada7d5b313e42a4931ca752522fce34/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:10:40.645130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.655769 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e971-3d52-4ecf-bea4-3be63b86b8f6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.659447 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:40.719505 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.720476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.720810 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.721098 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.721791 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.723553 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4974-4195-4899-a24e-6c1ca558f982 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.735306 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4545/9065] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:10:40.740448 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:40.751248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ca180-33d8-47c4-9753-62478b5a996f admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:40.756854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:40.757571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:40.757849 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:40.758117 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] PATH_INFO: `/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9/users/aada7d5b313e42a4931ca752522fce34/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:40.760016 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92fa4f2f2ca41919f299d5d9bacfef9, user_id=aada7d5b313e42a4931ca752522fce34, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:40.762693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:40.773710 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4521/9066] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:10:40 2022] PUT /identity/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9/users/aada7d5b313e42a4931ca752522fce34/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:10:45.447675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914274c-a6e7-44de-b990-8c225a288b43 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:45.448120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914274c-a6e7-44de-b990-8c225a288b43 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:45.448240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914274c-a6e7-44de-b990-8c225a288b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:45.497613 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7914274c-a6e7-44de-b990-8c225a288b43 None None] MFA Rules not processed for user `aada7d5b313e42a4931ca752522fce34`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:45.499276 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7914274c-a6e7-44de-b990-8c225a288b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:45.591672 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4546/9067] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:10:45.621247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:45.623650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:45.712091 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ea271-38c1-49ca-88fa-9b38136000ee admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:45.715949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:45.716565 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:45.716837 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:45.717254 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:45.777907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:45.779403 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b99bd2-7960-405e-b245-a590dd0509f1 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:45.789350 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4522/9068] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:10:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:10:45.948189 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:45.948476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:45.948756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:46.005050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:46.006332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:46.071262 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:46.076037 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4547/9069] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:10:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:46.128211 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa614de1-8453-4faa-92e3-73aa760cc7f2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:46.128556 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa614de1-8453-4faa-92e3-73aa760cc7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:46.128827 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa614de1-8453-4faa-92e3-73aa760cc7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:46.179426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-fa614de1-8453-4faa-92e3-73aa760cc7f2 None None] MFA Rules not processed for user `46f1c1451849424fa2b09e7ea786a539`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:46.180629 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fa614de1-8453-4faa-92e3-73aa760cc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:46.223449 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:46.251746 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4523/9070] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 25 02:10:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:46.258150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:46.271443 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edf91b-89fe-446e-9767-2ac5ced7681f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:46.276708 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:46.277324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:46.277639 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:46.277917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:46.287113 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:46.288840 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:46.296878 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4548/9071] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:10:55.460826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf55593-829b-4918-9f1c-4fb67eecd4b1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:55.461335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf55593-829b-4918-9f1c-4fb67eecd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:55.461471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf55593-829b-4918-9f1c-4fb67eecd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:55.481192 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-8bf55593-829b-4918-9f1c-4fb67eecd4b1 None None] MFA Rules not processed for user `4e4a721ce8234a698ef43644a8d96a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:55.482426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-8bf55593-829b-4918-9f1c-4fb67eecd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:55.489671 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4524/9072] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:56.067004 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:56.068487 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:56.139149 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c31de-e08f-4d4f-8036-d372fe84569a service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:56.145032 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:56.145671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:56.145958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:56.146234 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:56.147974 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:56.159186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:56.161022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:56.170915 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4549/9073] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:10:57.574893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:57.575387 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:57.575586 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:57.595948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:10:57.597515 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:10:57.605031 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4525/9074] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:10:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:10:57.618444 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:10:57.631001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ccfd-7b21-45a7-82c1-a8b02a528d84 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:10:57.636093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:10:57.636767 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:10:57.636996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:10:57.637272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:10:57.646985 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:10:57.648592 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:10:57.658256 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4550/9075] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:11:06.822779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:11:06.824310 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:11:06.882265 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73dca-e264-4a5d-b5ab-60e8c4b7a044 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:11:06.886225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:11:06.886866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:11:06.887147 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:11:06.887447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:11:06.889187 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:11:06.899225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:11:06.900989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:11:06.908570 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4526/9076] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:11:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:11:07.562110 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:11:07.563940 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:11:07.651024 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cf07-a410-4175-af48-9e816e1fa734 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:11:07.656591 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:11:07.657203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:11:07.657507 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:11:07.657780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:11:07.659662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:11:07.673078 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:11:07.674820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:11:07.687652 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4551/9077] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:11:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:11:13.780443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:11:13.794943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add2f6-6455-4743-8870-94e6f61f2074 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:11:13.800679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:11:13.801282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:11:13.801618 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:11:13.802743 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:11:13.804605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:11:13.817202 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:11:13.819597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:11:13.830249 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4527/9078] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:11:17.682923 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=78 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:23.825856 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=49 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:31.914579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:11:31.923917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108fd8-6138-47a0-84c2-8f9530ad652e service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:11:31.928157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:11:31.928931 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:11:31.929212 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:11:31.929518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:11:31.938621 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:11:31.940045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:11:31.949702 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4552/9079] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:11:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:11:41.945622 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:12:46.254039 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:12:46.255441 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:12:46.282095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc648b-a8ba-4e2a-b916-4c18fd9c2e05 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:12:46.287980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:12:46.288587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:12:46.288866 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:12:46.289702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:12:46.291392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:12:46.302669 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:12:46.304248 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:12:46.314108 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4528/9080] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:12:47.326646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:12:47.337972 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f5ec-c9b2-42db-849a-73be33309fb5 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:12:47.342962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:12:47.343558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:12:47.343873 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:12:47.344150 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:12:47.345883 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:12:47.358022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:12:47.359628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:12:47.370238 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4553/9081] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:12:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:12:56.310040 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:12:57.365392 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:30.605174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:30.616733 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1587f7-c507-4b3e-8e28-8eb59e397698 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:30.620828 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:30.621482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:30.621768 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:30.622040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:30.623779 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:30.649966 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:30.651344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db357-ea7c-419b-81c3-27f237d10fa2 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:30.663488 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4529/9082] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:14:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:14:40.657858 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=11 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:42.361057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:42.370307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa32b5-7c38-430f-9d7e-4f8f51d90478 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:42.374117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:42.374728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:42.375011 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:42.375287 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:42.377080 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:42.390755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:42.392201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:42.404004 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4554/9083] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:14:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:14:45.814952 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dbc75-5bd4-400b-8788-9e933bffa839 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:45.815632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dbc75-5bd4-400b-8788-9e933bffa839 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:45.815632 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dbc75-5bd4-400b-8788-9e933bffa839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:45.836186 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-0f3dbc75-5bd4-400b-8788-9e933bffa839 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:14:45.837424 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f3dbc75-5bd4-400b-8788-9e933bffa839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:45.844657 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4530/9084] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 02:14:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:14:45.885579 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:45.897140 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7722b8-bf9b-46d2-ad44-5e8001d6ac63 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:45.902142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:45.902741 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:45.903022 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:45.903296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:45.911824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:45.913704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:45.921705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4555/9085] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:14:46.416973 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e886c3-1b33-45f0-a523-9e3d2cff43d4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:46.417334 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e886c3-1b33-45f0-a523-9e3d2cff43d4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:46.417722 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e886c3-1b33-45f0-a523-9e3d2cff43d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:46.437088 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d6e886c3-1b33-45f0-a523-9e3d2cff43d4 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:14:46.438298 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6e886c3-1b33-45f0-a523-9e3d2cff43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:46.446080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4531/9086] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:14:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:14:46.458876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:46.469701 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb35b7-af6d-4993-8729-394db16e3c3e service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:46.475254 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:46.475862 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:46.476143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:46.476418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:46.484935 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:46.486561 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:46.494616 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4556/9087] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:14:55.089160 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:55.089675 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:55.089796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:55.108867 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] MFA Rules not processed for user `4e4a721ce8234a698ef43644a8d96a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:14:55.110073 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:55.118032 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4532/9088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:14:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:14:55.375803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:55.385380 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1017c-0a69-4646-b4de-f144766cc820 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:55.389088 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:55.389772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:55.390148 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:55.390310 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:55.391998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:55.416144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:55.417665 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd67ca-053f-4a94-a648-1a9423b3f103 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:55.426381 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4557/9089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:14:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:14:55.760409 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:55.774471 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa63ac-e3a4-4ad6-b17a-cec9f4475340 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:55.780008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:55.780752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:55.781212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:55.781623 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:55.784083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:55.798696 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:55.800336 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:55.810673 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4533/9090] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:14:59.285469 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:59.285959 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:59.286152 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:59.305672 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:14:59.306888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:14:59.314408 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4558/9091] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:14:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:14:59.327012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:14:59.338880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa8f31-b16c-449a-a89a-673a6951f387 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:14:59.344193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:14:59.344881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:14:59.345236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:14:59.345617 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:14:59.354223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:14:59.355963 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:14:59.364833 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4534/9092] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:15:09.300248 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=32 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:09.360843 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=21 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:29.532989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:15:29.535062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:15:29.556617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ff98-e033-4d4a-9193-88998086de7a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:15:29.562755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:15:29.563532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:15:29.563914 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:15:29.565044 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:15:29.567172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:15:29.581879 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:15:29.584230 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:15:29.599360 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4559/9093] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:15:39.591230 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:48.456275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:15:48.469226 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5f58-aeae-4767-a008-94b587ebd21d service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:15:48.474892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:15:48.475486 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:15:48.475771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:15:48.476047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:15:48.483778 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:15:48.485380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:15:48.494751 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4535/9094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:15:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:15:58.490678 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:34.746899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:34.757013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d30e0d-5794-48d7-8749-b3c8a52e3b3e service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:34.761215 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:34.761872 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:34.762155 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:34.762430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:34.770351 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:34.772450 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0194db-e1b8-41a9-a203-62ac09caa0f4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:34.781137 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4560/9095] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:16:44.777470 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:47.254570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:47.266890 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d36d3-a662-4859-a003-4f67e071b2e7 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:47.272921 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:47.273581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:47.273851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:47.274126 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:47.283781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:47.285439 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:47.296998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4536/9096] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:16:48.342460 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:48.342966 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:48.343070 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:48.363102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:16:48.364362 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:48.372225 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4561/9097] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 02:16:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:16:48.414514 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:48.425756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057407e-ab1b-4a40-8785-123f0a02d4a6 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:48.431263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:48.431884 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:48.432163 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:48.432433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:48.440333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:48.441944 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:48.450607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4537/9098] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:16:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:16:48.801946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:48.811551 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e03f5-f0d0-4a52-b1dd-fb5c889fde96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:48.815103 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:48.815723 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:48.816001 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:48.816272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:48.880272 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:48.882687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:48.892120 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4562/9099] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:16:52.010648 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:52.025643 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef0380-248f-46ec-bb1f-865870860b6c service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:52.031587 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:52.032235 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:52.032518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:52.032792 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:52.034737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:52.049127 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:52.050850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:52.064038 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4538/9100] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:16:55.241648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:55.254418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148253f9-ff3c-4bbd-8dd7-124ac2beadfa service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:55.261119 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:55.261776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:55.262058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:55.262333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:55.264278 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:55.277677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:55.279704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:55.295892 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4563/9101] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:16:55.305548 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:55.319954 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa04d-c700-4034-831d-3409d6c64759 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:55.325168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:55.325901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:55.326641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:55.326804 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] PATH_INFO: `/v3/users/4e4a721ce8234a698ef43644a8d96a53` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:55.330780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4a721ce8234a698ef43644a8d96a53)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:55.334592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:55.385766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4a721ce8234a698ef43644a8d96a53'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.386499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4a721ce8234a698ef43644a8d96a53'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.393869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4a721ce8234a698ef43644a8d96a53'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.407279 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4a721ce8234a698ef43644a8d96a53'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.407936 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4a721ce8234a698ef43644a8d96a53'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.425299 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4539/9102] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:16:55 2022] DELETE /identity/v3/users/4e4a721ce8234a698ef43644a8d96a53 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:55.615642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:55.628707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bdc53-5c77-45ab-bdd9-bb99055f309b service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:55.691184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:55.691825 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:55.692109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:55.692387 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] PATH_INFO: `/v3/projects/3e4dde63604a418d8ff919f35e5928d7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:55.693869 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4dde63604a418d8ff919f35e5928d7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:55.695897 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:55.742217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4dde63604a418d8ff919f35e5928d7', 'request_id': 'req-c0e3fe27-452d-4615-926c-e50b890ffe59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.748186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4dde63604a418d8ff919f35e5928d7', 'request_id': 'req-c0e3fe27-452d-4615-926c-e50b890ffe59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.753626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4dde63604a418d8ff919f35e5928d7', 'request_id': 'req-c0e3fe27-452d-4615-926c-e50b890ffe59'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.765557 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] The token cache is being invalidate because project 3e4dde63604a418d8ff919f35e5928d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:16:55.765843 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.766466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.767933 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4564/9103] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:16:55 2022] DELETE /identity/v3/projects/3e4dde63604a418d8ff919f35e5928d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:55.772049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:55.773552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:55.787469 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2bb66-bb42-4bbd-9767-7a0473846f37 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:55.843470 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:55.844034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:55.844314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:55.844584 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] PATH_INFO: `/v3/users/aada7d5b313e42a4931ca752522fce34` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:55.845742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aada7d5b313e42a4931ca752522fce34)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:55.847654 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:55.885769 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:55.897723 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aada7d5b313e42a4931ca752522fce34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.898370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aada7d5b313e42a4931ca752522fce34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.905225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aada7d5b313e42a4931ca752522fce34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.917880 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aada7d5b313e42a4931ca752522fce34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.918508 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-410c4385-15fe-4fc7-bf43-4d2632d2be11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aada7d5b313e42a4931ca752522fce34'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:55.931236 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4540/9104] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:16:55 2022] DELETE /identity/v3/users/aada7d5b313e42a4931ca752522fce34 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:56.105807 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.107317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:56.116666 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:56.120895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fe27-452d-4615-926c-e50b890ffe59 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.182426 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.183059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.183340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.183611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] PATH_INFO: `/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.184729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92fa4f2f2ca41919f299d5d9bacfef9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.186671 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.233061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92fa4f2f2ca41919f299d5d9bacfef9', 'request_id': 'req-f44d9d13-0eef-416a-a3ef-965efa995324'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:56.239353 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92fa4f2f2ca41919f299d5d9bacfef9', 'request_id': 'req-f44d9d13-0eef-416a-a3ef-965efa995324'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:56.245084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92fa4f2f2ca41919f299d5d9bacfef9', 'request_id': 'req-f44d9d13-0eef-416a-a3ef-965efa995324'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:56.257704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] The token cache is being invalidate because project c92fa4f2f2ca41919f299d5d9bacfef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:16:56.257991 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:56.258611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f44d9d13-0eef-416a-a3ef-965efa995324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:16:56.260089 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4565/9105] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:16:56 2022] DELETE /identity/v3/projects/c92fa4f2f2ca41919f299d5d9bacfef9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:56.265295 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.265690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.266042 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.286250 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:16:56.287748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:56.346281 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4541/9106] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:16:56.355137 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.355433 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.355709 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.375626 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:16:56.376831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:56.385656 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4566/9107] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:16:56.389997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.400433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b0f0f-6b61-44f6-be5d-d988c0da32f4 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.404950 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.405576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.405860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.406133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.406774 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81862) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:16:56.407077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.408678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.420591 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4542/9108] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:16:56.425061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.435124 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373dea9-1864-43a6-a5e6-af8f0ca6bbc1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.439824 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.440424 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.440706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.440982 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.441646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.444072 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.471938 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4567/9109] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:16:56.475788 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.486184 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223acfe-51a2-415b-8c83-d0a9e3ba35fb admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.542605 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.543210 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.543491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.543770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.544390 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.546370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.568361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4543/9110] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:16:56.572774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.584201 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f24f6-3bd9-4439-8e23-d1758b470688 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.588949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.589583 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.589864 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.590162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.590802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.592418 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.603107 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4568/9111] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:16:56.607056 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.617818 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa492-5b9a-4116-bbb6-85d4281f790e admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.623280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.623910 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.624195 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.624472 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.625115 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.626752 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a14359-e0e3-4513-a016-9cb5ff60f081 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.637610 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4544/9112] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:16:56.641774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.652306 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceacf6-13db-4794-acc7-c527a7117f33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.656939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.657623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.657913 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.658187 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] PATH_INFO: `/v3/projects/c81a9610beb448de86effadb691910a8/users/fda050fca295403c8695da4b37062cd7/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.673686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81a9610beb448de86effadb691910a8, user_id=fda050fca295403c8695da4b37062cd7, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.676358 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.689546 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4569/9113] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:16:56 2022] PUT /identity/v3/projects/c81a9610beb448de86effadb691910a8/users/fda050fca295403c8695da4b37062cd7/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:56.699739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.700028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.700304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.731010 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:16:56.732218 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:56.737184 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:56.804900 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4545/9114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:16:56.809822 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.846484 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:56.878722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfa564-e0a3-4d80-be95-e669bd832249 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.883517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.884127 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.884411 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.884686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.885314 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.887271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:56.915145 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4570/9115] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 25 02:16:56.919118 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:56.930098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1874-67a7-40cb-94d6-a94438d6de92 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:56.987460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:56.988065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:56.988348 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:56.988640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:56.989246 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:56.991241 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.012134 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4546/9116] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:16:56 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:16:57.016244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:57.027293 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a79d1-3825-43b7-bece-d50ae9329618 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:57.032009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:57.032612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.032896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.033169 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.033850 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:57.035455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.046247 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4571/9117] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:16:57.050275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:57.060347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e423d-56c8-4c51-8e51-527f9d5542a4 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:57.064976 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:57.065660 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.065941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.066214 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] PATH_INFO: `/v3/projects/11ffab08401e4850bcd231a58af248f9/users/f5f0443673c64e98bf8fb3ebd00fe78f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.081569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ffab08401e4850bcd231a58af248f9, user_id=f5f0443673c64e98bf8fb3ebd00fe78f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:57.085040 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.097824 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4547/9118] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:16:57 2022] PUT /identity/v3/projects/11ffab08401e4850bcd231a58af248f9/users/f5f0443673c64e98bf8fb3ebd00fe78f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:57.101797 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:57.111799 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c4bd-0c26-436c-8a86-138a6d3fd6f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:57.167097 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:57.167726 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.168008 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.168282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.168918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:57.170637 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646362f-0098-4768-85fc-eb207abd06e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.180926 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4572/9119] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:16:57.185034 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:57.195965 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75840-8b4c-42b6-86d5-35593868c69d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:57.200555 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:57.201200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.201505 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.201780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] PATH_INFO: `/v3/projects/11ffab08401e4850bcd231a58af248f9/users/f5f0443673c64e98bf8fb3ebd00fe78f/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.203694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ffab08401e4850bcd231a58af248f9, user_id=f5f0443673c64e98bf8fb3ebd00fe78f, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:57.206385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.217722 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4548/9120] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:16:57 2022] PUT /identity/v3/projects/11ffab08401e4850bcd231a58af248f9/users/f5f0443673c64e98bf8fb3ebd00fe78f/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:16:57.227841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.228138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.228417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.256354 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] MFA Rules not processed for user `f5f0443673c64e98bf8fb3ebd00fe78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:16:57.257679 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:57.327342 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4573/9121] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:16:57.342255 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:16:57.343994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:16:57.402933 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:57.420104 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006392f8-15e9-4247-9b2f-32da5d54cb71 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:16:57.425780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:16:57.426389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:16:57.426668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:16:57.426941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:16:57.484136 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:16:57.485810 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8508e-0285-4459-be5b-f371389e1906 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:16:57.495479 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4549/9122] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:00.468300 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:00.469754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:00.501818 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:00.532642 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ca80d-33ea-458d-b0f0-eb52d73b628b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:00.536488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:00.538060 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:00.538343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:00.538618 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:00.548009 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:00.549513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:00.559653 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4574/9123] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:03.663510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:03.664007 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:03.664089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:03.691644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:17:03.693676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:03.705346 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4550/9124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:17:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:17:04.047712 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:04.049361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:04.060916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733560-86c9-4c8e-9e33-e44cc6106ba2 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:04.064526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:04.065123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:04.065415 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:04.065706 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:04.067413 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:04.076948 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:04.078400 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:04.086874 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4575/9125] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:05.469212 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:05.471389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:05.568962 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88942d8e-e0b8-4ce4-90bc-5ecd88ace122 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:05.574546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:05.575182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:05.575491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:05.575769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:05.577570 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:05.591201 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:05.592830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:05.604312 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4551/9126] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:10.515360 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:10.525102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b320a9-6e53-46d9-93f8-c06cb2f47ea6 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:10.528860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:10.529502 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:10.529780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:10.530051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:10.531999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:10.543064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:10.544523 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:10.554164 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4576/9127] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:15.605716 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=64 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:18.110980 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:18.112603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:18.128012 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf07-4b7f-49d5-9030-6d2c0fe5072e service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:18.134419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:18.135028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:18.135313 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:18.135588 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:18.137302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:18.150292 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:18.151894 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:18.163144 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4552/9128] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:20.549339 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=26 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:28.158161 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:49.217526 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:49.238820 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628486b7-22d0-46a2-a1ba-f1d4c4de2164 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:49.244658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:49.245261 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:49.245582 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:49.245858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:49.247612 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:49.259729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:49.261307 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b4f34-d30f-4718-9d8d-e9aa04757406 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:49.271101 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4577/9129] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:53.999621 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:17:54.011597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d437be0-ccfa-4702-a664-63c17da5ece1 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:17:54.016637 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:17:54.017244 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:17:54.017543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:17:54.017817 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:17:54.019513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:17:54.031216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:17:54.032785 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:17:54.042871 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4553/9130] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:17:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:17:59.266947 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:04.038704 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:42.704172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:18:42.704666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:18:42.704775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:18:42.725239 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:18:42.727381 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:18:42.735043 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4578/9131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:18:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:18:52.720016 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:31.164603 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:19:31.183083 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62de4f-6246-4175-9926-f7d0c9570512 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:19:31.187581 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:19:31.188141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:19:31.188427 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:19:31.188702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:19:31.190502 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:19:31.205008 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:19:31.206491 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b339f8-5a53-41bd-8451-6a2a11efc688 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:19:31.227916 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4554/9132] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:19:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:19:41.225151 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=14 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:44.207587 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:19:44.226859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771de8d-f677-40b1-8cef-ecc7001ac90b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:19:44.231013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:19:44.231800 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:19:44.232083 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:19:44.232352 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:19:44.234109 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:19:44.287349 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:19:44.289054 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:19:44.300417 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4579/9133] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:19:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:19:54.295669 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=28 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:33.842380 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd655-329c-4a90-b53a-c60ebb3fe644 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:20:33.842892 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd655-329c-4a90-b53a-c60ebb3fe644 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:20:33.843002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bd655-329c-4a90-b53a-c60ebb3fe644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:20:33.874824 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-f91bd655-329c-4a90-b53a-c60ebb3fe644 None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:20:33.876328 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-f91bd655-329c-4a90-b53a-c60ebb3fe644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:20:33.884564 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4555/9134] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:20:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:20:43.862760 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:47.389014 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:20:47.417021 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10247c-bcfc-4878-b601-1e28ad5ac4c8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:20:47.418281 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:20:47.419002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:20:47.419286 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:20:47.419569 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:20:47.421536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:20:47.436156 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:20:47.438025 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:20:47.450705 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4580/9135] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:20:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:20:57.444633 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:49.538978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:49.539563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:49.539711 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:49.601028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] MFA Rules not processed for user `910f4364ae7543ab928a58d9a13e2d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:21:49.602290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:21:49.609250 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4556/9136] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:21:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:21:49.621180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:21:49.631132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4a0a-797f-4185-84c3-d30cef0aef76 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:21:49.634847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:21:49.635571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:49.635860 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:49.636134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:49.643401 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:21:49.645888 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35145f1-e277-45e9-9aa3-0200ab60ca66 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:21:49.654476 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4581/9137] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:21:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:21:49.744991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:21:49.757998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64decc75-71c1-4556-84e0-7137bc202653 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:21:49.763280 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:21:49.763881 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:49.764164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:49.764433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:49.766174 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:21:49.777823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:21:49.779446 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:21:49.789754 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4557/9138] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:21:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:21:49.961331 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:49.961641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:49.961915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:50.000162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:21:50.001374 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:21:50.010850 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4582/9139] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:21:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:21:50.022316 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:21:50.031576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89530c04-6369-4305-ab6a-b11939bf2cc4 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:21:50.035690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:21:50.036571 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:50.036877 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:50.037149 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:50.047257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:21:50.048694 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:21:50.059784 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4558/9140] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:21:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:21:50.120468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:21:50.132317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5ad85-a62f-4b7a-b523-35caa997d287 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:21:50.137339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:21:50.137967 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:50.138241 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:50.138511 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:50.140204 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:21:50.152309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:21:50.153916 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:21:50.164215 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4583/9141] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:21:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:21:57.782060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:21:57.794013 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51eedc2-5e89-4b8e-8c0c-5202aa1cad95 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:21:57.800355 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:21:57.800946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:21:57.801227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:21:57.801577 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:21:57.810257 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:21:57.811869 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:21:57.820832 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4559/9142] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:21:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:00.159471 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=21 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:04.140396 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:04.150619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406175f7-db02-4b6f-9805-e3f46423fc53 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:04.154248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:04.154841 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:04.155120 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:04.155389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:04.157102 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:22:04.167040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:04.168506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:04.177339 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4584/9143] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:07.816635 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=35 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:14.172818 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:42.406430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:42.423695 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b040c-271f-497a-95c9-e515c716f33e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:42.430771 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:42.431523 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:42.431836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:42.432150 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:42.434175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:22:42.447501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:42.449068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:42.461674 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4560/9144] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:46.044017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:46.057260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a510-39d6-4fb4-a5b9-a2bf4b010d74 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:46.067619 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:46.068449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:46.068742 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:46.069019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:46.071002 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:22:46.083020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:46.084558 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccf03d-68cb-4e8e-85c0-de85dd05fea6 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:46.098867 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4585/9145] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:50.219753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:50.229647 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c737e-ac09-4267-8fe2-daf02a676786 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:50.233447 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:50.234275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:50.234640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:50.234989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:50.244987 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:50.246503 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:50.256336 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4561/9146] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:53.095633 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:53.096193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:53.096193 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:53.120363 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:22:53.121998 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:22:53.129554 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4586/9147] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:22:53.214528 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:53.229766 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1572-1d23-4bbe-8fa5-109e394baf15 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:53.235777 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:53.236543 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:53.237089 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:53.237496 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:53.249765 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:53.251532 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:53.262196 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4562/9148] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:53.496449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:53.507761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790c669-93ce-4f82-9b42-f3fc38c7df9a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:53.512953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:53.514123 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:53.514600 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:53.515309 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:53.518466 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:22:53.533954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:53.535910 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:53.544930 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4587/9149] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:22:53.938493 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:22:53.954354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c602-7d80-4220-9d8c-03e6e009e4d9 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:22:53.961997 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:22:53.962619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:22:53.962897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:22:53.963181 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:22:53.974381 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:22:53.976232 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:22:53.993655 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4563/9150] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:23:01.297517 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:23:01.310617 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d80ae-7781-4103-8b0c-c3c992b234c5 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:23:01.315562 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:23:01.317040 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:23:01.317477 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:23:01.317755 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:23:01.326184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:23:01.327762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:23:01.338429 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4588/9151] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:23:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:23:02.831911 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:23:02.847560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0cce-8bbe-4010-838c-43ae6cc14ccc service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:23:02.853303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:23:02.853939 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:23:02.854224 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:23:02.854501 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:23:02.863748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:23:02.865935 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:23:02.876843 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4564/9152] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:23:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:23:11.334060 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=21 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:12.872279 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=30 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:33.723779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:24:33.734586 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5c11-a33d-4b1e-b235-b7cf29bf2d11 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:24:33.738492 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:24:33.739207 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:24:33.740134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:24:33.740134 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:24:33.752408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:24:33.754081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf0f10-ad5d-49e6-bb6f-3cf1a47c67a4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:24:33.768227 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4589/9153] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:24:40.265720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:24:40.277596 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b72242-30de-4758-81b6-ef3475a1638e service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:24:40.282724 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:24:40.283395 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:24:40.283744 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:24:40.284086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:24:40.285918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:24:40.312988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:24:40.312988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:24:40.324021 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4565/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:24:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:24:43.762630 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:45.950903 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:24:45.951909 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:24:45.952344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:24:45.972676 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] MFA Rules not processed for user `fda050fca295403c8695da4b37062cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:24:45.974084 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:24:45.986380 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4590/9155] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:24:46.027090 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:24:46.028578 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:24:46.116860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cbe1f-51e2-4950-8e8d-f01dbe072b77 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:24:46.121418 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:24:46.122038 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:24:46.122318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:24:46.122592 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:24:46.133981 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:24:46.135445 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:24:46.147589 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4566/9156] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:24:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:24:49.114919 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:24:49.126898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64cb6-f612-42a9-8973-993161c44684 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:24:49.131003 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:24:49.131918 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:24:49.132297 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:24:49.133386 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:24:49.144489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:24:49.146536 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:24:49.169759 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4591/9157] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:24:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:24:56.142205 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=46 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:59.154195 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=9 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:07.965930 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:07.977644 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c04a-89d2-4c21-b0ab-937a472692d3 service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:07.983797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:07.984533 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:07.984823 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:07.985102 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:07.995303 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:07.996986 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5e74-03f7-44ff-8945-d387bb76a799 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:08.009174 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4567/9158] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:26:14.712158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:14.804162 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560732b8-e789-42c0-a9bd-e75ce7387e31 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:14.809545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:14.810183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:14.810467 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:14.810792 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] PATH_INFO: `/v3/users/fda050fca295403c8695da4b37062cd7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:14.811950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda050fca295403c8695da4b37062cd7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:14.813932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:14.860303 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda050fca295403c8695da4b37062cd7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:14.868138 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda050fca295403c8695da4b37062cd7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:14.879756 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda050fca295403c8695da4b37062cd7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:14.880435 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda050fca295403c8695da4b37062cd7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:14.881037 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda050fca295403c8695da4b37062cd7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:14.894675 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4592/9159] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:26:14 2022] DELETE /identity/v3/users/fda050fca295403c8695da4b37062cd7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:26:14.899372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:14.899899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:14.899899 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:14.944443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:14.945702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:15.003423 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4568/9160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:26:15.014073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:15.015942 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:15.094190 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9292f-c2ae-4a2d-a498-4f9d756219b4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:15.098090 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:15.098704 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:15.098996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:15.099332 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:15.105842 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:15.110719 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:15.112260 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:15.124892 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4593/9161] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:26:15.301604 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:15.303204 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:15.316162 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab475a8-446c-415c-8fa1-9493238408d7 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:15.322041 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:15.322678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:15.322959 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:15.323809 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] PATH_INFO: `/v3/projects/c81a9610beb448de86effadb691910a8` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:15.325253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81a9610beb448de86effadb691910a8)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:15.327113 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:15.374019 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81a9610beb448de86effadb691910a8', 'request_id': 'req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.380086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81a9610beb448de86effadb691910a8', 'request_id': 'req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.386719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81a9610beb448de86effadb691910a8', 'request_id': 'req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.399408 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] The token cache is being invalidate because project c81a9610beb448de86effadb691910a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:26:15.399726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.400375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.401904 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4569/9162] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:26:15 2022] DELETE /identity/v3/projects/c81a9610beb448de86effadb691910a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:26:15.406051 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:15.416641 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd643d-3aef-4300-bda7-9557365fd326 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:15.474211 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:15.474847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:15.475131 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:15.475408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] PATH_INFO: `/v3/users/f5f0443673c64e98bf8fb3ebd00fe78f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:15.476648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f0443673c64e98bf8fb3ebd00fe78f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:15.478627 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:15.525361 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f0443673c64e98bf8fb3ebd00fe78f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.532256 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f0443673c64e98bf8fb3ebd00fe78f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.544677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f0443673c64e98bf8fb3ebd00fe78f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.545359 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f0443673c64e98bf8fb3ebd00fe78f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.546013 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6db0d94-8c40-4041-981d-6bd570ef1dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f0443673c64e98bf8fb3ebd00fe78f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.559284 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4594/9163] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:26:15 2022] DELETE /identity/v3/users/f5f0443673c64e98bf8fb3ebd00fe78f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:26:15.845389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:15.847075 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:15.867649 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4275e6-3cf1-4791-a05d-72c0b36a8dc2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:15.919000 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:15.930064 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:15.931035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:15.931538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:15.931887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] PATH_INFO: `/v3/projects/11ffab08401e4850bcd231a58af248f9` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:15.933101 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ffab08401e4850bcd231a58af248f9)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:15.935148 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:15.982140 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ffab08401e4850bcd231a58af248f9', 'request_id': 'req-be3819f1-2e94-4232-a7d0-da88e1210ca6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.988473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ffab08401e4850bcd231a58af248f9', 'request_id': 'req-be3819f1-2e94-4232-a7d0-da88e1210ca6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:15.995642 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ffab08401e4850bcd231a58af248f9', 'request_id': 'req-be3819f1-2e94-4232-a7d0-da88e1210ca6'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:16.009559 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] The token cache is being invalidate because project 11ffab08401e4850bcd231a58af248f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:26:16.009845 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:16.010576 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-be3819f1-2e94-4232-a7d0-da88e1210ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:26:16.012081 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4570/9164] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:26:15 2022] DELETE /identity/v3/projects/11ffab08401e4850bcd231a58af248f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:26:16.017451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.017923 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.018020 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.059159 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:16.060370 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:16.113127 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:16.124706 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4595/9165] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:26:16.134123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.134411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.134693 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.155538 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:16.156741 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:16.166361 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4571/9166] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:26:16.170858 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.181455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f25361-9f89-4e44-bc69-f2a8b0099ba6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.186158 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.186764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.187045 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.187319 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.187964 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:26:16.188268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.189904 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.201495 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4596/9167] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:26:16.205897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.215641 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cedc9-f1da-45c2-b017-57bed5b3a5e1 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.220243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.220838 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.221114 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.221382 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.222070 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.223988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.265390 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4572/9168] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:26:16 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:26:16.269608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.280915 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0b83-c321-468b-94c4-0c2b7590a991 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.341988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.342768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.343049 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.343322 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.343949 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.346147 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.368093 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4597/9169] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:26:16 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:26:16.371888 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.382557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60871eb9-76a4-4406-8661-c8f026cb93b2 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.392717 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.393341 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.393670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.393949 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.394626 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.396245 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.407640 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4573/9170] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:26:16.411760 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.423722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68de111-5ec7-42e8-afca-173dd557f564 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.428476 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.429093 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.429554 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.430129 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.430578 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.432181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83ed99-626f-4b8d-99d9-f4a1a6a0b703 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.443125 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4598/9171] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 02:26:16.448047 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.458519 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb58d4-2322-4b00-8fa2-939f48f410d6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.463189 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.463840 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.464121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.464393 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] PATH_INFO: `/v3/projects/22ad80c717834d09b7a3e0d396510679/users/2ba2c22356c54347901fa631b2d2ea28/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.480558 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ad80c717834d09b7a3e0d396510679, user_id=2ba2c22356c54347901fa631b2d2ea28, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.483264 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.497283 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4574/9172] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:26:16 2022] PUT /identity/v3/projects/22ad80c717834d09b7a3e0d396510679/users/2ba2c22356c54347901fa631b2d2ea28/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:26:16.502547 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb1b4-38a5-4026-914d-3cafd3974989 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.503031 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb1b4-38a5-4026-914d-3cafd3974989 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.503330 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb1b4-38a5-4026-914d-3cafd3974989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.522653 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d62bb1b4-38a5-4026-914d-3cafd3974989 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:16.524048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d62bb1b4-38a5-4026-914d-3cafd3974989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:16.584267 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4599/9173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:26:16.593825 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:16.595594 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:16.652780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5b6c-1f39-46e3-8598-2507d4eb008d admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:16.656790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:16.657392 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:16.657701 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:16.657971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:16.667918 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:16.669375 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:16.679282 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4575/9174] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:26:20.994950 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:20.995848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:20.996143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.027402 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] MFA Rules not processed for user `2ba2c22356c54347901fa631b2d2ea28`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:21.028763 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:21.106628 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:21.126670 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4600/9175] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:26:21.130971 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.142856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a622-3fac-4657-a0d6-7e337f06bef8 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.147560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.148967 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.149504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.149790 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.150419 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.152360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.164354 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:21.186044 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4576/9176] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:26:21 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:26:21.189766 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.204652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40913-9f28-41f6-968c-bb0c311b8a39 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.270081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.270811 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.271160 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.271522 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.272682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.274992 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.298904 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4601/9177] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:26:21 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:26:21.302891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.314360 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac4d6a-7351-44f9-bae2-65fb76c9a5b5 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.319193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.320482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.320769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.321048 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.321737 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.323349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.334968 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4577/9178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:26:21.339419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.350175 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3adc5-e195-4a7c-a69c-b4e7a1ba83e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.355057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.355737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.356012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.356283 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] PATH_INFO: `/v3/projects/8641f996172f47b1b4055ba826f0d0f3/users/60d22b45fa0f4ccc87d5dae210f519fd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.372861 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8641f996172f47b1b4055ba826f0d0f3, user_id=60d22b45fa0f4ccc87d5dae210f519fd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.375430 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.394562 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4602/9179] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:26:21 2022] PUT /identity/v3/projects/8641f996172f47b1b4055ba826f0d0f3/users/60d22b45fa0f4ccc87d5dae210f519fd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:26:21.398362 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.409923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ac78e-29b4-463f-88ca-aec6a95a5ee7 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.485630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.486236 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.486513 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.486783 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.487411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.488999 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe461-a3eb-4ef9-ac18-c75a4d4a3c5b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.500090 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4578/9180] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:26:21.505737 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:21.518172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb5d7a-ccf4-416a-9759-bf949fd9682b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:21.523130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:21.523902 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:21.524184 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:21.524461 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] PATH_INFO: `/v3/projects/8641f996172f47b1b4055ba826f0d0f3/users/60d22b45fa0f4ccc87d5dae210f519fd/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:21.526464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8641f996172f47b1b4055ba826f0d0f3, user_id=60d22b45fa0f4ccc87d5dae210f519fd, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:21.529566 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:21.541448 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4603/9181] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:26:21 2022] PUT /identity/v3/projects/8641f996172f47b1b4055ba826f0d0f3/users/60d22b45fa0f4ccc87d5dae210f519fd/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:26:26.040020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc43-de5a-4a9e-bcb5-d79254e9d42f None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:26.040885 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc43-de5a-4a9e-bcb5-d79254e9d42f None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:26.041168 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc43-de5a-4a9e-bcb5-d79254e9d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:26.094347 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6a7dcc43-de5a-4a9e-bcb5-d79254e9d42f None None] MFA Rules not processed for user `60d22b45fa0f4ccc87d5dae210f519fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:26.095600 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6a7dcc43-de5a-4a9e-bcb5-d79254e9d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:26.201942 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4579/9182] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:26:26.220529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:26.222425 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:26.327181 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae176-b7c5-4731-b30a-8d1f11331540 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:26.332876 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:26.333601 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:26.333954 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:26.334294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:26.368184 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:26.396317 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:26.398056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:26.408142 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4604/9183] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:26:27.439011 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:27.439547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:27.439547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:27.459770 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] MFA Rules not processed for user `2ba2c22356c54347901fa631b2d2ea28`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:26:27.461182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:27.468240 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4580/9184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:26:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:26:27.800468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:27.801924 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:27.866268 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1616e1-43a6-45c1-bb04-aeccad894e95 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:27.870166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:27.870780 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:27.871062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:27.871343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:27.873699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:26:27.884345 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:27.885842 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:27.894061 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4605/9185] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:26:37.454052 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:37.890382 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=39 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:38.871529 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:26:38.881180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e1216-d616-4b28-ba7f-3b01a2dc2e8a None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:26:38.884858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:26:38.885490 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:26:38.885773 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:26:38.886049 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:26:38.895032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:26:38.896463 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:26:38.906868 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4581/9186] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:26:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:26:48.902458 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:27:56.142188 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:27:56.143595 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:27:56.222005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87343a72-d941-4cd1-a055-263a8485cc8f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:27:56.227170 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:27:56.227775 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:27:56.228057 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:27:56.228329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:27:56.230052 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:27:56.241236 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:27:56.242835 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:27:56.252528 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4606/9187] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:27:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:28:05.320005 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:28:05.331003 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66904-dafb-4928-8fb6-1ab0fce7a31d service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:28:05.336781 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:28:05.337369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:28:05.337676 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:28:05.337945 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:28:05.339645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:28:05.350905 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:28:05.352474 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7337-dbd8-4032-823a-299583fdad6e service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:28:05.362049 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4582/9188] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:28:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:28:06.248470 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=36 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:28:15.358032 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:21.457628 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:21.459200 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:21.475490 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c6a8b-3126-4cec-9682-f6b6c842926e service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:21.481513 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:21.482244 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:21.482692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:21.483136 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:21.485270 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:21.500682 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:21.502521 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:21.514884 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4607/9189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:23.359024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:23.359511 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:23.359624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:23.413628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:29:23.416121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:23.481913 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4583/9190] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:29:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:29:23.530891 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:23.532434 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:23.622231 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cc246-8570-442b-ae98-c76581e5982d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:23.627142 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:23.627745 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:23.628026 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:23.628299 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:23.636809 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:23.638417 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2d334-260d-4f2c-abf6-2db8e40fdc5a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:23.646412 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4608/9191] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:29:33.478911 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=40 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:33.643164 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=47 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:35.147742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:35.167437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807863-9c05-4c32-a523-a3b5eb33d6de None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:35.171065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:35.171665 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:35.171942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:35.172209 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:35.173946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:35.187002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:35.188480 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:35.209690 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4584/9192] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:37.680851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:37.681779 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:37.682017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:37.702179 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] MFA Rules not processed for user `664154bf7b8d4ec9b0be57b37687ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:29:37.703311 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:37.713916 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4609/9193] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 25 02:29:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:29:37.729314 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:37.730796 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:37.788294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ff29-ed92-4b52-aea4-8ba8a3bb24e6 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:37.793024 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:37.793659 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:37.793940 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:37.794208 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:37.804417 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:37.806247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:37.817747 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4585/9194] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:29:37.883859 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:37.893245 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52aa84-65a3-4966-8d49-e375a53d766c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:37.896890 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:37.897518 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:37.897803 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:37.898662 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:37.900419 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:37.909814 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:37.911251 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:37.920098 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4610/9195] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:29:37.994354 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:38.003756 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cd66c-5bd5-4a33-a561-372a73d4cc1c service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:38.008223 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:38.008879 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:38.009165 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:38.009464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:38.011227 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:38.024435 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:38.025908 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:38.036692 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4586/9196] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:38.098139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:38.110663 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c852fc-b164-4332-a34d-42042938f468 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:38.115847 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:38.116449 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:38.117355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:38.117877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:38.119608 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:38.130906 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:38.132994 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca2400-b330-4d37-98f9-ed068d83a00e service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:38.143127 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4611/9197] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:39.091290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:39.099625 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7797f-c64f-4400-bf9a-572cf4f5bf6d service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:39.103436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:39.104020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:39.104294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:39.104562 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:39.106282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:39.115290 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:39.116702 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:39.124638 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4587/9198] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:40.772565 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:40.773648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:40.773648 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:40.793447 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:29:40.794635 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:40.801780 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4612/9199] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:29:40.813727 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:40.826076 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f06b66-6a3d-4a76-a2b4-52b365029389 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:40.831028 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:40.831619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:40.831897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:40.832166 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:40.841052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:40.842678 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b4f06-8076-4133-91e8-c3e1e061161f service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:40.850531 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4588/9200] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:29:47.321305 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:47.341606 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa6e7a-c62f-4890-9e87-32f4157bcfdd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:47.345440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:47.346059 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:47.346340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:47.346615 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:47.348389 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:47.420808 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:47.425652 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:47.465875 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4613/9201] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:29:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:29:50.847356 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=58 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:54.279662 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:54.280222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:54.280222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:54.300372 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:29:54.301614 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:29:54.309073 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4589/9202] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:29:54.321125 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:29:54.332074 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0508-df76-4921-8766-7c2a668ef173 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:29:54.337866 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:29:54.338456 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:29:54.338729 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:29:54.338995 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:29:54.346886 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:29:54.348459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece188d6-d99f-479f-9def-cc12a8980d76 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:29:54.357393 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4614/9203] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:30:04.295516 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=3 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:30:04.354151 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=52 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:09.362344 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:09.388154 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88db50-eb6f-4254-818e-5576df8b1bd2 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:09.396180 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:09.396929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:09.397275 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:09.397720 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:09.401284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:09.423060 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:09.424859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:09.445693 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4590/9204] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:14.281117 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:14.281687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:14.281687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:14.302223 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] MFA Rules not processed for user `2ba2c22356c54347901fa631b2d2ea28`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:31:14.303509 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:14.312327 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4615/9205] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:31:19.434079 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=9 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:24.296570 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:25.263125 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:25.264645 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:25.344081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f3698-3a14-4873-947f-f2e8657a7aa8 service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:25.347830 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9dafd81a8947f79616064549817153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:25.348378 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:25.348657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:25.348928 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:25.357704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:25.359758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:25.369593 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4591/9206] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:29.968503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:29.978488 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff5b1a-be47-4820-af07-31e635545197 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:29.982079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:29.982677 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:29.982983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:29.983262 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:29.990340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:29.991772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:30.000213 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4616/9207] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:30.454690 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:30.456130 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:30.471093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d05a-f89d-41ac-a4ab-e067e707a309 service cinder] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:30.476159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:30.476797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:30.477732 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:30.478152 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:30.480052 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:30.492247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:30.494473 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:30.504932 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4592/9208] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:32.272501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:32.281754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006f0e-0a35-416f-b654-5f329c0b89b8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:32.285599 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:32.286294 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:32.286644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:32.286988 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:32.288774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:32.300279 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:32.301878 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:32.312613 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4617/9209] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:40.500382 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=41 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:42.307807 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=12 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:50.682247 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:50.691794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1d8e-ee80-4df0-bf3e-41f37816f16b service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:50.696506 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:50.697086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:50.697369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:50.697674 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:50.706650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:50.708081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:50.718118 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4593/9210] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:31:52.286894 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:31:52.301073 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687c61-5e98-4e2e-8897-0f129bd8eb8a service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:31:52.307574 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:31:52.308257 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:31:52.308611 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:31:52.308958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:31:52.310818 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:31:52.323458 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:31:52.325172 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:31:52.336215 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4618/9211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:32:00.714883 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:32:02.331526 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:02.214547 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:33:02.226620 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded19-52e2-42ad-937c-2f9e740ed8f1 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:33:02.231564 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:33:02.232156 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:33:02.232437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:33:02.232710 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:33:02.241107 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:33:02.242730 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:33:02.252615 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4594/9212] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:33:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:33:12.248307 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:12.289462 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:33:12.300845 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9313d0-6928-454b-8f30-42d6e32b8c92 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:33:12.305857 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:33:12.306451 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:33:12.306782 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:33:12.307056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:33:12.315939 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:33:12.317571 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:33:12.327413 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4619/9213] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:33:22.323110 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:34:02.145858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:34:02.155415 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337831cb-eead-465c-bbed-ab54cb983c11 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:34:02.159199 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:34:02.159797 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:34:02.160077 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:34:02.160349 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:34:02.162943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:34:02.173611 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:34:02.174989 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:34:02.183911 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4595/9214] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:34:12.180224 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:36.394139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:36.405217 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4295ef-8cad-47de-92bb-a476d0bcbfcd service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:36.411343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:36.412697 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:36.413282 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:36.414285 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:36.427432 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:36.428932 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:36.441933 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4620/9215] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:35:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:35:37.635769 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:37.645284 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9dec4-2bb8-4bcb-a329-ccd908e7353d service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:37.648926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:37.649583 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:37.649861 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:37.650133 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:37.661100 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:37.662568 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:37.673607 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4596/9216] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:35:43.524549 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:43.534379 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275168b2-7b29-44e6-a33b-fac1531ecf7b service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:43.538335 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:43.538945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:43.539221 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:43.539489 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:43.603877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:43.605899 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:43.615797 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4621/9217] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:35:46.892368 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:46.905549 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba559-27f3-43e1-8a56-eab5c02fe2fe service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:46.910713 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:46.911320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:46.911607 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:46.911923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:46.914433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:46.942836 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:46.944978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:46.959519 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4597/9218] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:35:50.184656 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:50.194707 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d768-543d-4f21-8007-fcb021fe8b24 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:50.200061 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:50.200695 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:50.200978 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:50.201253 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] PATH_INFO: `/v3/users/2ba2c22356c54347901fa631b2d2ea28` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:50.202405 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba2c22356c54347901fa631b2d2ea28)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:50.204406 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:50.251748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba2c22356c54347901fa631b2d2ea28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.258764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba2c22356c54347901fa631b2d2ea28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.271344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba2c22356c54347901fa631b2d2ea28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.272036 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba2c22356c54347901fa631b2d2ea28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.272651 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba2c22356c54347901fa631b2d2ea28'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.297262 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4622/9219] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:35:50 2022] DELETE /identity/v3/users/2ba2c22356c54347901fa631b2d2ea28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:50.473082 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:50.484487 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d027-2fb6-421b-9b08-1ed72e6e3f2f service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:50.541726 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:50.542595 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:50.542897 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:50.543171 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] PATH_INFO: `/v3/projects/22ad80c717834d09b7a3e0d396510679` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:50.544282 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ad80c717834d09b7a3e0d396510679)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:50.546242 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:50.594121 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ad80c717834d09b7a3e0d396510679', 'request_id': 'req-d560a0da-3618-448b-bd57-3a65b8d1d59b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.600464 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ad80c717834d09b7a3e0d396510679', 'request_id': 'req-d560a0da-3618-448b-bd57-3a65b8d1d59b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.606230 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ad80c717834d09b7a3e0d396510679', 'request_id': 'req-d560a0da-3618-448b-bd57-3a65b8d1d59b'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.618015 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] The token cache is being invalidate because project 22ad80c717834d09b7a3e0d396510679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:35:50.618302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.618926 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.620998 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4598/9220] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:35:50 2022] DELETE /identity/v3/projects/22ad80c717834d09b7a3e0d396510679 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:50.625050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:50.626471 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:50.640143 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739e00-522e-4019-8e19-78a8b3afaaac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:50.689330 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:50.700740 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:50.701442 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:50.701721 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:50.701989 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] PATH_INFO: `/v3/users/60d22b45fa0f4ccc87d5dae210f519fd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:50.703115 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d22b45fa0f4ccc87d5dae210f519fd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:50.705035 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:50.749545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d22b45fa0f4ccc87d5dae210f519fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.756736 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d22b45fa0f4ccc87d5dae210f519fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.771344 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d22b45fa0f4ccc87d5dae210f519fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.772075 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d22b45fa0f4ccc87d5dae210f519fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.772724 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d921d8f-20bd-4e1f-9f88-a7ca3c534073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d22b45fa0f4ccc87d5dae210f519fd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:50.785479 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4623/9221] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:35:50 2022] DELETE /identity/v3/users/60d22b45fa0f4ccc87d5dae210f519fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:50.954893 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:50.956394 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:50.970504 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a0da-3618-448b-bd57-3a65b8d1d59b admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.020116 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:51.031452 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.032098 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.032630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.032907 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] PATH_INFO: `/v3/projects/8641f996172f47b1b4055ba826f0d0f3` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.034050 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8641f996172f47b1b4055ba826f0d0f3)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.035978 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.082128 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8641f996172f47b1b4055ba826f0d0f3', 'request_id': 'req-0222a440-fee4-4085-81b7-7b29dfeb20e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:51.088096 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8641f996172f47b1b4055ba826f0d0f3', 'request_id': 'req-0222a440-fee4-4085-81b7-7b29dfeb20e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:51.094225 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8641f996172f47b1b4055ba826f0d0f3', 'request_id': 'req-0222a440-fee4-4085-81b7-7b29dfeb20e0'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:51.106653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] The token cache is being invalidate because project 8641f996172f47b1b4055ba826f0d0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:35:51.106941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:51.107561 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-0222a440-fee4-4085-81b7-7b29dfeb20e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:35:51.109049 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4599/9222] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:35:50 2022] DELETE /identity/v3/projects/8641f996172f47b1b4055ba826f0d0f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:51.114232 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.114520 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.114795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.143999 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:35:51.145130 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:51.204285 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4624/9223] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:35:51.211922 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.212207 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.212482 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.232569 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:35:51.233791 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:51.241656 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4600/9224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:35:51.246324 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.255930 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0286-54fe-44fb-905e-32b90cbcd881 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.260584 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.261705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.261983 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.262242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.262884 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 25 02:35:51.263183 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.264774 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.276016 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4625/9225] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 25 02:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 25 02:35:51.280222 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.289656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5676a-5dc3-4109-8e00-c1a469e4c4a3 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.294672 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.295277 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.295560 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.295860 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.296478 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.298436 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.326201 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4601/9226] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:35:51 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:35:51.330264 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.340186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9da52-7e0d-4df1-88c5-5be5719e2fc9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.392470 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:51.402000 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.402762 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.403238 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.403987 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.404643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.406728 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.435069 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4626/9227] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:35:51 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:35:51.436216 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.446492 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d9596-f085-49c8-b133-7f46f3273c77 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.451758 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.452443 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.453742 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.454369 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.455031 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.456650 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.467156 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4602/9228] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 25 02:35:51.471185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.481560 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d102d-7e7d-479f-9b2c-1918b46d5919 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.486296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.486896 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.487180 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.487455 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.488096 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.489768 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f87b4-513c-4474-bbd7-6d1fefd6af6a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.501068 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4627/9229] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:35:51.505086 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.515998 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02392-1390-45bc-8fc8-b2530b59eb57 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.520657 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.521306 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.521628 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.521906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] PATH_INFO: `/v3/projects/f3e7e2a4385b4a82b425e2996388b19f/users/50316ca84b47420e93d1a492dbca830a/roles/fdda722dbaf545f283cce96500a5ed63` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.536455 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e7e2a4385b4a82b425e2996388b19f, user_id=50316ca84b47420e93d1a492dbca830a, role_id=fdda722dbaf545f283cce96500a5ed63)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.539167 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.552163 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4603/9230] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:35:51 2022] PUT /identity/v3/projects/f3e7e2a4385b4a82b425e2996388b19f/users/50316ca84b47420e93d1a492dbca830a/roles/fdda722dbaf545f283cce96500a5ed63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:51.557996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e505cd-1950-4673-b1c2-ff4acf0e5dcd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.558440 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e505cd-1950-4673-b1c2-ff4acf0e5dcd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.558718 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e505cd-1950-4673-b1c2-ff4acf0e5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.577711 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-98e505cd-1950-4673-b1c2-ff4acf0e5dcd None None] MFA Rules not processed for user `90697e4fcb7e4bb39c8b9cc770ece301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:35:51.578917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98e505cd-1950-4673-b1c2-ff4acf0e5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:51.638383 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4628/9231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 25 02:35:51.648035 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:51.649794 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:51.707475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5f2c6-9879-4cc8-973d-b73615d3c427 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:51.711081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:51.711685 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:51.711969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:51.712243 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:51.722071 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:51.723520 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:51.733187 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4604/9232] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:35:55.834958 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:55.835463 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:55.835568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:55.864898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] MFA Rules not processed for user `50316ca84b47420e93d1a492dbca830a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:35:55.866157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:35:55.932860 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4629/9233] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:35:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:35:55.937433 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:55.947220 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece4e1-30cc-4d69-a622-977fc62edc01 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:55.951903 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db490-b376-403f-9644-200538355248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:55.952510 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db490-b376-403f-9644-200538355248 admin admin] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:55.952793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db490-b376-403f-9644-200538355248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:55.953068 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db490-b376-403f-9644-200538355248 admin admin] PATH_INFO: `/v3/projects` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:55.953731 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db490-b376-403f-9644-200538355248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:55.955656 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db490-b376-403f-9644-200538355248 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:55.981769 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:55.989023 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4605/9234] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 25 02:35:55 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:35:55.992996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:56.004321 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f64de-8d4e-4cf3-bda6-21e27b660910 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:56.063895 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:56.064519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:56.064804 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:56.065079 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:56.065754 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:56.067752 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:56.076975 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:56.091640 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4630/9235] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 25 02:35:55 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 25 02:35:56.095850 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db490-b376-403f-9644-200538355248 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:56.107268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db490-b376-403f-9644-200538355248 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:56.112389 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:56.113020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:56.113311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:56.113624 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:56.114274 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:56.115887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:56.131215 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4606/9236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:35:56.132339 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:56.146459 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5bcc-b595-40be-afa6-6688d5a784af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:56.151545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:56.152342 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:56.152696 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:56.153041 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] PATH_INFO: `/v3/projects/d60e15de30d34199880479e31733f3c2/users/94ac9f2455184210b226b832effe0a62/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:56.174259 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60e15de30d34199880479e31733f3c2, user_id=94ac9f2455184210b226b832effe0a62, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:56.176945 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:56.190707 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4631/9237] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:35:56 2022] PUT /identity/v3/projects/d60e15de30d34199880479e31733f3c2/users/94ac9f2455184210b226b832effe0a62/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:35:56.194414 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:56.206263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22f7e-1fc6-494d-b062-3bf11898ede6 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:56.266095 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:56.266718 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:56.266995 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:56.267267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:56.267906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:56.269748 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d7b18-ef87-4811-82e5-a901c8cedafd admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:56.281074 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4607/9238] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 02:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 25 02:35:56.285423 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:35:56.297118 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a85f5e-8e8f-4837-a617-00694b05d98c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:35:56.302271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:35:56.302946 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:35:56.303228 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:35:56.303503 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] PATH_INFO: `/v3/projects/d60e15de30d34199880479e31733f3c2/users/94ac9f2455184210b226b832effe0a62/roles/ce0f72b1198f4b18845fae1c4d7f94af` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:35:56.305519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60e15de30d34199880479e31733f3c2, user_id=94ac9f2455184210b226b832effe0a62, role_id=ce0f72b1198f4b18845fae1c4d7f94af)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:35:56.308550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:35:56.319580 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4632/9239] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 25 02:35:56 2022] PUT /identity/v3/projects/d60e15de30d34199880479e31733f3c2/users/94ac9f2455184210b226b832effe0a62/roles/ce0f72b1198f4b18845fae1c4d7f94af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:36:00.694988 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782e9f-b53d-44a1-bb5d-65fd634f2f71 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:36:00.695518 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782e9f-b53d-44a1-bb5d-65fd634f2f71 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:36:00.695815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782e9f-b53d-44a1-bb5d-65fd634f2f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:36:00.725311 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-5b782e9f-b53d-44a1-bb5d-65fd634f2f71 None None] MFA Rules not processed for user `94ac9f2455184210b226b832effe0a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:36:00.726658 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5b782e9f-b53d-44a1-bb5d-65fd634f2f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:36:00.805938 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4608/9240] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:36:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:36:00.825144 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:36:00.827567 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:36:00.919593 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f689e9-2812-4653-ab94-01ea37b569f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:36:00.925802 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:36:00.926333 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:36:00.926687 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:36:00.927030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:36:01.014532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:36:01.016271 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:36:01.025888 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4633/9241] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:36:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:36:02.085093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:36:02.085639 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:36:02.085755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:36:02.106500 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] MFA Rules not processed for user `50316ca84b47420e93d1a492dbca830a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:36:02.107709 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:36:02.114572 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4609/9242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:36:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:36:11.021422 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=5,keystone:SELECT=73 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:11.397986 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:36:11.399572 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:36:11.422012 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63102370-2732-46fb-9e93-d95990e512e0 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:36:11.427772 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:36:11.428392 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:36:11.428675 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:36:11.428951 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:36:11.431067 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:36:11.444064 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:36:11.445699 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:36:11.458043 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4634/9243] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:36:12.099994 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=71 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:13.624200 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:36:13.681444 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca953a-3eeb-4feb-8dae-a4f5f6ebe828 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:36:13.685085 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:36:13.685719 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:36:13.686002 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:36:13.686273 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:36:13.695268 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:36:13.696704 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:36:13.707322 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4610/9244] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:36:21.452275 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:23.702950 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=26 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:37:07.025356 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:37:07.026838 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:37:07.054464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb119a-3db4-4fd6-a327-2ca828fe315a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:37:07.058017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:37:07.058623 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:37:07.058898 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:37:07.059166 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:37:07.060851 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:37:07.070343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:37:07.071761 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:37:07.079841 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4635/9245] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:37:17.076078 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:06.194324 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:38:06.195739 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:38:06.273858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201df2-0986-46fa-8e13-1c0f3a71f3aa service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:38:06.278856 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:38:06.279461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:38:06.279745 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:38:06.280020 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:38:06.281780 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:38:06.293335 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:38:06.294943 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3d3d5-45e3-4422-8782-5570e47a39f0 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:38:06.305498 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4611/9246] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:38:16.301473 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=36 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:18.303496 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:38:18.315414 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e3c5-1437-49bb-ba1e-0c0ec696f485 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:38:18.320368 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:38:18.320962 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:38:18.321242 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:38:18.321545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:38:18.323240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:38:18.335100 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:38:18.336666 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:38:18.347031 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4636/9247] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:38:28.342251 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:51.220898 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb2fc-9c8c-4800-b3c6-73e31fd8b19a None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:38:51.221483 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb2fc-9c8c-4800-b3c6-73e31fd8b19a None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:38:51.222044 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb2fc-9c8c-4800-b3c6-73e31fd8b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:38:51.252281 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-d6beb2fc-9c8c-4800-b3c6-73e31fd8b19a None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:38:51.253597 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-d6beb2fc-9c8c-4800-b3c6-73e31fd8b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:38:51.309257 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4612/9248] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:38:51.362453 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:38:51.363848 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:38:51.433006 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca80a9-9f32-488c-88fd-821ed896d9e6 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:38:51.438139 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:38:51.438747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:38:51.439030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:38:51.439302 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:38:51.447855 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:38:51.449468 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:38:51.457488 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4637/9249] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:38:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:39:01.302562 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=29 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:01.454214 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=32 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:01.643891 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:01.644182 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:01.644458 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:01.663826 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] MFA Rules not processed for user `50316ca84b47420e93d1a492dbca830a`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:39:01.665023 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:01.672436 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4613/9250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 25 02:39:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:39:02.002506 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:02.012237 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fed5a-5e84-4730-a67e-2b2766c27263 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:02.015798 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:02.016383 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:02.016659 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:02.016927 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:02.018620 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:02.028301 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:02.029764 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d38d3-9218-469f-8214-0dc3c8173dd7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:02.037489 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4638/9251] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:39:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:39:03.372302 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:03.373841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:03.389045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681b6b-7fa3-474f-9dd5-54cb360e71db None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:03.394065 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:03.394668 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:03.394946 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:03.395851 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:03.397557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:03.408841 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:03.410499 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:03.421046 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4614/9252] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:39:08.639429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:08.639953 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:08.640065 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:08.659616 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:39:08.661291 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:08.669039 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4639/9253] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:39:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:39:08.683753 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:08.696941 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa6e8-27a4-4703-92ef-c40232df8c06 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:08.703032 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:08.703755 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:08.704105 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:08.704640 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:08.713661 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:08.715376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:08.733600 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4615/9254] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:39:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:39:16.222646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:16.234050 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255092ec-ca69-426f-9981-f42e621d7b7d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:16.237801 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:16.238445 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:16.239030 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:16.239326 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:16.241107 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:16.251163 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:16.252658 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:16.261992 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4640/9255] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:39:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:39:16.948746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:16.968430 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60081-c21d-40a1-9400-0b4753028a3b service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:16.977552 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:16.978484 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:16.978833 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:16.979175 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:16.981619 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:17.016045 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:17.018043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:17.037141 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4616/9256] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:39:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:39:25.461378 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:39:25.475369 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4711-acd7-4f59-831c-a2d631ea83a6 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:39:25.481429 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '664154bf7b8d4ec9b0be57b37687ecb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:39:25.482062 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:39:25.482340 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:39:25.482610 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:39:25.484343 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:39:25.497091 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:39:25.498714 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d286d-c755-468f-afb6-0d50fde227f2 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:39:25.509289 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4641/9257] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:39:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:39:27.031749 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=26 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:35.505233 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=21 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:40:56.883746 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:40:56.885169 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:40:56.990411 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2cca-38b6-4d8a-9218-c5d9376de37d service nova] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:40:56.994099 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:40:56.994707 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:40:56.994991 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:40:56.995267 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:40:56.996957 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:40:57.032123 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:40:57.033630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:40:57.054057 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4617/9258] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:40:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 25 02:41:00.405056 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208e02-6222-407e-b348-7146eece6cae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:00.405568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208e02-6222-407e-b348-7146eece6cae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:00.405686 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208e02-6222-407e-b348-7146eece6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:00.460421 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e5208e02-6222-407e-b348-7146eece6cae None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:41:00.461692 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5208e02-6222-407e-b348-7146eece6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:00.480219 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4642/9259] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 25 02:41:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:41:00.525815 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:00.547304 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a405-a7b2-438e-9266-4b6f5038b7ed service glance] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:00.553215 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:00.553901 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:00.554170 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:00.554437 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:00.563616 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:00.565461 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d066-cdf6-4d75-980e-fe8959605cbe service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:00.575143 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4618/9260] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:41:01.328607 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208e02-6222-407e-b348-7146eece6cae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:01.338776 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208e02-6222-407e-b348-7146eece6cae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:01.342996 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8565cc85e8a149ac8761b7f687ff7552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:01.343497 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:01.343789 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:01.346157 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:01.357657 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:01.359643 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:01.380980 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4643/9261] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:41:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:41:09.669735 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] REQUEST_METHOD: `POST` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:09.670253 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:09.670353 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:09.690059 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.auth.core [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81862) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:41:09.691263 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:09.706609 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4619/9262] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 02:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:41:09.719705 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:09.731376 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217d46-5036-4783-8796-1e0b2fd3a990 service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:09.736329 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:09.736921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:09.737203 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:09.737514 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:09.745439 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:09.747019 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14000407-ced6-491f-b7da-d89b87f693d1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:09.755571 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4644/9263] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:41:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:41:11.090776 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:11.111984 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179fc83-295e-4e52-a266-5ad54db5e723 None None] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:11.117308 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:11.118670 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:11.119193 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:11.120009 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:11.121397 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:11.138673 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:11.140159 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:11.151650 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4620/9264] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:41:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:41:14.660017 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:14.660501 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:14.660680 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:14.680636 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] MFA Rules not processed for user `54042d352c6b4bbb95af7eed835a7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 25 02:41:14.681877 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:14.688987 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4645/9265] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 25 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 25 02:41:14.701729 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:14.712854 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cfd5-4fe9-4b5e-bffc-d975cbb0a2b4 service neutron] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:14.717793 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f1c1451849424fa2b09e7ea786a539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:14.718376 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:14.718653 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:14.718923 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:14.727037 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:14.728606 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:14.736448 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4621/9266] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 25 02:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 25 02:41:18.773355 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:18.782917 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5202-2541-4e88-bf68-f17e1bb2e0d2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:18.786929 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910f4364ae7543ab928a58d9a13e2d2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:18.787532 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:18.787815 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:18.788087 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:18.858058 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:18.859545 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:18.878471 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4646/9267] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:41:22.032432 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:22.040407 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=94 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:22.051942 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d789a9-114c-4d7d-9148-e0389e9c5a1a service swift] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:22.062582 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:22.063294 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:22.063589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:22.063863 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:22.066333 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:22.084001 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:22.086164 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:22.107936 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4622/9268] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:41:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:41:25.333753 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:25.344550 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546160a-9eeb-47c9-bcf3-7a84cad1c289 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:25.349821 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:25.350464 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:25.350748 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:25.351023 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] PATH_INFO: `/v3/users/50316ca84b47420e93d1a492dbca830a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:25.352151 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=50316ca84b47420e93d1a492dbca830a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:25.354132 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:25.401338 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50316ca84b47420e93d1a492dbca830a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.408296 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50316ca84b47420e93d1a492dbca830a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.410335 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:25.424765 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50316ca84b47420e93d1a492dbca830a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.425519 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50316ca84b47420e93d1a492dbca830a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.426240 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50316ca84b47420e93d1a492dbca830a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.443395 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4647/9269] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:41:25 2022] DELETE /identity/v3/users/50316ca84b47420e93d1a492dbca830a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 25 02:41:25.619124 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:25.630542 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be932cc-3766-4316-b329-5c50d4573f22 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:25.694426 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:25.695155 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:25.695521 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:25.695859 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] PATH_INFO: `/v3/projects/f3e7e2a4385b4a82b425e2996388b19f` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:25.696994 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e7e2a4385b4a82b425e2996388b19f)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:25.698924 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:25.749459 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e7e2a4385b4a82b425e2996388b19f', 'request_id': 'req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.758141 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e7e2a4385b4a82b425e2996388b19f', 'request_id': 'req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.764139 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e7e2a4385b4a82b425e2996388b19f', 'request_id': 'req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.791589 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] The token cache is being invalidate because project f3e7e2a4385b4a82b425e2996388b19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:41:25.791883 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.792546 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.794343 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4623/9270] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:41:25 2022] DELETE /identity/v3/projects/f3e7e2a4385b4a82b425e2996388b19f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:41:25.798408 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:25.799816 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:25.812795 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd3c4-a224-4c42-9ad2-edb0b26839cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:25.868853 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:25.869529 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:25.869813 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:25.870089 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] PATH_INFO: `/v3/users/94ac9f2455184210b226b832effe0a62` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:25.871226 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ac9f2455184210b226b832effe0a62)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:25.873141 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:25.919757 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ac9f2455184210b226b832effe0a62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.926921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ac9f2455184210b226b832effe0a62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.938531 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ac9f2455184210b226b832effe0a62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.939185 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ac9f2455184210b226b832effe0a62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.939777 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ac9f2455184210b226b832effe0a62'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:25.952553 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4648/9271] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 02:41:25 2022] DELETE /identity/v3/users/94ac9f2455184210b226b832effe0a62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:41:26.131385 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:41:26.132858 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:41:26.145889 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30c0a3-e3a3-41a1-a748-36d3f77d9a27 admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:41:26.203679 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90697e4fcb7e4bb39c8b9cc770ece301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703ca81b507b4a13a3d49269a53cbe77', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:41:26.204318 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:41:26.204601 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:41:26.204878 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] PATH_INFO: `/v3/projects/d60e15de30d34199880479e31733f3c2` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:41:26.206043 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60e15de30d34199880479e31733f3c2)` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:41:26.208712 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:41:26.218987 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:26.257022 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60e15de30d34199880479e31733f3c2', 'request_id': 'req-5e666f39-7f28-4852-8f5b-29369e0503bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:26.262948 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60e15de30d34199880479e31733f3c2', 'request_id': 'req-5e666f39-7f28-4852-8f5b-29369e0503bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:26.268751 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60e15de30d34199880479e31733f3c2', 'request_id': 'req-5e666f39-7f28-4852-8f5b-29369e0503bc'} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:26.281151 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] The token cache is being invalidate because project d60e15de30d34199880479e31733f3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81862) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 25 02:41:26.281475 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:26.282137 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.notifications [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81862) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 25 02:41:26.283616 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4624/9272] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 02:41:26 2022] DELETE /identity/v3/projects/d60e15de30d34199880479e31733f3c2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 25 02:41:35.949243 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=60,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:36.278183 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:43:11.204248 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:43:11.205751 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:43:11.277575 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67920397-0da5-4b96-828f-94fb4cb59e11 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:43:11.336108 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:43:11.336722 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:43:11.337005 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:43:11.337277 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:43:11.339081 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:43:11.350252 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:43:11.351831 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:43:11.361517 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4649/9273] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:43:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:43:21.357412 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=58 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:43:24.260630 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:43:24.262093 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:43:24.276887 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f39-7f28-4852-8f5b-29369e0503bc admin admin] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:43:24.281929 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:43:24.282525 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:43:24.282807 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:43:24.283081 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:43:24.284820 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.fernet_utils [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81862) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 25 02:43:24.296177 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:43:24.297803 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:43:24.308080 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4625/9274] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:43:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:43:34.304059 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=6 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:48:12.139568 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:48:12.165747 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e204a6-ced1-45db-98ad-529d27ae74c9 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:48:12.171048 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:48:12.171644 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:48:12.171921 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:48:12.172186 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:48:12.181039 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:48:12.182646 n-d-master-1 devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd677c3-13f5-4d2c-8581-ad473574d765 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:48:12.192731 n-d-master-1 devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4650/9275] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:48:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:48:22.188253 n-d-master-1 devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:48:29.258460 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] Authenticating user token {{(pid=81862) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 25 02:48:29.282563 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbf95-3ee8-480a-999e-c01609064649 service placement] Validating token access rules against request {{(pid=81862) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 25 02:48:29.288370 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9805de18a574ac1bba25ba2a64ebae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '010a52b78fc842a58d4ab3351e03e76b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81862) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 25 02:48:29.288969 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] REQUEST_METHOD: `GET` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 25 02:48:29.289249 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] SCRIPT_NAME: `/identity` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 25 02:48:29.289557 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81862) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 25 02:48:29.298320 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 25 02:48:29.299906 n-d-master-1 devstack@keystone.service[81862]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237ea8-7b43-49d4-9b93-d95c68e94bfa service placement] RBAC: Authorization granted {{(pid=81862) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 25 02:48:29.309694 n-d-master-1 devstack@keystone.service[81862]: [pid: 81862|app: 0|req: 4626/9276] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 25 02:48:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 25 02:48:39.305570 n-d-master-1 devstack@keystone.service[81862]: DEBUG dbcounter [-] [81862] Writing DB stats keystone:SELECT=10 {{(pid=81862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}